-- Logs begin at Tue 2022-06-07 21:16:29 UTC, end at Tue 2022-06-07 22:18:52 UTC. -- Jun 07 21:46:46.286902 dv-cinder-835525-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 07 21:46:46.295407 dv-cinder-835525-4-smb devstack@keystone.service[80395]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 07 21:46:46.297943 dv-cinder-835525-4-smb devstack@keystone.service[80395]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 21:46:46 2022] *** Jun 07 21:46:46.297943 dv-cinder-835525-4-smb devstack@keystone.service[80395]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 21:46:46.297943 dv-cinder-835525-4-smb devstack@keystone.service[80395]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 21:46:46.297943 dv-cinder-835525-4-smb devstack@keystone.service[80395]: nodename: dv-cinder-835525-4-smb Jun 07 21:46:46.297943 dv-cinder-835525-4-smb devstack@keystone.service[80395]: machine: x86_64 Jun 07 21:46:46.297943 dv-cinder-835525-4-smb devstack@keystone.service[80395]: clock source: unix Jun 07 21:46:46.297943 dv-cinder-835525-4-smb devstack@keystone.service[80395]: pcre jit disabled Jun 07 21:46:46.297943 dv-cinder-835525-4-smb devstack@keystone.service[80395]: detected number of CPU cores: 4 Jun 07 21:46:46.297943 dv-cinder-835525-4-smb devstack@keystone.service[80395]: current working directory: / Jun 07 21:46:46.297943 dv-cinder-835525-4-smb devstack@keystone.service[80395]: detected binary path: /usr/bin/uwsgi-core Jun 07 21:46:46.298511 dv-cinder-835525-4-smb devstack@keystone.service[80395]: your processes number limit is 47680 Jun 07 21:46:46.298511 dv-cinder-835525-4-smb devstack@keystone.service[80395]: your memory page size is 4096 bytes Jun 07 21:46:46.298511 dv-cinder-835525-4-smb devstack@keystone.service[80395]: detected max file descriptor number: 2048 Jun 07 21:46:46.298511 dv-cinder-835525-4-smb devstack@keystone.service[80395]: lock engine: pthread robust mutexes Jun 07 21:46:46.298511 dv-cinder-835525-4-smb devstack@keystone.service[80395]: thunder lock: enabled Jun 07 21:46:46.298511 dv-cinder-835525-4-smb devstack@keystone.service[80395]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 07 21:46:46.298511 dv-cinder-835525-4-smb devstack@keystone.service[80395]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 21:46:46.342536 dv-cinder-835525-4-smb devstack@keystone.service[80395]: Python main interpreter initialized at 0x55b3f31839c0 Jun 07 21:46:46.342536 dv-cinder-835525-4-smb devstack@keystone.service[80395]: python threads support enabled Jun 07 21:46:46.342536 dv-cinder-835525-4-smb devstack@keystone.service[80395]: your server socket listen backlog is limited to 100 connections Jun 07 21:46:46.342536 dv-cinder-835525-4-smb devstack@keystone.service[80395]: your mercy for graceful operations on workers is 90 seconds Jun 07 21:46:46.342856 dv-cinder-835525-4-smb devstack@keystone.service[80395]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 21:46:46.342928 dv-cinder-835525-4-smb devstack@keystone.service[80395]: *** Operational MODE: preforking *** Jun 07 21:46:46.343204 dv-cinder-835525-4-smb devstack@keystone.service[80395]: *** uWSGI is running in multiple interpreter mode *** Jun 07 21:46:46.343204 dv-cinder-835525-4-smb devstack@keystone.service[80395]: spawned uWSGI master process (pid: 80395) Jun 07 21:46:46.343399 dv-cinder-835525-4-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 07 21:46:46.345963 dv-cinder-835525-4-smb devstack@keystone.service[80395]: spawned uWSGI worker 1 (pid: 80403, cores: 1) Jun 07 21:46:46.345963 dv-cinder-835525-4-smb devstack@keystone.service[80395]: spawned uWSGI worker 2 (pid: 80404, cores: 1) Jun 07 21:46:46.345963 dv-cinder-835525-4-smb devstack@keystone.service[80395]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 21:46:52.014654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 21:46:52.014654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: from cryptography.utils import int_from_bytes Jun 07 21:46:52.015435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 21:46:52.015435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: from cryptography.utils import int_from_bytes Jun 07 21:46:52.015544 dv-cinder-835525-4-smb devstack@keystone.service[80404]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 21:46:52.015544 dv-cinder-835525-4-smb devstack@keystone.service[80404]: from cryptography.utils import int_from_bytes Jun 07 21:46:52.015941 dv-cinder-835525-4-smb devstack@keystone.service[80404]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 21:46:52.015941 dv-cinder-835525-4-smb devstack@keystone.service[80404]: from cryptography.utils import int_from_bytes Jun 07 21:46:52.064613 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 21:46:52.064806 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 21:46:52.064976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 21:46:52.065068 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] command line args: [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 21:46:52.065175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 21:46:52.065263 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 21:46:52.065367 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] command line args: [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 21:46:52.065450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ================================================================================ {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 21:46:52.065638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 21:46:52.065720 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] admin_token = **** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.065819 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ================================================================================ {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 21:46:52.065907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] config_dir = [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.066105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] admin_token = **** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.066190 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.066285 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] config_source = [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.066365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] config_dir = [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.066467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] debug = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.066550 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.066672 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.066928 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] config_source = [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.066928 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] debug = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.067048 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.067111 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.067198 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.067258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.067435 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.067549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.067679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.067787 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.067910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] list_limit = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.068011 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.068110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] log_config_append = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.068218 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] list_limit = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.068318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.068412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] log_config_append = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.068512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] log_dir = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.068606 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.068706 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] log_file = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.068807 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] log_dir = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.068807 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] log_file = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.068981 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.069101 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.069179 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.069248 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.069369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.069472 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.069595 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.069686 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.069761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.069884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.069992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.070081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.070158 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.070308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.070388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.070542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.070617 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.070773 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.070852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.071000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.071115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.071229 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.071348 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.071458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.071597 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.071705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.071781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.071951 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.072029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.072226 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.072457 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.072641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] publish_errors = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.072764 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.072872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.072948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] publish_errors = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.073101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.073223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.073302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.073371 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.073490 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.073610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.073746 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.073829 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.073968 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] standard_threads = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.074058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.074203 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.074287 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] standard_threads = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.074455 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.074535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.074634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.074709 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.074811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] use_journal = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.074900 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.074976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] use_json = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.075053 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] use_journal = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.075147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] use_stderr = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.075228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] use_json = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.075323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] use_syslog = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.075406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] use_stderr = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.075504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] use_syslog = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.075578 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.075733 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 21:46:52.075807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.075988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.076073 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.076227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.076303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.076482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.076555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.076718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.076793 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.076953 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.077030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.077191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.077275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.077419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.077552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.077656 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.077731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.077900 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.078041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.078171 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.078249 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.078403 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.078476 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.078639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.078714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.078873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.078956 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.079108 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.079256 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.079355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.079437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.079588 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.079669 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.079828 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.079902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.080083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.080157 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.080327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.080408 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.080563 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.080638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.080794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.080868 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.081061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.081138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.081309 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.081382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.081558 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.081632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.081795 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.081871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.082046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.082123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.082274 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.082357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.082501 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.082576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.082737 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.082810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.082979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.083053 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.083195 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.083268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.083423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.083505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.083661 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.083736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.083904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.083979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.084140 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.084216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.084373 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.084457 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.084602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.084676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.084836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.084911 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.085067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.085151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.085292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.085366 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.085518 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.085591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.085743 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.085824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.085991 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.086096 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.086224 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.086305 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.086459 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.086543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.086685 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.086759 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.086920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.086994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.087148 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.087237 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.087376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.087449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.087607 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.087686 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.087839 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.087922 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.088071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.088203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.088309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.088406 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.088525 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.088637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.088754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.088856 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.088986 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.089063 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.089217 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.089303 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.089446 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.089523 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.089673 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.089748 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.089917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.090564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.090695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.090773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.090924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.091055 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.091137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.091219 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.091395 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.091479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.091634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.091718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.091860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.091936 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.092093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.092176 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.092327 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.092402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.092589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.092666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.092825 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.092917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.093067 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.093148 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.093302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.093378 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.093535 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.093624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.093766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.093843 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.094020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.094100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.094262 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.094353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.094497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.094575 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.094730 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.094809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.094963 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.095115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.095189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.095258 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.095419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.095500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.095649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.095732 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.095880 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.095962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.096114 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.096190 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.096362 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.096438 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.096591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.096710 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.096823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.096901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.097057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.097134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.097289 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.097363 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.097522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.097598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.097754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.097838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.098011 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.098090 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.098240 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.098325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.098467 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.098550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.098699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.098775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.098923 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.099253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.099406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.099485 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.099637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.099714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.099868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.099943 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.100104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.100179 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.100338 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.100414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.100592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.100668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.100837 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.100912 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.101069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] auth.external = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.101188 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.101298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.101381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] auth.external = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.101525 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.101700 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.101805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.101887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.102050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] auth.password = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.102133 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.102281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] auth.password = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.102356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] auth.token = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.102511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] auth.token = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.102596 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.102741 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.102817 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.102973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.103049 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.103205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.103290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.103449 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.103528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.103696 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.103772 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.103928 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.104012 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.104158 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.104240 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] credential.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.104395 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] credential.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.104472 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.104640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.104725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.104887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.104964 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.105119 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.105195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.105359 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.105442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.105590 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.106281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.106402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.106479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.106672 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.106760 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.106907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.106990 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.107154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.107230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.107408 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.107492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.107665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.107741 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.107929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.108005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.108171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.108254 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.108427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.108503 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.108660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] federation.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.108736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.108897 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.108985 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] federation.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.109132 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.109207 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.109377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.109453 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.109607 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.109761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.109841 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.109913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.110104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.110181 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.110341 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.110429 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.110580 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.110656 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.110820 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.110895 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.111054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.111138 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.111299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.111376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.111532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.111608 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.111764 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.111852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.112011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.112087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.112253 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.112489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.113713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.114011 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.114226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.114303 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.114483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.114560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.114738 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.114818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.115005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.115083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.115272 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.115349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.115515 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.115633 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.115752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.115829 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.115988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.116071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.116224 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.116301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.116474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.116549 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.116729 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.116804 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.116985 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.117063 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.117232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.117307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.117488 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.117569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.117733 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.117810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.117998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.118077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.118233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.118310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.118471 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.118549 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.118702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.118778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.118933 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.119014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.119171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.119250 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.119410 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.119485 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.119654 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.119732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.119881 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.119957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.120130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.120205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.120375 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.120449 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.120610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.120688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.120848 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.120923 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.121092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.121166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.121346 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.121429 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.121583 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.121660 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.121813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.121889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.122070 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.122150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.122310 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.122385 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.122544 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.122619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.122777 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.122854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.123013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.123089 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.123254 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.123330 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.123498 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.123576 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.123729 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.123806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.123960 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.124036 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.124189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.124266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.124441 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.124518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.124674 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.124749 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.124908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.124986 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.125141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.125217 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.125368 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.125444 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.125598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.125675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.125837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.125914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.126101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.126178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.126342 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.126420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.126587 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.126664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.126832 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.126916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.127067 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.127143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.127296 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.127373 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.127524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.127608 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.127756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.127832 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.127989 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.128066 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.128217 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.128301 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.128445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.128521 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.128695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.128772 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.128937 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.129020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.129181 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.129257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.129422 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.129498 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.129650 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.129738 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.129885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.129976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.130155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.130233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.130389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.130477 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.130622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.130698 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.130852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.130928 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.131084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.131168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.131328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.131405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.131560 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.131636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.131800 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.131883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.132029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.132104 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.132276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.132351 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.132506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.132590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.132740 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.132816 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.132973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.133048 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.133209 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.133293 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.133446 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.133522 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.133676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.133752 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.133908 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.134106 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.134183 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.134253 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] resource.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.134394 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] resource.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.134478 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.134641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.134725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.134878 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.134954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.135112 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.135187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.135363 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.135446 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.135598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.135675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.135830 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.135906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.136067 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.136150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.136302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.136377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.136532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] role.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.136607 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.136765 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] role.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.136848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] role.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.137020 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.137097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] role.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.137257 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.137332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.137502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.137585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.137747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.137823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.138019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.138099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.138265 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.138352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.138511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.138587 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.138754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.138830 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.138999 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.139082 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.139227 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.139303 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.139470 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.139545 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.139715 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.139793 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.139961 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.140038 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.140204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.140280 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.140449 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.140600 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.140837 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.140912 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.141075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.141150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.141323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.141399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.141569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.141645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.141816 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.141891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.142070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.142149 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.142310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.142385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.142565 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.142641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.142799 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.142876 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.143027 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.143104 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.143258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.143333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.143486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.143562 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.143719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.143794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.143970 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.144047 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.144213 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.144289 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.144448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.144524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.144680 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.144756 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.144907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.144984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.145133 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.145208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] token.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.145363 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.145446 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] token.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.145596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.145672 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.145833 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.145908 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.146093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.146184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.146347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.146423 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.146582 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.146659 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.146817 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.146900 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.147055 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.147131 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.147295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.147371 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.147526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.147610 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.147763 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.147872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.147994 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.148071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.148227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.148311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.148471 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.148547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.148698 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.148775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.148931 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.149015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.149174 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.149252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.149466 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.149543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.connection = **** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.149705 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.149790 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.connection = **** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.149976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.150069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.150215 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.150294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.150449 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.150526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.150680 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.150756 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.150912 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.150989 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.151142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.151218 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.151383 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.151505 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.151601 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.151680 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.151837 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.151925 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.152070 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.152155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.152308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.152395 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.153068 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.153160 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.153322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.153409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.153558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.153635 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.153780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.153866 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.154007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.154093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.154250 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.154338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.154410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 21:46:52.154507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 21:46:52.154680 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 21:46:52.183415 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.183645 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.183898 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.183980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.184175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.184400 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.192198 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.192740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.220295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.220523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.220962 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.221193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.274300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.274635 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.322662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.322896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.323286 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.323524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.389816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.390078 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.390304 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.390458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.390594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.390722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.390848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.390973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.391109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.391237 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.391237 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.391475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.414209 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.414419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.414631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.414714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.414862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.414944 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.415082 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.415173 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.415295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.415377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.415506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.415589 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.415733 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.415951 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.426350 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.426755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.439028 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.439263 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.439413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.439541 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.439667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.439804 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.439934 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.440067 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.440194 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.440323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.440452 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.440580 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.440720 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.440720 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 21:46:52.457914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.458147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 07 21:46:52.458481 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.458682 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 07 21:46:52.458810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.458943 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.459068 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 07 21:46:52.459193 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.459343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.459479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.459614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 07 21:46:52.459740 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.459865 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.460048 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.460307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.460564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.470998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.471275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.471544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.471827 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.471962 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.472197 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.472468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.472748 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.480337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.481349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.483667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.483947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.484228 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.484507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.484644 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.484776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.484900 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.485030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.485181 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.485316 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.485454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.485584 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.485713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.485841 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.485990 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.486127 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.486255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.486384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.486513 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.486767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.487039 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.487306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.513145 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.514284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.514776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.515054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.515896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.516172 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.520417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.520695 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.520974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.521571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.521848 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.522155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.528851 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.529090 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.530025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.530308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.533562 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.533850 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.534159 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.534440 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.534714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.534796 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.534984 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.535064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.535250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.535341 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.535595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.535675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.535872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.536145 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.536416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.536798 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.554385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.554721 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.555883 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.556179 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.559255 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.561225 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.563014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.563332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.566164 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.566569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.568348 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.571759 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.572027 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.576067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.576279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.576546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.576756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.576984 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.577278 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.577575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.580907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.581014 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.581302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.581629 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.581975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.582325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.598028 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.598314 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.598589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.598850 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.602928 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.603216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.603486 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.603751 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.607007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.610400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.610685 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.611747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.613719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.614092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.614321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.614602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.614886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.615090 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.615374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.618465 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.618751 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.619040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.619322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.619608 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.628245 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.628528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.628810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.629088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.629372 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.629648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.629956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.632994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.633276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.633556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.633837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.634147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.634426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.634716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.648324 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.651598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.653717 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.655643 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.657024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.657251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.658924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.659202 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.659487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.660516 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.662169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.663798 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.664077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.664355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.666738 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.668385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.671736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.671837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.672026 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.672309 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.672595 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.673421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.676793 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.677086 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.677372 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.677670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.681809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.682123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.682403 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.687317 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.687604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.687884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.691004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.691282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.691562 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.691834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.692102 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.692379 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.692653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.692924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.693191 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.693455 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.693722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.694024 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.694296 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.694559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.695879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 21:46:52.696159 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.696440 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.696714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.696985 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.697256 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.697531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.697818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.698115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.698386 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.698656 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.698943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.699216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.700094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 21:46:52.732981 dv-cinder-835525-4-smb devstack@keystone.service[80403]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b3f31839c0 pid: 80403 (default app) Jun 07 21:46:52.736398 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bf6df-b42f-49ad-b94c-d12b15f9197f None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:46:52.736697 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bf6df-b42f-49ad-b94c-d12b15f9197f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:46:52.736973 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bf6df-b42f-49ad-b94c-d12b15f9197f None None] PATH_INFO: `/v3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:46:52.737973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b3f31839c0 pid: 80404 (default app) Jun 07 21:46:52.741158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Tue Jun 7 21:46:52 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:00.679428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43f4da-4e98-4ae3-bc13-e7dbe7815829 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:00.679954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43f4da-4e98-4ae3-bc13-e7dbe7815829 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:00.679954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43f4da-4e98-4ae3-bc13-e7dbe7815829 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:00.684886 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:47:00.690006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16a0cb-f9af-4aa5-94ad-3f2be6012742 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:00.690436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16a0cb-f9af-4aa5-94ad-3f2be6012742 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:00.690551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16a0cb-f9af-4aa5-94ad-3f2be6012742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:00.757039 dv-cinder-835525-4-smb devstack@keystone.service[80403]: INFO dbcounter [None req-5f16a0cb-f9af-4aa5-94ad-3f2be6012742 None None] Registered counter for database keystone Jun 07 21:47:00.777785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG oslo_db.sqlalchemy.engines [None req-5f16a0cb-f9af-4aa5-94ad-3f2be6012742 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 21:47:00.783824 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writer thread running {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 21:47:01.061387 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG passlib.handlers.bcrypt [None req-5f16a0cb-f9af-4aa5-94ad-3f2be6012742 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80403) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 07 21:47:01.061724 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG passlib.handlers.bcrypt [None req-5f16a0cb-f9af-4aa5-94ad-3f2be6012742 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80403) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 07 21:47:01.118176 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5f16a0cb-f9af-4aa5-94ad-3f2be6012742 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:01.119749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5f16a0cb-f9af-4aa5-94ad-3f2be6012742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:01.241002 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 552 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 07 21:47:01.380342 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43f4da-4e98-4ae3-bc13-e7dbe7815829 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:01.448084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: INFO dbcounter [None req-dd43f4da-4e98-4ae3-bc13-e7dbe7815829 None None] Registered counter for database keystone Jun 07 21:47:01.467890 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG oslo_db.sqlalchemy.engines [None req-dd43f4da-4e98-4ae3-bc13-e7dbe7815829 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80404) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 21:47:01.474432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writer thread running {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 21:47:01.695120 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43f4da-4e98-4ae3-bc13-e7dbe7815829 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:01.699450 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400ea4e-ef39-4ef9-8eee-5128af132ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:01.700104 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400ea4e-ef39-4ef9-8eee-5128af132ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:01.700383 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400ea4e-ef39-4ef9-8eee-5128af132ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:01.700656 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400ea4e-ef39-4ef9-8eee-5128af132ea1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:01.708602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400ea4e-ef39-4ef9-8eee-5128af132ea1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:01.760554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6400ea4e-ef39-4ef9-8eee-5128af132ea1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 07 21:47:01.760892 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400ea4e-ef39-4ef9-8eee-5128af132ea1 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:01.770135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Jun 7 21:47:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 21:47:01.776059 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16a0cb-f9af-4aa5-94ad-3f2be6012742 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:01.790927 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16a0cb-f9af-4aa5-94ad-3f2be6012742 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:01.795367 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a698c8-5d86-42b1-a800-0775f67ea936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:01.796484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a698c8-5d86-42b1-a800-0775f67ea936 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:01.796764 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a698c8-5d86-42b1-a800-0775f67ea936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:01.797034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a698c8-5d86-42b1-a800-0775f67ea936 admin admin] PATH_INFO: `/v3/projects/d15d054b930a4d03bfa50272128a53b7` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:01.798612 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a698c8-5d86-42b1-a800-0775f67ea936 admin admin] RBAC: Authorizing `identity:get_project(project_id=d15d054b930a4d03bfa50272128a53b7)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:01.848817 dv-cinder-835525-4-smb devstack@keystone.service[80403]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a1a698c8-5d86-42b1-a800-0775f67ea936 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 07 21:47:01.849414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a698c8-5d86-42b1-a800-0775f67ea936 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:01.855135 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Jun 7 21:47:01 2022] GET /identity/v3/projects/d15d054b930a4d03bfa50272128a53b7 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:04.057887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5e532-3006-4013-86fb-73681746b3e1 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:04.058445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5e532-3006-4013-86fb-73681746b3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:04.058445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5e532-3006-4013-86fb-73681746b3e1 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:04.062566 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:04.067829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09437b-58c9-4b37-ad60-0592c85b6261 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:04.068254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09437b-58c9-4b37-ad60-0592c85b6261 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:04.068381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09437b-58c9-4b37-ad60-0592c85b6261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:04.087312 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8f09437b-58c9-4b37-ad60-0592c85b6261 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:04.088803 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8f09437b-58c9-4b37-ad60-0592c85b6261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:04.097070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 07 21:47:04.120407 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5e532-3006-4013-86fb-73681746b3e1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:04.132523 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5e532-3006-4013-86fb-73681746b3e1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:04.136719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b0e06-5892-42d2-9cb1-021415ecd217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:04.137345 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b0e06-5892-42d2-9cb1-021415ecd217 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:04.137634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b0e06-5892-42d2-9cb1-021415ecd217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:04.137911 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b0e06-5892-42d2-9cb1-021415ecd217 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:04.145494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b0e06-5892-42d2-9cb1-021415ecd217 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:04.147291 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b0e06-5892-42d2-9cb1-021415ecd217 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:04.156466 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Jun 7 21:47:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 07 21:47:04.161637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09437b-58c9-4b37-ad60-0592c85b6261 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:04.170479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09437b-58c9-4b37-ad60-0592c85b6261 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:04.174732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698457b-345f-45c1-9135-ec1b2920a147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:04.175578 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698457b-345f-45c1-9135-ec1b2920a147 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:04.175861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698457b-345f-45c1-9135-ec1b2920a147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:04.176134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698457b-345f-45c1-9135-ec1b2920a147 admin admin] PATH_INFO: `/v3/users/6e81933b979640d390f4c808a9dcf7c6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:04.177501 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698457b-345f-45c1-9135-ec1b2920a147 admin admin] RBAC: Authorizing `identity:get_user(user_id=6e81933b979640d390f4c808a9dcf7c6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:04.179334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698457b-345f-45c1-9135-ec1b2920a147 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:04.180867 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Jun 7 21:47:04 2022] GET /identity/v3/users/6e81933b979640d390f4c808a9dcf7c6 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:06.450638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f7e6c-8417-40e6-bbc6-052bc9e84a3b None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:06.451155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f7e6c-8417-40e6-bbc6-052bc9e84a3b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:06.451260 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f7e6c-8417-40e6-bbc6-052bc9e84a3b None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:06.452539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:06.457677 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10841e1-b816-4fc2-88fd-18e9ceca26ad None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:06.458098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10841e1-b816-4fc2-88fd-18e9ceca26ad None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:06.458274 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10841e1-b816-4fc2-88fd-18e9ceca26ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:06.475389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d10841e1-b816-4fc2-88fd-18e9ceca26ad None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:06.476548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d10841e1-b816-4fc2-88fd-18e9ceca26ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:06.478243 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfc9f1-0560-4003-885b-7b2d7a02709d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:06.478733 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfc9f1-0560-4003-885b-7b2d7a02709d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:06.479021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfc9f1-0560-4003-885b-7b2d7a02709d None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:06.481696 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:06.487002 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e103ba-a9a7-4086-bef1-13bbdbcbe48e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:06.487295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e103ba-a9a7-4086-bef1-13bbdbcbe48e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:06.487580 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e103ba-a9a7-4086-bef1-13bbdbcbe48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:06.527823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG passlib.handlers.bcrypt [None req-e9e103ba-a9a7-4086-bef1-13bbdbcbe48e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80404) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 07 21:47:06.528246 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG passlib.handlers.bcrypt [None req-e9e103ba-a9a7-4086-bef1-13bbdbcbe48e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80404) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 07 21:47:06.554889 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:06.574562 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e9e103ba-a9a7-4086-bef1-13bbdbcbe48e None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:06.576146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e9e103ba-a9a7-4086-bef1-13bbdbcbe48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:06.577755 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10841e1-b816-4fc2-88fd-18e9ceca26ad None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:06.601086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:06.677310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:47:06.678607 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10841e1-b816-4fc2-88fd-18e9ceca26ad None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:06.700674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e103ba-a9a7-4086-bef1-13bbdbcbe48e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:06.714193 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b4e1d-21b9-4026-8eae-62d0d95e063d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:06.715615 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b4e1d-21b9-4026-8eae-62d0d95e063d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:06.715887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b4e1d-21b9-4026-8eae-62d0d95e063d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:06.716154 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b4e1d-21b9-4026-8eae-62d0d95e063d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:06.727307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b4e1d-21b9-4026-8eae-62d0d95e063d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:06.738377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-bc1b4e1d-21b9-4026-8eae-62d0d95e063d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:06.738377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:06.738377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:06.738377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:06.738377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:06.738377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:06.738377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:06.738377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:06.738377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:06.738377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:06.738377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:06.738377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:06.738377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:06.738377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:06.738377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:06.738377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:06.739333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:06.739333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:06.739333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:06.739333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:06.739333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:06.739333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:06.739333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:06.739333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:06.739333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:06.739333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:06.739333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:06.739333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:06.739333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:06.739333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:06.739333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:06.739333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:06.740153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:06.740153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:06.740153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:06.740153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:06.740153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:06.740153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:06.740153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:06.740153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:06.740153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:06.740153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:06.740153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:06.740153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:06.740153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:47:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:47:06.745273 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b4e1d-21b9-4026-8eae-62d0d95e063d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:06.800028 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e103ba-a9a7-4086-bef1-13bbdbcbe48e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:06.802348 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:06.826412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:06.837293 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe39be4-cab1-4cc0-b9e5-f1e7272af169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:06.838207 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe39be4-cab1-4cc0-b9e5-f1e7272af169 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:06.838489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe39be4-cab1-4cc0-b9e5-f1e7272af169 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:06.838763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe39be4-cab1-4cc0-b9e5-f1e7272af169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:06.844960 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b4e1d-21b9-4026-8eae-62d0d95e063d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:06.877632 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462d875-097e-415e-a2f1-04d70376ad1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:06.878327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462d875-097e-415e-a2f1-04d70376ad1d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:06.878619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462d875-097e-415e-a2f1-04d70376ad1d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:06.878899 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462d875-097e-415e-a2f1-04d70376ad1d None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:06.879649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462d875-097e-415e-a2f1-04d70376ad1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:06.879959 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462d875-097e-415e-a2f1-04d70376ad1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:06.881360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462d875-097e-415e-a2f1-04d70376ad1d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:06.893561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:06.898976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462d875-097e-415e-a2f1-04d70376ad1d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:06.906531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe39be4-cab1-4cc0-b9e5-f1e7272af169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:06.908456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe39be4-cab1-4cc0-b9e5-f1e7272af169 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:06.997516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462d875-097e-415e-a2f1-04d70376ad1d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:07.005383 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 21:47:07.010842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe39be4-cab1-4cc0-b9e5-f1e7272af169 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:07.014029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:07.031474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c9198-0eb1-4017-b28c-ba6bddbfa028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:07.032340 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c9198-0eb1-4017-b28c-ba6bddbfa028 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:07.032621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c9198-0eb1-4017-b28c-ba6bddbfa028 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:07.032891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c9198-0eb1-4017-b28c-ba6bddbfa028 None admin] PATH_INFO: `/v3/users/6e81933b979640d390f4c808a9dcf7c6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:07.034105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c9198-0eb1-4017-b28c-ba6bddbfa028 None admin] RBAC: Authorizing `identity:get_user(user_id=6e81933b979640d390f4c808a9dcf7c6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:07.035564 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c9198-0eb1-4017-b28c-ba6bddbfa028 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:07.037159 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:06 2022] GET /identity/v3/users/6e81933b979640d390f4c808a9dcf7c6 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:07.042335 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c9198-0eb1-4017-b28c-ba6bddbfa028 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:07.056790 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:07.108194 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe39be4-cab1-4cc0-b9e5-f1e7272af169 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:07.139085 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c9198-0eb1-4017-b28c-ba6bddbfa028 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:07.141074 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4594160-106f-42da-ad7b-371d1d9fc1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:07.141862 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4594160-106f-42da-ad7b-371d1d9fc1fc None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:07.142174 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4594160-106f-42da-ad7b-371d1d9fc1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:07.142446 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4594160-106f-42da-ad7b-371d1d9fc1fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:07.160953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4594160-106f-42da-ad7b-371d1d9fc1fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:07.162452 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4594160-106f-42da-ad7b-371d1d9fc1fc None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:07.173139 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470ad14-554a-41b1-af9c-4cc88d6bbac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:07.173914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470ad14-554a-41b1-af9c-4cc88d6bbac2 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:07.174279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470ad14-554a-41b1-af9c-4cc88d6bbac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:07.174556 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470ad14-554a-41b1-af9c-4cc88d6bbac2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:07.175733 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470ad14-554a-41b1-af9c-4cc88d6bbac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:07.177162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470ad14-554a-41b1-af9c-4cc88d6bbac2 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:07.178790 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:47:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:07.182884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-d4594160-106f-42da-ad7b-371d1d9fc1fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:47:07.182884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:07.182884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:07.182884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:07.182884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:07.182884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:07.182884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:07.182884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:07.182884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:07.182884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:07.182884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:07.182884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:07.182884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:47:07.182884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:47:07.182884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:47:07.184203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:47:07.184203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:07.184203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:07.184203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:07.184203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:07.184203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:07.184203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:07.184203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:07.184203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:07.184203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:07.184203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:07.184203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:07.184203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:07.184203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:07.184203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:07.184203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:07.184203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:07.185006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:47:07.185006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:47:07.185006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:47:07.185006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:07.185006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:47:07.185272 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470ad14-554a-41b1-af9c-4cc88d6bbac2 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:07.190357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4594160-106f-42da-ad7b-371d1d9fc1fc None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:07.245568 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:07.264979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:07.283924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470ad14-554a-41b1-af9c-4cc88d6bbac2 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:07.289252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4594160-106f-42da-ad7b-371d1d9fc1fc None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:07.316858 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d29da-9e52-43bc-9601-c8524cbd8864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:07.317508 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d29da-9e52-43bc-9601-c8524cbd8864 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:07.317791 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d29da-9e52-43bc-9601-c8524cbd8864 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:07.318106 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d29da-9e52-43bc-9601-c8524cbd8864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:07.318939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d29da-9e52-43bc-9601-c8524cbd8864 None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.domain.id=default, user.id=6e81933b979640d390f4c808a9dcf7c6) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:07.319248 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d29da-9e52-43bc-9601-c8524cbd8864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:07.320692 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d29da-9e52-43bc-9601-c8524cbd8864 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:07.322008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c6ea9-cf11-4459-9bc9-e0ce6df3a188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:07.322655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c6ea9-cf11-4459-9bc9-e0ce6df3a188 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:07.322930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c6ea9-cf11-4459-9bc9-e0ce6df3a188 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:07.323196 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c6ea9-cf11-4459-9bc9-e0ce6df3a188 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:07.323902 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c6ea9-cf11-4459-9bc9-e0ce6df3a188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:07.324724 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c6ea9-cf11-4459-9bc9-e0ce6df3a188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:07.326126 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c6ea9-cf11-4459-9bc9-e0ce6df3a188 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:07.327900 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Jun 7 21:47:07 2022] GET /identity/v3/role_assignments?user.id=6e81933b979640d390f4c808a9dcf7c6&scope.domain.id=default&role.id=8f58ef9d28494d97a68de20b84355450 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:07.351700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:09.787598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542eb7a-6eba-43ea-8157-70f4e94df34c None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:09.788591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542eb7a-6eba-43ea-8157-70f4e94df34c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:09.789073 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542eb7a-6eba-43ea-8157-70f4e94df34c None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:09.790662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:09.796396 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f440cb-5125-447f-83da-8999e399a3f0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:09.797216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f440cb-5125-447f-83da-8999e399a3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:09.797721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f440cb-5125-447f-83da-8999e399a3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:09.822906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-02f440cb-5125-447f-83da-8999e399a3f0 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:09.824960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-02f440cb-5125-447f-83da-8999e399a3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:09.907635 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:47:09.939287 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542eb7a-6eba-43ea-8157-70f4e94df34c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:10.075701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542eb7a-6eba-43ea-8157-70f4e94df34c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:10.123117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d087c18-cc61-4991-9ec3-04c6e3bd1252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:10.124302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d087c18-cc61-4991-9ec3-04c6e3bd1252 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:10.124807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d087c18-cc61-4991-9ec3-04c6e3bd1252 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:10.125277 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d087c18-cc61-4991-9ec3-04c6e3bd1252 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:10.147044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d087c18-cc61-4991-9ec3-04c6e3bd1252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:10.155874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-5d087c18-cc61-4991-9ec3-04c6e3bd1252 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:10.155874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:10.155874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:10.155874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:10.155874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:10.155874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:10.155874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:10.155874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:10.155874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:10.155874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:10.155874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:10.155874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:10.155874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:10.155874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:10.155874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:10.155874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:10.156781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:10.156781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:10.156781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:10.156781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:10.156781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:10.156781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:10.156781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:10.156781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:10.156781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:10.156781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:10.156781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:10.156781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:10.156781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:10.156781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:10.156781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:10.156781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:10.157537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:10.157537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:10.157537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:10.157537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:10.157537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:10.157537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:10.157537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:10.157537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:10.157537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:10.157537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:10.157537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:10.157537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:10.159480 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 13/24] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:47:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:10.165243 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f440cb-5125-447f-83da-8999e399a3f0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:10.233271 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:10.302379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f440cb-5125-447f-83da-8999e399a3f0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:10.322108 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982b2d4-eb19-43ce-98dd-312ae51e3db2 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:10.322402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982b2d4-eb19-43ce-98dd-312ae51e3db2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:10.322671 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982b2d4-eb19-43ce-98dd-312ae51e3db2 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:10.324576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 14/25] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:47:10.330428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a84bf-06f8-4350-a1cc-dd7d5a447ca5 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:10.330633 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a84bf-06f8-4350-a1cc-dd7d5a447ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:10.331114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a84bf-06f8-4350-a1cc-dd7d5a447ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:10.354332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:10.363455 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0b6a84bf-06f8-4350-a1cc-dd7d5a447ca5 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:10.365068 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0b6a84bf-06f8-4350-a1cc-dd7d5a447ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:10.383540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357e2ac-ef73-4643-88b8-494bcb97b263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:10.384222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357e2ac-ef73-4643-88b8-494bcb97b263 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:10.384508 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357e2ac-ef73-4643-88b8-494bcb97b263 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:10.384785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357e2ac-ef73-4643-88b8-494bcb97b263 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:10.385543 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357e2ac-ef73-4643-88b8-494bcb97b263 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:10.385849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357e2ac-ef73-4643-88b8-494bcb97b263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:10.387285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357e2ac-ef73-4643-88b8-494bcb97b263 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:10.409572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 12/26] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:10.414784 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357e2ac-ef73-4643-88b8-494bcb97b263 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:10.480780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 15/27] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:47:10.523212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a84bf-06f8-4350-a1cc-dd7d5a447ca5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:10.647854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357e2ac-ef73-4643-88b8-494bcb97b263 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:10.668794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:10.690903 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a84bf-06f8-4350-a1cc-dd7d5a447ca5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:10.702633 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a082f3-2e5e-4f8c-84c2-013f54df4399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:10.703663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a082f3-2e5e-4f8c-84c2-013f54df4399 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:10.704030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a082f3-2e5e-4f8c-84c2-013f54df4399 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:10.704506 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a082f3-2e5e-4f8c-84c2-013f54df4399 None admin] PATH_INFO: `/v3/users/6e81933b979640d390f4c808a9dcf7c6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:10.706378 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a082f3-2e5e-4f8c-84c2-013f54df4399 None admin] RBAC: Authorizing `identity:get_user(user_id=6e81933b979640d390f4c808a9dcf7c6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:10.708037 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a082f3-2e5e-4f8c-84c2-013f54df4399 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:10.714121 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 13/28] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:10 2022] GET /identity/v3/users/6e81933b979640d390f4c808a9dcf7c6 => generated 247 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:10.715769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0a662-4b9c-4d06-b585-1a5b91607b4a None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:10.716252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0a662-4b9c-4d06-b585-1a5b91607b4a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:10.716825 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0a662-4b9c-4d06-b585-1a5b91607b4a None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:10.718326 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 14/29] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:10.720282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0a662-4b9c-4d06-b585-1a5b91607b4a None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:10.727557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc591abb-d8b4-4b9e-9fa2-7691f79a320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:10.728418 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc591abb-d8b4-4b9e-9fa2-7691f79a320b None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:10.728874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc591abb-d8b4-4b9e-9fa2-7691f79a320b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:10.729289 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc591abb-d8b4-4b9e-9fa2-7691f79a320b None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:10.730361 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc591abb-d8b4-4b9e-9fa2-7691f79a320b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:10.731946 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc591abb-d8b4-4b9e-9fa2-7691f79a320b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:10.737073 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:10.877380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0a662-4b9c-4d06-b585-1a5b91607b4a None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:10.896508 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 16/30] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jun 7 21:47:10 2022] POST /identity/v3/roles => generated 219 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 21:47:10.898967 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523905dd-cbca-45d3-9594-f2133867addc None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:10.899554 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523905dd-cbca-45d3-9594-f2133867addc None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:10.900097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523905dd-cbca-45d3-9594-f2133867addc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:10.920467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-523905dd-cbca-45d3-9594-f2133867addc None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:10.922619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-523905dd-cbca-45d3-9594-f2133867addc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:10.940275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03d057-04f6-46d4-88ed-db412b0086ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:10.941202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03d057-04f6-46d4-88ed-db412b0086ac None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:10.941637 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03d057-04f6-46d4-88ed-db412b0086ac None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:10.942115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03d057-04f6-46d4-88ed-db412b0086ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:10.943564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03d057-04f6-46d4-88ed-db412b0086ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:10.955366 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03d057-04f6-46d4-88ed-db412b0086ac None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:10.957850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 15/31] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:47:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:10.959593 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07e70f-cf7e-49cc-aa17-36dd082c5e07 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:10.960047 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07e70f-cf7e-49cc-aa17-36dd082c5e07 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:10.960499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07e70f-cf7e-49cc-aa17-36dd082c5e07 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:10.962240 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 16/32] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:10.963335 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07e70f-cf7e-49cc-aa17-36dd082c5e07 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:11.004920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 17/33] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:11.006601 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437f86c-0a32-4c33-9838-5cfb47895700 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:11.007141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437f86c-0a32-4c33-9838-5cfb47895700 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:11.007617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437f86c-0a32-4c33-9838-5cfb47895700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:11.035161 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1437f86c-0a32-4c33-9838-5cfb47895700 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:11.036754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1437f86c-0a32-4c33-9838-5cfb47895700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:11.087108 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:11.115078 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 18/34] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:11.116275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437f86c-0a32-4c33-9838-5cfb47895700 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:11.167557 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07e70f-cf7e-49cc-aa17-36dd082c5e07 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:11.181331 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:11.219056 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4410a-f6e3-426f-a3c3-df4f1a0c72a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:11.220821 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4410a-f6e3-426f-a3c3-df4f1a0c72a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:11.221360 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4410a-f6e3-426f-a3c3-df4f1a0c72a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:11.221842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4410a-f6e3-426f-a3c3-df4f1a0c72a3 None admin] PATH_INFO: `/v3/domains/default/users/6e81933b979640d390f4c808a9dcf7c6/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:11.225007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4410a-f6e3-426f-a3c3-df4f1a0c72a3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6e81933b979640d390f4c808a9dcf7c6, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:11.227258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4410a-f6e3-426f-a3c3-df4f1a0c72a3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:11.246215 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437f86c-0a32-4c33-9838-5cfb47895700 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:11.286647 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533776b-0d08-4d0c-83ce-b283222c9b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:11.287654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533776b-0d08-4d0c-83ce-b283222c9b7a None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:11.288128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533776b-0d08-4d0c-83ce-b283222c9b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:11.288658 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533776b-0d08-4d0c-83ce-b283222c9b7a None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:11.289659 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533776b-0d08-4d0c-83ce-b283222c9b7a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:11.291394 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533776b-0d08-4d0c-83ce-b283222c9b7a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:11.307778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 19/35] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jun 7 21:47:11 2022] POST /identity/v3/roles => generated 225 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:47:11.309625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533776b-0d08-4d0c-83ce-b283222c9b7a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:11.381734 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 17/36] 10.222.0.18 () {58 vars in 1361 bytes} [Tue Jun 7 21:47:10 2022] PUT /identity/v3/domains/default/users/6e81933b979640d390f4c808a9dcf7c6/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:47:11.383564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60162f31-4d79-4e4a-81b9-e7e6ed37ec87 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:11.383888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60162f31-4d79-4e4a-81b9-e7e6ed37ec87 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:11.384139 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60162f31-4d79-4e4a-81b9-e7e6ed37ec87 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:11.393597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 18/37] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:11.395523 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f50cc-8149-4de4-89a4-000d5a6fda12 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:11.395834 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f50cc-8149-4de4-89a4-000d5a6fda12 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:11.396081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f50cc-8149-4de4-89a4-000d5a6fda12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:11.431321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e65f50cc-8149-4de4-89a4-000d5a6fda12 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:11.432880 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e65f50cc-8149-4de4-89a4-000d5a6fda12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:11.459781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533776b-0d08-4d0c-83ce-b283222c9b7a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:11.500178 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3946f4-796b-4af5-8099-0366a559674f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:11.501012 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3946f4-796b-4af5-8099-0366a559674f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:11.501305 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3946f4-796b-4af5-8099-0366a559674f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:11.501594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3946f4-796b-4af5-8099-0366a559674f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:11.505162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:11.514964 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3946f4-796b-4af5-8099-0366a559674f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:11.516540 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3946f4-796b-4af5-8099-0366a559674f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:11.539338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-ba3946f4-796b-4af5-8099-0366a559674f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:47:11.539338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:11.539338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:11.539338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:11.539338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:11.539338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:11.539338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:11.539338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:11.539338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:11.539338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:11.539338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:11.539338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:11.539338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:47:11.539338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:47:11.539338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:47:11.540220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:47:11.540220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:11.540220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:11.540220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:11.540220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:11.540220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:11.540220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:11.540220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:11.540220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:11.540220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:11.540220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:11.540220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:11.540220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:11.540220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:11.540220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:11.540220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:11.540220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:11.541034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:47:11.541034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:47:11.541034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:47:11.541034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:11.541034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:11.547172 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3946f4-796b-4af5-8099-0366a559674f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:11.653588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 19/39] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:47:11.662099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3946f4-796b-4af5-8099-0366a559674f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:11.681217 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f50cc-8149-4de4-89a4-000d5a6fda12 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:11.698325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac87b5-bddf-4819-8393-047a89028609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:11.698953 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac87b5-bddf-4819-8393-047a89028609 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:11.699241 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac87b5-bddf-4819-8393-047a89028609 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:11.699513 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac87b5-bddf-4819-8393-047a89028609 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:11.700247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac87b5-bddf-4819-8393-047a89028609 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:11.700557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac87b5-bddf-4819-8393-047a89028609 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:11.702732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac87b5-bddf-4819-8393-047a89028609 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:11.721422 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 21/40] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:11.722768 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:11.731579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac87b5-bddf-4819-8393-047a89028609 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:11.763693 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:11.805920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f50cc-8149-4de4-89a4-000d5a6fda12 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:11.841957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a1909-6cbb-4c65-9399-50de00a619a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:11.842770 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a1909-6cbb-4c65-9399-50de00a619a8 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:11.843051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a1909-6cbb-4c65-9399-50de00a619a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:11.843325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a1909-6cbb-4c65-9399-50de00a619a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:11.844702 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a1909-6cbb-4c65-9399-50de00a619a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:11.846326 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a1909-6cbb-4c65-9399-50de00a619a8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:11.846947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac87b5-bddf-4819-8393-047a89028609 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:11.847968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 20/41] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:47:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:11.849410 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725632f0-eea4-4774-b0b6-4a75f316d251 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:11.849693 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725632f0-eea4-4774-b0b6-4a75f316d251 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:11.849987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725632f0-eea4-4774-b0b6-4a75f316d251 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:11.851378 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 21/42] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:11.857405 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a040298-f832-4498-874b-41d7b52fc657 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:11.857699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a040298-f832-4498-874b-41d7b52fc657 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:11.858002 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a040298-f832-4498-874b-41d7b52fc657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:11.875347 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-7a040298-f832-4498-874b-41d7b52fc657 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:11.876543 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7a040298-f832-4498-874b-41d7b52fc657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:11.891366 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f313c-8b86-47c9-b324-0656eae34909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:11.892035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f313c-8b86-47c9-b324-0656eae34909 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:11.892324 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f313c-8b86-47c9-b324-0656eae34909 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:11.892600 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f313c-8b86-47c9-b324-0656eae34909 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:11.893321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f313c-8b86-47c9-b324-0656eae34909 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:11.894819 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f313c-8b86-47c9-b324-0656eae34909 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:11.929961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 22/43] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 7 21:47:11 2022] POST /identity/v3/projects => generated 301 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:47:11.929961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f313c-8b86-47c9-b324-0656eae34909 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:11.958004 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 22/44] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:11.976783 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a040298-f832-4498-874b-41d7b52fc657 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:12.013833 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:12.044684 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:12.086987 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f313c-8b86-47c9-b324-0656eae34909 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:12.110332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a040298-f832-4498-874b-41d7b52fc657 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:12.128707 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3fda2-ffcd-435b-8b48-7b1fea7cc354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:12.129511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3fda2-ffcd-435b-8b48-7b1fea7cc354 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:12.129884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3fda2-ffcd-435b-8b48-7b1fea7cc354 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:12.130325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3fda2-ffcd-435b-8b48-7b1fea7cc354 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:12.131130 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3fda2-ffcd-435b-8b48-7b1fea7cc354 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:12.133044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3fda2-ffcd-435b-8b48-7b1fea7cc354 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:12.164872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 7 21:47:11 2022] POST /identity/v3/projects => generated 312 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:47:12.166324 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b91ea2-3774-4db9-8863-bc962cacaa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:12.167289 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b91ea2-3774-4db9-8863-bc962cacaa9b None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:12.167780 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b91ea2-3774-4db9-8863-bc962cacaa9b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:12.168305 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b91ea2-3774-4db9-8863-bc962cacaa9b None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:12.169464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b91ea2-3774-4db9-8863-bc962cacaa9b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:12.171260 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b91ea2-3774-4db9-8863-bc962cacaa9b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:12.191066 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jun 7 21:47:11 2022] POST /identity/v3/roles => generated 223 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 21:47:13.744260 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc47ae-e5ad-46f6-b161-b57111c96bff None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:13.744744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc47ae-e5ad-46f6-b161-b57111c96bff None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:13.744744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc47ae-e5ad-46f6-b161-b57111c96bff None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:13.746661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 24/47] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:13.751920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b04b20-44d6-4f10-b4e4-0c27cdad2f73 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:13.752302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b04b20-44d6-4f10-b4e4-0c27cdad2f73 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:13.752610 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b04b20-44d6-4f10-b4e4-0c27cdad2f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:13.769128 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-58b04b20-44d6-4f10-b4e4-0c27cdad2f73 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:13.770353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-58b04b20-44d6-4f10-b4e4-0c27cdad2f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:13.835078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 24/48] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:13.858732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc47ae-e5ad-46f6-b161-b57111c96bff None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:13.958444 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc47ae-e5ad-46f6-b161-b57111c96bff None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:13.987365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:13.993982 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fea23-538b-40c0-a5a5-1cd3f8d49234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:13.995000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fea23-538b-40c0-a5a5-1cd3f8d49234 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:13.995451 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fea23-538b-40c0-a5a5-1cd3f8d49234 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:13.995877 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fea23-538b-40c0-a5a5-1cd3f8d49234 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:14.005785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fea23-538b-40c0-a5a5-1cd3f8d49234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:14.013816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-ec7fea23-538b-40c0-a5a5-1cd3f8d49234 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:14.013816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:14.013816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:14.013816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:14.013816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:14.013816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:14.013816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:14.013816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:14.013816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:14.013816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:14.013816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:14.013816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:14.013816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:14.013816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:14.013816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:14.013816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:14.014660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:14.014660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:14.014660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:14.014660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:14.014660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:14.014660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:14.014660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:14.014660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:14.014660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:14.014660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:14.014660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:14.014660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:14.014660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:14.014660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:14.014660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:14.014660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:14.015428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:14.015428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:14.015428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:14.015428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:14.015428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:14.015428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:14.015428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:14.015428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:14.015428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:14.015428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:14.015428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:14.015428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:14.015428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 25/49] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:47:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:14.020670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b04b20-44d6-4f10-b4e4-0c27cdad2f73 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:14.043958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:14.121519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b04b20-44d6-4f10-b4e4-0c27cdad2f73 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:14.154922 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e4e55-8027-4cb2-b389-4f5dbab8b10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:14.155581 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e4e55-8027-4cb2-b389-4f5dbab8b10c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:14.155863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e4e55-8027-4cb2-b389-4f5dbab8b10c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:14.156135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e4e55-8027-4cb2-b389-4f5dbab8b10c None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:14.156885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e4e55-8027-4cb2-b389-4f5dbab8b10c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:14.157191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e4e55-8027-4cb2-b389-4f5dbab8b10c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:14.158604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e4e55-8027-4cb2-b389-4f5dbab8b10c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:14.166472 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 25/50] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:14.172500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fea23-538b-40c0-a5a5-1cd3f8d49234 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:14.269437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fea23-538b-40c0-a5a5-1cd3f8d49234 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:14.301175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788ab1e-bfb7-43d5-9833-cef920d0dfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:14.302071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788ab1e-bfb7-43d5-9833-cef920d0dfa8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:14.302358 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788ab1e-bfb7-43d5-9833-cef920d0dfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:14.302630 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788ab1e-bfb7-43d5-9833-cef920d0dfa8 None admin] PATH_INFO: `/v3/users/6e81933b979640d390f4c808a9dcf7c6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:14.303808 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788ab1e-bfb7-43d5-9833-cef920d0dfa8 None admin] RBAC: Authorizing `identity:get_user(user_id=6e81933b979640d390f4c808a9dcf7c6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:14.305259 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788ab1e-bfb7-43d5-9833-cef920d0dfa8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:14.306928 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 26/51] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:14 2022] GET /identity/v3/users/6e81933b979640d390f4c808a9dcf7c6 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:14.312335 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e4e55-8027-4cb2-b389-4f5dbab8b10c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:14.396473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:14.412567 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e4e55-8027-4cb2-b389-4f5dbab8b10c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:14.433773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd30a-aa1e-4d63-8cf9-9dc02994069c None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:14.434117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd30a-aa1e-4d63-8cf9-9dc02994069c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:14.434406 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd30a-aa1e-4d63-8cf9-9dc02994069c None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:14.435778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 27/52] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:47:14.440653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedf7af-1d9d-4c42-8b31-9e03b38caac9 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:14.440948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedf7af-1d9d-4c42-8b31-9e03b38caac9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:14.441231 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedf7af-1d9d-4c42-8b31-9e03b38caac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:14.445999 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a61a0e-c470-442f-8155-5df5769fb43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:14.446800 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a61a0e-c470-442f-8155-5df5769fb43b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:14.447087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a61a0e-c470-442f-8155-5df5769fb43b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:14.447365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a61a0e-c470-442f-8155-5df5769fb43b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:14.448543 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a61a0e-c470-442f-8155-5df5769fb43b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:14.450604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a61a0e-c470-442f-8155-5df5769fb43b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:14.452233 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:47:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:14.457574 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a61a0e-c470-442f-8155-5df5769fb43b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:14.458551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-9bedf7af-1d9d-4c42-8b31-9e03b38caac9 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:14.459749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9bedf7af-1d9d-4c42-8b31-9e03b38caac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:14.512225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:14.526133 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 28/54] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:47:14.550179 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedf7af-1d9d-4c42-8b31-9e03b38caac9 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:14.555104 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a61a0e-c470-442f-8155-5df5769fb43b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:14.586735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd28a7-ff11-4422-b3fa-89eebee0b723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:14.587381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd28a7-ff11-4422-b3fa-89eebee0b723 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:14.587660 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd28a7-ff11-4422-b3fa-89eebee0b723 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:14.587934 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd28a7-ff11-4422-b3fa-89eebee0b723 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:14.588760 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd28a7-ff11-4422-b3fa-89eebee0b723 None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.domain.id=default, user.id=6e81933b979640d390f4c808a9dcf7c6) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:14.589073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd28a7-ff11-4422-b3fa-89eebee0b723 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:14.591084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd28a7-ff11-4422-b3fa-89eebee0b723 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:14.598899 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Jun 7 21:47:14 2022] GET /identity/v3/role_assignments?user.id=6e81933b979640d390f4c808a9dcf7c6&scope.domain.id=default&role.id=8f58ef9d28494d97a68de20b84355450 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:14.649173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedf7af-1d9d-4c42-8b31-9e03b38caac9 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:14.685683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ea3d2-02ba-4211-a2f8-8bb1ba9989be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:14.686534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ea3d2-02ba-4211-a2f8-8bb1ba9989be None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:14.686819 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ea3d2-02ba-4211-a2f8-8bb1ba9989be None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:14.687096 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ea3d2-02ba-4211-a2f8-8bb1ba9989be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:14.688362 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ea3d2-02ba-4211-a2f8-8bb1ba9989be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:14.689861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ea3d2-02ba-4211-a2f8-8bb1ba9989be None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:14.691575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 29/56] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:47:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:14.697264 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd28a7-ff11-4422-b3fa-89eebee0b723 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:14.717160 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:14.803125 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd28a7-ff11-4422-b3fa-89eebee0b723 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:14.840553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea185562-bfac-4b0e-9f3c-183214897bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:14.841725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea185562-bfac-4b0e-9f3c-183214897bd9 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:14.842160 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea185562-bfac-4b0e-9f3c-183214897bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:14.842446 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea185562-bfac-4b0e-9f3c-183214897bd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:14.843500 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea185562-bfac-4b0e-9f3c-183214897bd9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:14.845309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea185562-bfac-4b0e-9f3c-183214897bd9 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:14.871732 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 28/57] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Jun 7 21:47:14 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:47:17.084571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefd28f-2ad5-44dc-8232-e5fc9a75abfb None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:17.085239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefd28f-2ad5-44dc-8232-e5fc9a75abfb None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:17.085239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefd28f-2ad5-44dc-8232-e5fc9a75abfb None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:17.086823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 30/58] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:17.093417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7119518-8925-47b2-8e21-1167caeeafa4 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:17.093874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7119518-8925-47b2-8e21-1167caeeafa4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:17.094187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7119518-8925-47b2-8e21-1167caeeafa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:17.113252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a7119518-8925-47b2-8e21-1167caeeafa4 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:17.114454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a7119518-8925-47b2-8e21-1167caeeafa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:17.173232 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:17.179402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 29/59] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:17.203898 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefd28f-2ad5-44dc-8232-e5fc9a75abfb None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:17.259502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:17.303330 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefd28f-2ad5-44dc-8232-e5fc9a75abfb None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:17.335784 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189e0dd-ace3-45b2-83da-fdf1df46d50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:17.336497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189e0dd-ace3-45b2-83da-fdf1df46d50a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:17.336783 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189e0dd-ace3-45b2-83da-fdf1df46d50a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:17.337061 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189e0dd-ace3-45b2-83da-fdf1df46d50a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:17.338253 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189e0dd-ace3-45b2-83da-fdf1df46d50a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:17.340368 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189e0dd-ace3-45b2-83da-fdf1df46d50a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:17.341978 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 31/60] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:47:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:17.347274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7119518-8925-47b2-8e21-1167caeeafa4 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:17.441465 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7119518-8925-47b2-8e21-1167caeeafa4 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:17.473772 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf5efd-ecea-45a7-9cc1-5cb830f556c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:17.474727 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf5efd-ecea-45a7-9cc1-5cb830f556c8 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:17.475013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf5efd-ecea-45a7-9cc1-5cb830f556c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:17.475292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf5efd-ecea-45a7-9cc1-5cb830f556c8 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:17.476018 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf5efd-ecea-45a7-9cc1-5cb830f556c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:17.477471 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf5efd-ecea-45a7-9cc1-5cb830f556c8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:17.502755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 30/61] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:47:17 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 21:47:20.887025 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5db6b-2526-4247-897c-44bf39f5835f None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:20.887529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5db6b-2526-4247-897c-44bf39f5835f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:20.887633 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5db6b-2526-4247-897c-44bf39f5835f None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:20.889127 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 32/62] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:20.899396 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958e27f-f2db-4ae1-ac0c-5af7ff511e04 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:20.899847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958e27f-f2db-4ae1-ac0c-5af7ff511e04 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:20.900023 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958e27f-f2db-4ae1-ac0c-5af7ff511e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:20.926492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3958e27f-f2db-4ae1-ac0c-5af7ff511e04 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:20.927697 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3958e27f-f2db-4ae1-ac0c-5af7ff511e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:20.952492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d9f4a-b1b9-4620-9dad-c8b519c91dd9 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:20.952832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d9f4a-b1b9-4620-9dad-c8b519c91dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:20.953056 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d9f4a-b1b9-4620-9dad-c8b519c91dd9 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:20.954673 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 33/63] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:47:20.960461 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e5cc4-8dd9-4050-ad78-541f9e97080f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:20.961170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e5cc4-8dd9-4050-ad78-541f9e97080f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:20.961671 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e5cc4-8dd9-4050-ad78-541f9e97080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:20.992389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-317e5cc4-8dd9-4050-ad78-541f9e97080f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:20.994926 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-317e5cc4-8dd9-4050-ad78-541f9e97080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:21.027840 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:21.067318 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 31/64] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:21.098282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 34/65] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:47:21.106871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958e27f-f2db-4ae1-ac0c-5af7ff511e04 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:21.119604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e5cc4-8dd9-4050-ad78-541f9e97080f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:21.176790 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:21.232579 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958e27f-f2db-4ae1-ac0c-5af7ff511e04 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:21.240837 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e5cc4-8dd9-4050-ad78-541f9e97080f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:21.268510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c576f-2b22-4609-806c-cf46d3b3fb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:21.269590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c576f-2b22-4609-806c-cf46d3b3fb0b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:21.270160 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c576f-2b22-4609-806c-cf46d3b3fb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:21.270613 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c576f-2b22-4609-806c-cf46d3b3fb0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:21.282897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c576f-2b22-4609-806c-cf46d3b3fb0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:21.283928 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55f1e4-8762-44c6-bd48-11e3db556b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:21.284796 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55f1e4-8762-44c6-bd48-11e3db556b8c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:21.285154 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55f1e4-8762-44c6-bd48-11e3db556b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:21.285505 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55f1e4-8762-44c6-bd48-11e3db556b8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:21.296901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-5f6c576f-2b22-4609-806c-cf46d3b3fb0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:21.296901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:21.296901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:21.296901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:21.296901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:21.296901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:21.296901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:21.296901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:21.296901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:21.296901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:21.296901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:21.296901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:21.296901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:21.296901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:21.296901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:21.296901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:21.297742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:21.297742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:21.297742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:21.297742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:21.297742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:21.297742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:21.297742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:21.297742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:21.297742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:21.297742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:21.297742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:21.297742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:21.297742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:21.297742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:21.297742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:21.297742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:21.298540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:21.298540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:21.298540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:21.298540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:21.298540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:21.298540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:21.298540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:21.298540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:21.298540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:21.298540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:21.298540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:21.298540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:21.299125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55f1e4-8762-44c6-bd48-11e3db556b8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:21.301369 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 32/66] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:21.302896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2e520-f1c2-41e0-8fec-8fee321433ab None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:21.303350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2e520-f1c2-41e0-8fec-8fee321433ab None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:21.303801 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2e520-f1c2-41e0-8fec-8fee321433ab None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:21.305263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 33/67] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:21.308944 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2e520-f1c2-41e0-8fec-8fee321433ab None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:21.312810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-ac55f1e4-8762-44c6-bd48-11e3db556b8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:21.312810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:21.312810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:21.312810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:21.312810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:21.312810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:21.312810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:21.312810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:21.312810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:21.312810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:21.312810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:21.312810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:21.312810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:21.312810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:21.312810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:21.312810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:21.313667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:21.313667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:21.313667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:21.313667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:21.313667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:21.313667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:21.313667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:21.313667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:21.313667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:21.313667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:21.313667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:21.313667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:21.313667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:21.313667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:21.313667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:21.313667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:21.314464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:21.314464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:21.314464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:21.314464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:21.314464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:21.314464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:21.314464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:21.314464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:21.314464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:21.314464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:21.314464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:21.314464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:21.314464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 35/68] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:47:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:21.315778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090dea7-ebca-4564-8978-e9eb2e10bb8c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:21.315778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090dea7-ebca-4564-8978-e9eb2e10bb8c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:21.318051 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090dea7-ebca-4564-8978-e9eb2e10bb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:21.336838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0090dea7-ebca-4564-8978-e9eb2e10bb8c None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:21.338044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0090dea7-ebca-4564-8978-e9eb2e10bb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:21.370126 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:21.409486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 36/69] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:21.411260 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd7380-0de6-4abd-a7eb-8a9b4298249f None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:21.411551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd7380-0de6-4abd-a7eb-8a9b4298249f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:21.411830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd7380-0de6-4abd-a7eb-8a9b4298249f None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:21.413097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 37/70] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:21.418014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd7380-0de6-4abd-a7eb-8a9b4298249f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:21.440548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2e520-f1c2-41e0-8fec-8fee321433ab None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:21.471793 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:21.481311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a42b8-2d0a-4ebd-a59a-89ee14108b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:21.482102 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a42b8-2d0a-4ebd-a59a-89ee14108b7a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:21.482324 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a42b8-2d0a-4ebd-a59a-89ee14108b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:21.482602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a42b8-2d0a-4ebd-a59a-89ee14108b7a None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:21.483530 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a42b8-2d0a-4ebd-a59a-89ee14108b7a None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:21.483847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a42b8-2d0a-4ebd-a59a-89ee14108b7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:21.485259 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a42b8-2d0a-4ebd-a59a-89ee14108b7a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:21.494347 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 34/71] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:21.496365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9b3df-f346-4416-bc65-c9b77e00ba27 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:21.496656 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9b3df-f346-4416-bc65-c9b77e00ba27 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:21.496934 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9b3df-f346-4416-bc65-c9b77e00ba27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:21.514328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c4c9b3df-f346-4416-bc65-c9b77e00ba27 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:21.515523 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c4c9b3df-f346-4416-bc65-c9b77e00ba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:21.537291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd7380-0de6-4abd-a7eb-8a9b4298249f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:21.571948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e32c5-8497-46a4-9e99-f4c8015dc1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:21.572615 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e32c5-8497-46a4-9e99-f4c8015dc1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:21.572903 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e32c5-8497-46a4-9e99-f4c8015dc1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:21.573186 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e32c5-8497-46a4-9e99-f4c8015dc1e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:21.573997 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e32c5-8497-46a4-9e99-f4c8015dc1e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:21.574311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e32c5-8497-46a4-9e99-f4c8015dc1e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:21.575720 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e32c5-8497-46a4-9e99-f4c8015dc1e8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:21.581429 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 35/72] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:21.582300 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9b3df-f346-4416-bc65-c9b77e00ba27 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:21.583761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 38/73] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:21.584548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e32c5-8497-46a4-9e99-f4c8015dc1e8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:21.629180 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:21.683925 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e32c5-8497-46a4-9e99-f4c8015dc1e8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:21.690836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:21.692057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9b3df-f346-4416-bc65-c9b77e00ba27 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:21.718365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee4aa8-93be-4bcc-a879-429972469643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:21.719239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4aa8-93be-4bcc-a879-429972469643 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:21.719526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4aa8-93be-4bcc-a879-429972469643 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:21.719808 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4aa8-93be-4bcc-a879-429972469643 None admin] PATH_INFO: `/v3/users/9bcbcac888534699a368bba89ae10030` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:21.726302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca84ea7-083d-434f-b8d1-e28bf0273be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:21.727112 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca84ea7-083d-434f-b8d1-e28bf0273be2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:21.727400 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca84ea7-083d-434f-b8d1-e28bf0273be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:21.727683 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca84ea7-083d-434f-b8d1-e28bf0273be2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:21.733391 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee4aa8-93be-4bcc-a879-429972469643 None admin] RBAC: Authorizing `identity:get_user(user_id=9bcbcac888534699a368bba89ae10030)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:21.734887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee4aa8-93be-4bcc-a879-429972469643 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:21.736540 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 39/74] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:21 2022] GET /identity/v3/users/9bcbcac888534699a368bba89ae10030 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:21.737705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca84ea7-083d-434f-b8d1-e28bf0273be2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:21.737803 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b9e5e-4ae1-41a8-b0ca-e1aa18d29b32 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:21.738016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b9e5e-4ae1-41a8-b0ca-e1aa18d29b32 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:21.738297 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b9e5e-4ae1-41a8-b0ca-e1aa18d29b32 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:21.739702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 40/75] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:21.740212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b9e5e-4ae1-41a8-b0ca-e1aa18d29b32 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:21.749857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-fca84ea7-083d-434f-b8d1-e28bf0273be2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:47:21.749857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:21.749857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:21.749857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:21.749857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:21.749857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:21.749857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:21.749857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:21.749857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:21.749857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:21.749857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:21.749857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:21.749857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:21.749857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:21.749857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:21.749857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:21.750871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:21.750871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:21.750871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:21.750871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:21.750871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:21.750871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:21.750871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:21.750871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:21.750871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:21.750871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:21.750871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:21.750871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:21.750871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:21.750871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:21.750871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:21.750871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:21.751655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:21.751655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:21.751655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:21.751655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:21.751655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:21.751655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:21.751655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:21.751655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:21.751655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:21.751655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:21.751655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:47:21.751655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:21.751655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 36/76] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:47:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:21.752405 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca84ea7-083d-434f-b8d1-e28bf0273be2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:21.842292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b9e5e-4ae1-41a8-b0ca-e1aa18d29b32 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:21.844775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:21.851017 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca84ea7-083d-434f-b8d1-e28bf0273be2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:21.876118 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9786f-a12c-4bf5-93da-d1b6cf5006e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:21.876984 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9786f-a12c-4bf5-93da-d1b6cf5006e8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:21.877270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9786f-a12c-4bf5-93da-d1b6cf5006e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:21.877546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9786f-a12c-4bf5-93da-d1b6cf5006e8 None admin] PATH_INFO: `/v3/users/6e81933b979640d390f4c808a9dcf7c6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:21.878773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9786f-a12c-4bf5-93da-d1b6cf5006e8 None admin] RBAC: Authorizing `identity:get_user(user_id=6e81933b979640d390f4c808a9dcf7c6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:21.880221 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9786f-a12c-4bf5-93da-d1b6cf5006e8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:21.881847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 41/77] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:21 2022] GET /identity/v3/users/6e81933b979640d390f4c808a9dcf7c6 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:21.884134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244800f-3786-4610-a70b-9dfda14e52f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:21.884924 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244800f-3786-4610-a70b-9dfda14e52f5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:21.885212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244800f-3786-4610-a70b-9dfda14e52f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:21.885490 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244800f-3786-4610-a70b-9dfda14e52f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:21.887711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9786f-a12c-4bf5-93da-d1b6cf5006e8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:21.896770 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244800f-3786-4610-a70b-9dfda14e52f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:21.905078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-c244800f-3786-4610-a70b-9dfda14e52f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:21.905078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:21.905078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:21.905078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:21.905078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:21.905078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:21.905078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:21.905078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:21.905078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:21.905078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:21.905078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:21.905078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:21.905078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:21.905078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:21.905078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:21.905078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:21.906403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:21.906403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:21.906403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:21.906403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:21.906403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:21.906403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:21.906403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:21.906403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:21.906403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:21.906403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:21.906403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:21.906403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:21.906403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:21.906403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:21.906403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:21.906403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:21.907154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:21.907154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:21.907154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:21.907154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:21.907154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:21.907154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:21.907154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:21.907154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:21.907154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:21.907154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:21.907154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:21.907154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:21.907154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 37/78] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:21.907765 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf46e9-48cf-4a0a-a574-da14cd431e8b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:21.907765 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf46e9-48cf-4a0a-a574-da14cd431e8b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:21.908180 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf46e9-48cf-4a0a-a574-da14cd431e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:21.920456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:21.924143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-efaf46e9-48cf-4a0a-a574-da14cd431e8b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:21.925332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-efaf46e9-48cf-4a0a-a574-da14cd431e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:21.988316 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9786f-a12c-4bf5-93da-d1b6cf5006e8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:21.991354 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 38/79] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:21.992173 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf46e9-48cf-4a0a-a574-da14cd431e8b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:22.022159 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fe0ea-b78c-4d5b-9fab-3a72b3d5c7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:22.022813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fe0ea-b78c-4d5b-9fab-3a72b3d5c7ce None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:22.023096 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fe0ea-b78c-4d5b-9fab-3a72b3d5c7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:22.023374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fe0ea-b78c-4d5b-9fab-3a72b3d5c7ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:22.073222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:22.088046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf46e9-48cf-4a0a-a574-da14cd431e8b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:22.090667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fe0ea-b78c-4d5b-9fab-3a72b3d5c7ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:22.092153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fe0ea-b78c-4d5b-9fab-3a72b3d5c7ce None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:22.121802 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca3364-dec8-4607-aa7e-a58f8e5bb9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:22.122490 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca3364-dec8-4607-aa7e-a58f8e5bb9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:22.122777 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca3364-dec8-4607-aa7e-a58f8e5bb9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:22.123054 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca3364-dec8-4607-aa7e-a58f8e5bb9a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:22.123170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:22.123806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca3364-dec8-4607-aa7e-a58f8e5bb9a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:22.124131 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca3364-dec8-4607-aa7e-a58f8e5bb9a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:22.125574 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca3364-dec8-4607-aa7e-a58f8e5bb9a0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:22.133962 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 39/80] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:47:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:22.134658 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca3364-dec8-4607-aa7e-a58f8e5bb9a0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:22.194379 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 42/81] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:47:22.195198 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fe0ea-b78c-4d5b-9fab-3a72b3d5c7ce None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:22.234017 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca3364-dec8-4607-aa7e-a58f8e5bb9a0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:22.267355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aebca8-b861-4376-b89c-e65a8e5fa9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:22.267939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aebca8-b861-4376-b89c-e65a8e5fa9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:22.268225 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aebca8-b861-4376-b89c-e65a8e5fa9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:22.268506 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aebca8-b861-4376-b89c-e65a8e5fa9c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:22.285517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:22.290070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fe0ea-b78c-4d5b-9fab-3a72b3d5c7ce None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:22.319105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:22.324978 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec884881-f56d-4334-b725-394a2a33742d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:22.325637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec884881-f56d-4334-b725-394a2a33742d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:22.325946 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec884881-f56d-4334-b725-394a2a33742d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:22.326238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec884881-f56d-4334-b725-394a2a33742d None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:22.326986 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec884881-f56d-4334-b725-394a2a33742d None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:22.327297 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec884881-f56d-4334-b725-394a2a33742d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:22.328707 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec884881-f56d-4334-b725-394a2a33742d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:22.335406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aebca8-b861-4376-b89c-e65a8e5fa9c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:22.336781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 43/82] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:22.336886 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aebca8-b861-4376-b89c-e65a8e5fa9c4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:22.337561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec884881-f56d-4334-b725-394a2a33742d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:22.438636 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec884881-f56d-4334-b725-394a2a33742d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:22.439236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 40/83] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:47:22.440088 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aebca8-b861-4376-b89c-e65a8e5fa9c4 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:22.473156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd071a-c620-498a-9931-e20e5c508e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:22.473984 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd071a-c620-498a-9931-e20e5c508e85 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:22.474531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd071a-c620-498a-9931-e20e5c508e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:22.474814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd071a-c620-498a-9931-e20e5c508e85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:22.475992 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd071a-c620-498a-9931-e20e5c508e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:22.477445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd071a-c620-498a-9931-e20e5c508e85 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:22.479110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 44/84] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:47:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:22.480355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd071a-c620-498a-9931-e20e5c508e85 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:22.489072 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:22.538947 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aebca8-b861-4376-b89c-e65a8e5fa9c4 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:22.539177 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:22.571501 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648c4aa-23a8-42f3-b06e-4ca3eb6b0c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:22.572377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648c4aa-23a8-42f3-b06e-4ca3eb6b0c0d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:22.572668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648c4aa-23a8-42f3-b06e-4ca3eb6b0c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:22.572937 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648c4aa-23a8-42f3-b06e-4ca3eb6b0c0d None admin] PATH_INFO: `/v3/users/9bcbcac888534699a368bba89ae10030` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:22.574651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648c4aa-23a8-42f3-b06e-4ca3eb6b0c0d None admin] RBAC: Authorizing `identity:get_user(user_id=9bcbcac888534699a368bba89ae10030)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:22.576100 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648c4aa-23a8-42f3-b06e-4ca3eb6b0c0d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:22.577741 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 41/85] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:22 2022] GET /identity/v3/users/9bcbcac888534699a368bba89ae10030 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:22.578218 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd071a-c620-498a-9931-e20e5c508e85 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:22.578539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648c4aa-23a8-42f3-b06e-4ca3eb6b0c0d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:22.614238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae0f82-c2ef-4339-901f-5759420d4020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:22.615098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae0f82-c2ef-4339-901f-5759420d4020 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:22.615384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae0f82-c2ef-4339-901f-5759420d4020 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:22.615664 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae0f82-c2ef-4339-901f-5759420d4020 None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:22.616837 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae0f82-c2ef-4339-901f-5759420d4020 None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:22.618309 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae0f82-c2ef-4339-901f-5759420d4020 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:22.620003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 45/86] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:22 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:22.620798 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae0f82-c2ef-4339-901f-5759420d4020 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:22.676917 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648c4aa-23a8-42f3-b06e-4ca3eb6b0c0d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:22.693435 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:22.711957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f28980-9c81-4115-a435-14bc05cb3316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:22.712822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f28980-9c81-4115-a435-14bc05cb3316 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:22.713117 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f28980-9c81-4115-a435-14bc05cb3316 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:22.713393 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f28980-9c81-4115-a435-14bc05cb3316 None admin] PATH_INFO: `/v3/users/9bcbcac888534699a368bba89ae10030` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:22.714629 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f28980-9c81-4115-a435-14bc05cb3316 None admin] RBAC: Authorizing `identity:get_user(user_id=9bcbcac888534699a368bba89ae10030)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:22.716126 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f28980-9c81-4115-a435-14bc05cb3316 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:22.717691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 42/87] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:22 2022] GET /identity/v3/users/9bcbcac888534699a368bba89ae10030 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:22.717866 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae0f82-c2ef-4339-901f-5759420d4020 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:22.718465 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f28980-9c81-4115-a435-14bc05cb3316 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:22.746205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:22.752424 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e16772-135d-4282-9988-24f2a7bfb5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:22.753283 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e16772-135d-4282-9988-24f2a7bfb5eb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:22.753570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e16772-135d-4282-9988-24f2a7bfb5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:22.753850 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e16772-135d-4282-9988-24f2a7bfb5eb None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:22.755066 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e16772-135d-4282-9988-24f2a7bfb5eb None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:22.756551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e16772-135d-4282-9988-24f2a7bfb5eb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:22.758288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 46/88] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:22 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:22.759055 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e16772-135d-4282-9988-24f2a7bfb5eb None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:22.821991 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f28980-9c81-4115-a435-14bc05cb3316 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:22.855772 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc824567-996b-4085-ab0f-db42512c65cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:22.856420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc824567-996b-4085-ab0f-db42512c65cb None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:22.856705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc824567-996b-4085-ab0f-db42512c65cb None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:22.856984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc824567-996b-4085-ab0f-db42512c65cb None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:22.857690 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc824567-996b-4085-ab0f-db42512c65cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:22.857944 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e16772-135d-4282-9988-24f2a7bfb5eb None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:22.859177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc824567-996b-4085-ab0f-db42512c65cb None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:22.878814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 43/89] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:47:22 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:47:22.879848 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc824567-996b-4085-ab0f-db42512c65cb None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:22.891541 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03339c-03f6-4e94-8beb-7a8dde90e395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:22.892249 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03339c-03f6-4e94-8beb-7a8dde90e395 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:22.892494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03339c-03f6-4e94-8beb-7a8dde90e395 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:22.892773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03339c-03f6-4e94-8beb-7a8dde90e395 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:22.958308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:22.966014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:22.969821 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03339c-03f6-4e94-8beb-7a8dde90e395 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:22.972056 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03339c-03f6-4e94-8beb-7a8dde90e395 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:23.004031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc824567-996b-4085-ab0f-db42512c65cb None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:23.041164 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ae61b-1e2c-4f30-97bc-e476b04a0530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:23.041866 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ae61b-1e2c-4f30-97bc-e476b04a0530 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:23.042162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ae61b-1e2c-4f30-97bc-e476b04a0530 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:23.042479 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ae61b-1e2c-4f30-97bc-e476b04a0530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:23.043369 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ae61b-1e2c-4f30-97bc-e476b04a0530 None admin] RBAC: Adding query filter params (role.id=01ccb434cf384bc79bf82f49b697f1ce, scope.project.id=eb30985c7f9f457095a0e5e03ed6954c, user.id=9bcbcac888534699a368bba89ae10030) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:23.043685 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ae61b-1e2c-4f30-97bc-e476b04a0530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:23.045176 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ae61b-1e2c-4f30-97bc-e476b04a0530 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:23.051271 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 44/90] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:22 2022] GET /identity/v3/role_assignments?user.id=9bcbcac888534699a368bba89ae10030&scope.project.id=eb30985c7f9f457095a0e5e03ed6954c&role.id=01ccb434cf384bc79bf82f49b697f1ce => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:23.055125 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ae61b-1e2c-4f30-97bc-e476b04a0530 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:23.088768 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 47/91] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:47:23.089647 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03339c-03f6-4e94-8beb-7a8dde90e395 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:23.195421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ae61b-1e2c-4f30-97bc-e476b04a0530 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:23.199054 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:23.235405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:23.240691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03339c-03f6-4e94-8beb-7a8dde90e395 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:23.241643 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed1673-5965-4a62-8fac-49262f97d1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:23.242580 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed1673-5965-4a62-8fac-49262f97d1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:23.243087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed1673-5965-4a62-8fac-49262f97d1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:23.243553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed1673-5965-4a62-8fac-49262f97d1a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:23.286362 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff829b-cac4-4599-8254-336362cbdea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:23.287036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff829b-cac4-4599-8254-336362cbdea2 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:23.287326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff829b-cac4-4599-8254-336362cbdea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:23.287612 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff829b-cac4-4599-8254-336362cbdea2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:23.288448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff829b-cac4-4599-8254-336362cbdea2 None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=eb30985c7f9f457095a0e5e03ed6954c, user.id=6e81933b979640d390f4c808a9dcf7c6) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:23.288763 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff829b-cac4-4599-8254-336362cbdea2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:23.290663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff829b-cac4-4599-8254-336362cbdea2 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:23.300539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 48/92] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:23 2022] GET /identity/v3/role_assignments?user.id=6e81933b979640d390f4c808a9dcf7c6&scope.project.id=eb30985c7f9f457095a0e5e03ed6954c&role.id=8f58ef9d28494d97a68de20b84355450 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:23.301648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff829b-cac4-4599-8254-336362cbdea2 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:23.371961 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed1673-5965-4a62-8fac-49262f97d1a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:23.373466 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed1673-5965-4a62-8fac-49262f97d1a6 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:23.500933 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff829b-cac4-4599-8254-336362cbdea2 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:23.546195 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6a90c-b213-4c35-ac50-aa7a8fc80fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:23.547436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6a90c-b213-4c35-ac50-aa7a8fc80fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:23.548491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6a90c-b213-4c35-ac50-aa7a8fc80fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:23.548976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6a90c-b213-4c35-ac50-aa7a8fc80fc7 None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:23.550990 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6a90c-b213-4c35-ac50-aa7a8fc80fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:23.552822 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6a90c-b213-4c35-ac50-aa7a8fc80fc7 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:23.559489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 49/93] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:23 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:23.562438 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6a90c-b213-4c35-ac50-aa7a8fc80fc7 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:23.579291 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 45/94] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:47:23.585952 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed1673-5965-4a62-8fac-49262f97d1a6 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:23.587761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:23.610058 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:23.719389 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed1673-5965-4a62-8fac-49262f97d1a6 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:23.739731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6a90c-b213-4c35-ac50-aa7a8fc80fc7 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:23.792783 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76354c64-82ce-4ac3-97b1-721d7c7b73de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:23.793671 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76354c64-82ce-4ac3-97b1-721d7c7b73de None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:23.793965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76354c64-82ce-4ac3-97b1-721d7c7b73de None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:23.794649 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76354c64-82ce-4ac3-97b1-721d7c7b73de None admin] PATH_INFO: `/v3/projects/9fe63d8beeec45e7a7ad93fa39cc20f6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:23.798900 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76354c64-82ce-4ac3-97b1-721d7c7b73de None admin] RBAC: Authorizing `identity:get_project(project_id=9fe63d8beeec45e7a7ad93fa39cc20f6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:23.800504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76354c64-82ce-4ac3-97b1-721d7c7b73de None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:23.802727 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 46/95] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:23 2022] GET /identity/v3/projects/9fe63d8beeec45e7a7ad93fa39cc20f6 => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:23.808656 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76354c64-82ce-4ac3-97b1-721d7c7b73de None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:23.817452 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563fdd4-27b8-412d-b6fb-9e23350f948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:23.818466 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563fdd4-27b8-412d-b6fb-9e23350f948d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:23.818954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563fdd4-27b8-412d-b6fb-9e23350f948d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:23.819450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563fdd4-27b8-412d-b6fb-9e23350f948d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:23.820508 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563fdd4-27b8-412d-b6fb-9e23350f948d None admin] RBAC: Adding query filter params (role.id=73d4eafa268f4cc3aca4863c73b794ae, scope.project.id=eb30985c7f9f457095a0e5e03ed6954c, user.id=9bcbcac888534699a368bba89ae10030) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:23.821035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563fdd4-27b8-412d-b6fb-9e23350f948d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:23.822724 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563fdd4-27b8-412d-b6fb-9e23350f948d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:23.840877 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 50/96] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:23 2022] GET /identity/v3/role_assignments?user.id=9bcbcac888534699a368bba89ae10030&scope.project.id=eb30985c7f9f457095a0e5e03ed6954c&role.id=73d4eafa268f4cc3aca4863c73b794ae => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:23.931169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:23.975228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76354c64-82ce-4ac3-97b1-721d7c7b73de None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:24.028374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938e43a-254d-4ef0-8698-f45eb8721b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:24.029032 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938e43a-254d-4ef0-8698-f45eb8721b7c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:24.029313 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938e43a-254d-4ef0-8698-f45eb8721b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:24.029590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938e43a-254d-4ef0-8698-f45eb8721b7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:24.030454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938e43a-254d-4ef0-8698-f45eb8721b7c None admin] RBAC: Adding query filter params (role.id=01ccb434cf384bc79bf82f49b697f1ce, scope.project.id=9fe63d8beeec45e7a7ad93fa39cc20f6, user.id=9bcbcac888534699a368bba89ae10030) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:24.030769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938e43a-254d-4ef0-8698-f45eb8721b7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:24.032216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938e43a-254d-4ef0-8698-f45eb8721b7c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:24.043281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 47/97] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:23 2022] GET /identity/v3/role_assignments?user.id=9bcbcac888534699a368bba89ae10030&scope.project.id=9fe63d8beeec45e7a7ad93fa39cc20f6&role.id=01ccb434cf384bc79bf82f49b697f1ce => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:26.009722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83a067-b614-4216-8522-4d49821c49ac None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:26.010771 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83a067-b614-4216-8522-4d49821c49ac None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:26.011353 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83a067-b614-4216-8522-4d49821c49ac None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:26.012964 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 51/98] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:26.018479 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c40e0e-8ab3-4bab-88c2-4a7b5d045dba None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:26.019320 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c40e0e-8ab3-4bab-88c2-4a7b5d045dba None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:26.019801 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c40e0e-8ab3-4bab-88c2-4a7b5d045dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:26.043483 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-57c40e0e-8ab3-4bab-88c2-4a7b5d045dba None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:26.045029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-57c40e0e-8ab3-4bab-88c2-4a7b5d045dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:26.122468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 48/99] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:26.156902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83a067-b614-4216-8522-4d49821c49ac None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:26.271811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:26.283744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83a067-b614-4216-8522-4d49821c49ac None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:26.325902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6480dee-39db-4f5b-878d-6d6f3fa8936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:26.326725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480dee-39db-4f5b-878d-6d6f3fa8936b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:26.327007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480dee-39db-4f5b-878d-6d6f3fa8936b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:26.327284 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480dee-39db-4f5b-878d-6d6f3fa8936b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:26.347163 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6480dee-39db-4f5b-878d-6d6f3fa8936b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:26.355735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-f6480dee-39db-4f5b-878d-6d6f3fa8936b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:26.355735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:26.355735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:26.355735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:26.355735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:26.355735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:26.355735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:26.355735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:26.355735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:26.355735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:26.355735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:26.355735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:26.355735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:26.355735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:26.355735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:26.355735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:26.356652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:26.356652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:26.356652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:26.356652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:26.356652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:26.356652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:26.356652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:26.356652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:26.356652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:26.356652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:26.356652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:26.356652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:26.356652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:26.356652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:26.356652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:26.356652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:26.357814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:26.357814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:26.357814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:26.357814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:26.357814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:26.357814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:26.357814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:26.357814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:26.357814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:26.357814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:26.357814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:26.357814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:26.357814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 52/100] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:26.365347 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c40e0e-8ab3-4bab-88c2-4a7b5d045dba None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:26.382281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93028e-87c1-4d2e-9c09-fbb3e4e1a245 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:26.382565 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93028e-87c1-4d2e-9c09-fbb3e4e1a245 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:26.382849 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93028e-87c1-4d2e-9c09-fbb3e4e1a245 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:26.388507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 53/101] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:47:26.391019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902c94f-066f-402e-8153-7098fdf1151c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:26.391311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902c94f-066f-402e-8153-7098fdf1151c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:26.391589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902c94f-066f-402e-8153-7098fdf1151c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:26.426954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c902c94f-066f-402e-8153-7098fdf1151c None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:26.428719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c902c94f-066f-402e-8153-7098fdf1151c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:26.476128 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:26.532033 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c40e0e-8ab3-4bab-88c2-4a7b5d045dba None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:26.559050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 54/102] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:47:26.559050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a19ef-7126-4b7f-9794-ebf10b6be8f8 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:26.559050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a19ef-7126-4b7f-9794-ebf10b6be8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:26.559050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a19ef-7126-4b7f-9794-ebf10b6be8f8 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:26.559050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 55/103] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:26.559948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f78fb-3ad6-4be6-90c5-839b299d88bc None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:26.560231 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f78fb-3ad6-4be6-90c5-839b299d88bc None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:26.560506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f78fb-3ad6-4be6-90c5-839b299d88bc None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:26.561696 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 56/104] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:26.570676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80ac42-5ed0-48e6-8bc2-4446e27b4fca None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:26.570970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80ac42-5ed0-48e6-8bc2-4446e27b4fca None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:26.571250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80ac42-5ed0-48e6-8bc2-4446e27b4fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:26.589651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3c80ac42-5ed0-48e6-8bc2-4446e27b4fca None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:26.591029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3c80ac42-5ed0-48e6-8bc2-4446e27b4fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:26.601476 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae46972-acda-4add-a6ea-c51a1f1f5302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:26.602511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46972-acda-4add-a6ea-c51a1f1f5302 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:26.602874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46972-acda-4add-a6ea-c51a1f1f5302 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:26.603353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46972-acda-4add-a6ea-c51a1f1f5302 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:26.604298 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae46972-acda-4add-a6ea-c51a1f1f5302 None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:26.605347 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae46972-acda-4add-a6ea-c51a1f1f5302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:26.606975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae46972-acda-4add-a6ea-c51a1f1f5302 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:26.617700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 49/105] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:26.619303 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41403a12-c092-4d87-8e56-565b4456e428 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:26.619726 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41403a12-c092-4d87-8e56-565b4456e428 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:26.620107 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41403a12-c092-4d87-8e56-565b4456e428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:26.637104 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-41403a12-c092-4d87-8e56-565b4456e428 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:26.638440 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-41403a12-c092-4d87-8e56-565b4456e428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:26.665715 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 57/106] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:26.666989 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80ac42-5ed0-48e6-8bc2-4446e27b4fca None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:26.695402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:26.728957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 50/107] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:26.731814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41403a12-c092-4d87-8e56-565b4456e428 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:26.807760 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:26.815048 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80ac42-5ed0-48e6-8bc2-4446e27b4fca None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:26.853510 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ada0e-d36e-400b-9a3c-23138225b121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:26.855205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ada0e-d36e-400b-9a3c-23138225b121 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:26.855671 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ada0e-d36e-400b-9a3c-23138225b121 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:26.856153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ada0e-d36e-400b-9a3c-23138225b121 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:26.857510 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ada0e-d36e-400b-9a3c-23138225b121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:26.859296 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ada0e-d36e-400b-9a3c-23138225b121 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:26.865716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41403a12-c092-4d87-8e56-565b4456e428 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:26.866003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 58/108] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:47:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:26.867041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ada0e-d36e-400b-9a3c-23138225b121 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:26.909550 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8d2a6-6bef-469e-88e3-92000a8e6863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:26.910466 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8d2a6-6bef-469e-88e3-92000a8e6863 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:26.910750 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8d2a6-6bef-469e-88e3-92000a8e6863 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:26.911030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8d2a6-6bef-469e-88e3-92000a8e6863 None admin] PATH_INFO: `/v3/users/9bcbcac888534699a368bba89ae10030` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:26.912250 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8d2a6-6bef-469e-88e3-92000a8e6863 None admin] RBAC: Authorizing `identity:get_user(user_id=9bcbcac888534699a368bba89ae10030)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:26.914312 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8d2a6-6bef-469e-88e3-92000a8e6863 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:26.916000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 51/109] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:26 2022] GET /identity/v3/users/9bcbcac888534699a368bba89ae10030 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:26.917776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8d2a6-6bef-469e-88e3-92000a8e6863 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:26.964365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:26.993318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ada0e-d36e-400b-9a3c-23138225b121 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:27.040569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12452b-3495-410a-98b4-db6954b1ddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:27.041390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12452b-3495-410a-98b4-db6954b1ddfe None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:27.041907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12452b-3495-410a-98b4-db6954b1ddfe None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:27.042248 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12452b-3495-410a-98b4-db6954b1ddfe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:27.049217 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8d2a6-6bef-469e-88e3-92000a8e6863 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:27.056023 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12452b-3495-410a-98b4-db6954b1ddfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:27.066232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-5f12452b-3495-410a-98b4-db6954b1ddfe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:27.066232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:27.066232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:27.066232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:27.066232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:27.066232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:27.066232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:27.066232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:27.066232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:27.066232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:27.066232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:27.066232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:27.066232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:27.066232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:27.066232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:27.066232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:27.067128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:27.067128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:27.067128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:27.067128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:27.067128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:27.067128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:27.067128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:27.067128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:27.067128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:27.067128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:27.067128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:27.067128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:27.067128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:27.067128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:27.067128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:27.067128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:27.067876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:27.067876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:27.067876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:27.067876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:27.067876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:27.067876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:27.067876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:27.067876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:27.067876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:27.067876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:27.067876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:27.067876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:27.070004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 59/110] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:47:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:27.071032 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12452b-3495-410a-98b4-db6954b1ddfe None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:27.089160 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:27.102025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494856-9804-4146-b21a-4460c5432963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:27.102841 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494856-9804-4146-b21a-4460c5432963 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:27.103256 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494856-9804-4146-b21a-4460c5432963 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:27.103576 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494856-9804-4146-b21a-4460c5432963 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:27.117378 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c494856-9804-4146-b21a-4460c5432963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:27.127988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-9c494856-9804-4146-b21a-4460c5432963 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:47:27.127988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:27.127988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:27.127988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:27.127988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:27.127988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:27.127988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:27.127988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:27.127988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:27.127988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:27.127988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:27.127988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:27.127988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:27.127988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:27.127988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:27.127988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:27.128870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:27.128870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:27.128870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:27.128870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:27.128870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:27.128870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:27.128870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:27.128870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:27.128870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:27.128870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:27.128870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:27.128870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:27.128870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:27.128870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:27.128870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:27.128870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:27.130275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:27.130275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:27.130275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:27.130275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:27.130275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:27.130275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:27.130275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:27.130275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:27.130275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:27.130275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:27.130275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:47:27.130275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:27.130275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 52/111] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:27.134583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494856-9804-4146-b21a-4460c5432963 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:27.196794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12452b-3495-410a-98b4-db6954b1ddfe None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:27.235287 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff178b-6fa4-494e-801a-d1d928d088ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:27.236339 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff178b-6fa4-494e-801a-d1d928d088ac None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:27.236876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff178b-6fa4-494e-801a-d1d928d088ac None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:27.237467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff178b-6fa4-494e-801a-d1d928d088ac None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:27.238515 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff178b-6fa4-494e-801a-d1d928d088ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:27.240184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff178b-6fa4-494e-801a-d1d928d088ac None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:27.240879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494856-9804-4146-b21a-4460c5432963 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:27.256298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:27.274504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 60/112] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 7 21:47:27 2022] POST /identity/v3/projects => generated 302 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:47:27.282252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff178b-6fa4-494e-801a-d1d928d088ac None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:27.288124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93db05-de9d-45ad-87ef-70bbf536dee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:27.289253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93db05-de9d-45ad-87ef-70bbf536dee3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:27.289631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93db05-de9d-45ad-87ef-70bbf536dee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:27.289971 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93db05-de9d-45ad-87ef-70bbf536dee3 None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:27.291296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93db05-de9d-45ad-87ef-70bbf536dee3 None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:27.292833 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93db05-de9d-45ad-87ef-70bbf536dee3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:27.294742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 53/113] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:27 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:27.295559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93db05-de9d-45ad-87ef-70bbf536dee3 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:27.358661 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:27.424406 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff178b-6fa4-494e-801a-d1d928d088ac None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:27.425645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93db05-de9d-45ad-87ef-70bbf536dee3 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:27.466535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff596af6-b376-4fb0-94d9-f8164bd46eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:27.467516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596af6-b376-4fb0-94d9-f8164bd46eab None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:27.467969 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596af6-b376-4fb0-94d9-f8164bd46eab None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:27.468329 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d567e-959a-49d4-91be-dae3229b715f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:27.468546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596af6-b376-4fb0-94d9-f8164bd46eab None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:27.469006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d567e-959a-49d4-91be-dae3229b715f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:27.469299 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d567e-959a-49d4-91be-dae3229b715f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:27.469580 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d567e-959a-49d4-91be-dae3229b715f None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:27.469909 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff596af6-b376-4fb0-94d9-f8164bd46eab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:27.470362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d567e-959a-49d4-91be-dae3229b715f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:27.470483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff596af6-b376-4fb0-94d9-f8164bd46eab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:27.470672 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d567e-959a-49d4-91be-dae3229b715f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:27.472071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d567e-959a-49d4-91be-dae3229b715f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:27.472313 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff596af6-b376-4fb0-94d9-f8164bd46eab None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:27.482078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 54/114] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:27.483445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c002ce0-646c-465a-bead-da62ca1e18e9 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:27.483743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c002ce0-646c-465a-bead-da62ca1e18e9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:27.484026 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c002ce0-646c-465a-bead-da62ca1e18e9 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:27.484720 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 61/115] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:27.485743 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff596af6-b376-4fb0-94d9-f8164bd46eab None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:27.497728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 55/116] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:27 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:27.498821 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c002ce0-646c-465a-bead-da62ca1e18e9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:27.551783 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:27.602775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff596af6-b376-4fb0-94d9-f8164bd46eab None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:27.619670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c002ce0-646c-465a-bead-da62ca1e18e9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:27.638640 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:27.638791 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3a145-f9f0-4b4e-915e-b4001dd7f307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:27.639780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3a145-f9f0-4b4e-915e-b4001dd7f307 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:27.640071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3a145-f9f0-4b4e-915e-b4001dd7f307 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:27.640498 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3a145-f9f0-4b4e-915e-b4001dd7f307 None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c/users/9bcbcac888534699a368bba89ae10030/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:27.642907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3a145-f9f0-4b4e-915e-b4001dd7f307 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb30985c7f9f457095a0e5e03ed6954c, user_id=9bcbcac888534699a368bba89ae10030, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:27.644391 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3a145-f9f0-4b4e-915e-b4001dd7f307 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:27.658373 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 62/117] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:47:27 2022] PUT /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c/users/9bcbcac888534699a368bba89ae10030/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:47:27.659191 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3a145-f9f0-4b4e-915e-b4001dd7f307 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:27.667768 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7e847-f9dc-4732-a2b0-056967cdb925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:27.669055 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7e847-f9dc-4732-a2b0-056967cdb925 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:27.669757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7e847-f9dc-4732-a2b0-056967cdb925 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:27.670315 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7e847-f9dc-4732-a2b0-056967cdb925 None admin] PATH_INFO: `/v3/users/926fd1db8b6244018f5f077bed34fa3c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:27.689109 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7e847-f9dc-4732-a2b0-056967cdb925 None admin] RBAC: Authorizing `identity:get_user(user_id=926fd1db8b6244018f5f077bed34fa3c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:27.691118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7e847-f9dc-4732-a2b0-056967cdb925 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:27.693270 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 56/118] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:27 2022] GET /identity/v3/users/926fd1db8b6244018f5f077bed34fa3c => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:27.700702 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353117a6-ffa0-405c-aa59-6a47de0a11ec None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:27.701312 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353117a6-ffa0-405c-aa59-6a47de0a11ec None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:27.701954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353117a6-ffa0-405c-aa59-6a47de0a11ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:27.721040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-353117a6-ffa0-405c-aa59-6a47de0a11ec None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:27.722471 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-353117a6-ffa0-405c-aa59-6a47de0a11ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:27.803543 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 57/119] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:27.803543 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef3bee-4b3d-44d0-8da7-9532ebf4514d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:27.803543 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef3bee-4b3d-44d0-8da7-9532ebf4514d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:27.803543 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef3bee-4b3d-44d0-8da7-9532ebf4514d None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:27.803543 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 58/120] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:27.803543 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef3bee-4b3d-44d0-8da7-9532ebf4514d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:27.844160 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3a145-f9f0-4b4e-915e-b4001dd7f307 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:27.878992 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:27.898445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcae6c1-e075-4191-a1e0-b8c770d7f8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:27.899572 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae6c1-e075-4191-a1e0-b8c770d7f8bb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:27.899979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae6c1-e075-4191-a1e0-b8c770d7f8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:27.900316 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae6c1-e075-4191-a1e0-b8c770d7f8bb None admin] PATH_INFO: `/v3/users/6e81933b979640d390f4c808a9dcf7c6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:27.901647 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcae6c1-e075-4191-a1e0-b8c770d7f8bb None admin] RBAC: Authorizing `identity:get_user(user_id=6e81933b979640d390f4c808a9dcf7c6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:27.903301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcae6c1-e075-4191-a1e0-b8c770d7f8bb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:27.905257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 63/121] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:27 2022] GET /identity/v3/users/6e81933b979640d390f4c808a9dcf7c6 => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:27.906448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0e88f-197f-4b8d-b3e3-9f57559169dd None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:27.906555 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0e88f-197f-4b8d-b3e3-9f57559169dd None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:27.908092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0e88f-197f-4b8d-b3e3-9f57559169dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:27.924919 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b7a0e88f-197f-4b8d-b3e3-9f57559169dd None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:27.926374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b7a0e88f-197f-4b8d-b3e3-9f57559169dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:27.937995 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef3bee-4b3d-44d0-8da7-9532ebf4514d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:27.940457 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:27.980327 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693c476-2842-4f84-811a-832b3276ed9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:27.981386 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693c476-2842-4f84-811a-832b3276ed9f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:27.981782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693c476-2842-4f84-811a-832b3276ed9f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:27.982433 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693c476-2842-4f84-811a-832b3276ed9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:28.001679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 64/122] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:28.002651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0e88f-197f-4b8d-b3e3-9f57559169dd None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:28.094514 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693c476-2842-4f84-811a-832b3276ed9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:28.095990 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693c476-2842-4f84-811a-832b3276ed9f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:28.133643 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0e88f-197f-4b8d-b3e3-9f57559169dd None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:28.148802 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:28.172264 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22edae-c997-4a29-a260-c1aab5c482a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:28.173081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22edae-c997-4a29-a260-c1aab5c482a2 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:28.173367 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22edae-c997-4a29-a260-c1aab5c482a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:28.173651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22edae-c997-4a29-a260-c1aab5c482a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:28.185271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22edae-c997-4a29-a260-c1aab5c482a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:28.193589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-cd22edae-c997-4a29-a260-c1aab5c482a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:28.193589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:28.193589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:28.193589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:28.193589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:28.193589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:28.193589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:28.193589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:28.193589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:28.193589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:28.193589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:28.193589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:28.193589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:28.193589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:28.193589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:28.193589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:28.194482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:28.194482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:28.194482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:28.194482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:28.194482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:28.194482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:28.194482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:28.194482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:28.194482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:28.194482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:28.194482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:28.194482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:28.194482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:28.194482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:28.194482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:28.194482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:28.195237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:28.195237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:28.195237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:28.195237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:28.195237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:28.195237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:28.195237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:28.195237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:28.195237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:28.195237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:28.195237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:28.195237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:28.199787 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 65/123] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:28.200644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22edae-c997-4a29-a260-c1aab5c482a2 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:28.202000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 59/124] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:47:28.202867 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693c476-2842-4f84-811a-832b3276ed9f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:28.208779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:28.310524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693c476-2842-4f84-811a-832b3276ed9f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:28.311686 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22edae-c997-4a29-a260-c1aab5c482a2 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:28.346720 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b69332-d854-4737-96c7-00261bc6aa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:28.347348 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02229518-3692-4d3a-9403-85ae5a5ba08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:28.347953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b69332-d854-4737-96c7-00261bc6aa57 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:28.348217 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02229518-3692-4d3a-9403-85ae5a5ba08c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:28.348506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02229518-3692-4d3a-9403-85ae5a5ba08c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:28.348741 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b69332-d854-4737-96c7-00261bc6aa57 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:28.348831 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02229518-3692-4d3a-9403-85ae5a5ba08c None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:28.349228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b69332-d854-4737-96c7-00261bc6aa57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:28.350288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02229518-3692-4d3a-9403-85ae5a5ba08c None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:28.351775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02229518-3692-4d3a-9403-85ae5a5ba08c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:28.353610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 66/125] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:28 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:28.354492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02229518-3692-4d3a-9403-85ae5a5ba08c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:28.365079 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b69332-d854-4737-96c7-00261bc6aa57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:28.373554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-78b69332-d854-4737-96c7-00261bc6aa57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:47:28.373554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:28.373554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:28.373554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:28.373554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:28.373554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:28.373554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:28.373554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:28.373554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:28.373554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:28.373554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:28.373554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:28.373554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:28.373554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:28.373554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:28.373554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:28.374591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:28.374591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:28.374591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:28.374591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:28.374591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:28.374591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:28.374591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:28.374591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:28.374591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:28.374591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:28.374591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:28.374591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:28.374591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:28.374591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:28.374591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:28.374591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:28.375362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:28.375362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:28.375362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:28.375362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:28.375362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:28.375362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:28.375362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:28.375362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:28.375362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:28.375362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:28.375362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:47:28.375362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:28.377607 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 60/126] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:47:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:28.378607 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b69332-d854-4737-96c7-00261bc6aa57 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:28.412344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:28.448168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:28.481843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02229518-3692-4d3a-9403-85ae5a5ba08c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:28.490080 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b69332-d854-4737-96c7-00261bc6aa57 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:28.520240 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd879fd-5422-4084-8652-eb5a599a5c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:28.521020 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd879fd-5422-4084-8652-eb5a599a5c28 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:28.521318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd879fd-5422-4084-8652-eb5a599a5c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:28.521601 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd879fd-5422-4084-8652-eb5a599a5c28 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:28.522397 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd879fd-5422-4084-8652-eb5a599a5c28 None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:28.522748 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd879fd-5422-4084-8652-eb5a599a5c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:28.524210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd879fd-5422-4084-8652-eb5a599a5c28 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:28.526850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa61246-39d9-4d06-a748-00d30765b952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:28.527973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa61246-39d9-4d06-a748-00d30765b952 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:28.528462 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa61246-39d9-4d06-a748-00d30765b952 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:28.528946 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa61246-39d9-4d06-a748-00d30765b952 None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:28.530391 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa61246-39d9-4d06-a748-00d30765b952 None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:28.532040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa61246-39d9-4d06-a748-00d30765b952 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:28.532986 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 67/127] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:28.533799 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd879fd-5422-4084-8652-eb5a599a5c28 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:28.534445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 61/128] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:28 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:28.535407 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa61246-39d9-4d06-a748-00d30765b952 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:28.650523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd879fd-5422-4084-8652-eb5a599a5c28 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:28.654049 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:28.679520 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa61246-39d9-4d06-a748-00d30765b952 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:28.690062 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c148e62-3d6a-4972-b5d4-1969d9400905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:28.691182 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c148e62-3d6a-4972-b5d4-1969d9400905 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:28.691572 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c148e62-3d6a-4972-b5d4-1969d9400905 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:28.691951 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c148e62-3d6a-4972-b5d4-1969d9400905 None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c/users/6e81933b979640d390f4c808a9dcf7c6/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:28.694037 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c148e62-3d6a-4972-b5d4-1969d9400905 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb30985c7f9f457095a0e5e03ed6954c, user_id=6e81933b979640d390f4c808a9dcf7c6, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:28.695600 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c148e62-3d6a-4972-b5d4-1969d9400905 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:28.711137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 68/129] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:47:28 2022] PUT /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c/users/6e81933b979640d390f4c808a9dcf7c6/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:47:28.712050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c148e62-3d6a-4972-b5d4-1969d9400905 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:28.727419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:28.735358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15c24e-ba1a-4aa2-bd97-9c8357c9eeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:28.736045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15c24e-ba1a-4aa2-bd97-9c8357c9eeb4 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:28.736495 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15c24e-ba1a-4aa2-bd97-9c8357c9eeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:28.736781 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15c24e-ba1a-4aa2-bd97-9c8357c9eeb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:28.737612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15c24e-ba1a-4aa2-bd97-9c8357c9eeb4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:28.737945 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15c24e-ba1a-4aa2-bd97-9c8357c9eeb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:28.739971 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15c24e-ba1a-4aa2-bd97-9c8357c9eeb4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:28.758408 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 62/130] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:47:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:28.761504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15c24e-ba1a-4aa2-bd97-9c8357c9eeb4 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:28.819928 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c148e62-3d6a-4972-b5d4-1969d9400905 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:28.858642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5bb49-00c4-490e-9be8-d21cda848938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:28.860732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5bb49-00c4-490e-9be8-d21cda848938 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:28.861023 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5bb49-00c4-490e-9be8-d21cda848938 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:28.861307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5bb49-00c4-490e-9be8-d21cda848938 None admin] PATH_INFO: `/v3/users/9bcbcac888534699a368bba89ae10030` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:28.862824 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5bb49-00c4-490e-9be8-d21cda848938 None admin] RBAC: Authorizing `identity:get_user(user_id=9bcbcac888534699a368bba89ae10030)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:28.866639 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5bb49-00c4-490e-9be8-d21cda848938 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:28.869230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 69/131] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:28 2022] GET /identity/v3/users/9bcbcac888534699a368bba89ae10030 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:28.870837 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5bb49-00c4-490e-9be8-d21cda848938 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:28.952037 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:28.967959 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15c24e-ba1a-4aa2-bd97-9c8357c9eeb4 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:29.046473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d1ca3-d4aa-4de5-a4d3-a4f5adaad78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:29.047124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d1ca3-d4aa-4de5-a4d3-a4f5adaad78c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:29.047443 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d1ca3-d4aa-4de5-a4d3-a4f5adaad78c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:29.047824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d1ca3-d4aa-4de5-a4d3-a4f5adaad78c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:29.048630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d1ca3-d4aa-4de5-a4d3-a4f5adaad78c None admin] RBAC: Adding query filter params (role.id=822830288b154ed78764b4d57d45d813, scope.project.id=eb30985c7f9f457095a0e5e03ed6954c, user.id=926fd1db8b6244018f5f077bed34fa3c) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:29.048954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d1ca3-d4aa-4de5-a4d3-a4f5adaad78c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:29.050594 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d1ca3-d4aa-4de5-a4d3-a4f5adaad78c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:29.060117 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 63/132] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:28 2022] GET /identity/v3/role_assignments?user.id=926fd1db8b6244018f5f077bed34fa3c&scope.project.id=eb30985c7f9f457095a0e5e03ed6954c&role.id=822830288b154ed78764b4d57d45d813 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:29.061289 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d1ca3-d4aa-4de5-a4d3-a4f5adaad78c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:29.064719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5bb49-00c4-490e-9be8-d21cda848938 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:29.145215 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6709b9-367b-4c00-9f65-b19f362d9eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:29.147144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6709b9-367b-4c00-9f65-b19f362d9eee None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:29.147645 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6709b9-367b-4c00-9f65-b19f362d9eee None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:29.148130 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6709b9-367b-4c00-9f65-b19f362d9eee None admin] PATH_INFO: `/v3/users/9bcbcac888534699a368bba89ae10030` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:29.151103 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6709b9-367b-4c00-9f65-b19f362d9eee None admin] RBAC: Authorizing `identity:get_user(user_id=9bcbcac888534699a368bba89ae10030)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:29.153006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6709b9-367b-4c00-9f65-b19f362d9eee None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:29.156031 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 70/133] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:28 2022] GET /identity/v3/users/9bcbcac888534699a368bba89ae10030 => generated 275 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:29.162092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6709b9-367b-4c00-9f65-b19f362d9eee None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:29.188842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:29.296272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d1ca3-d4aa-4de5-a4d3-a4f5adaad78c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:29.341028 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:29.344086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6709b9-367b-4c00-9f65-b19f362d9eee None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:29.406670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b13a7-f454-401c-ace3-557845dea5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:29.407948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b13a7-f454-401c-ace3-557845dea5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:29.408443 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b13a7-f454-401c-ace3-557845dea5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:29.408944 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b13a7-f454-401c-ace3-557845dea5e2 None admin] PATH_INFO: `/v3/projects/9fe63d8beeec45e7a7ad93fa39cc20f6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:29.410515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b13a7-f454-401c-ace3-557845dea5e2 None admin] RBAC: Authorizing `identity:get_project(project_id=9fe63d8beeec45e7a7ad93fa39cc20f6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:29.412212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b13a7-f454-401c-ace3-557845dea5e2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:29.414273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 64/134] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:29 2022] GET /identity/v3/projects/9fe63d8beeec45e7a7ad93fa39cc20f6 => generated 312 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:29.422511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b13a7-f454-401c-ace3-557845dea5e2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:29.426844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2d521-eb4f-496a-89a1-c1cc4de90fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:29.427746 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2d521-eb4f-496a-89a1-c1cc4de90fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:29.428039 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2d521-eb4f-496a-89a1-c1cc4de90fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:29.428326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2d521-eb4f-496a-89a1-c1cc4de90fb8 None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:29.430342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2d521-eb4f-496a-89a1-c1cc4de90fb8 None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:29.433489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2d521-eb4f-496a-89a1-c1cc4de90fb8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:29.435469 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 71/135] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:29 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:29.442045 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2d521-eb4f-496a-89a1-c1cc4de90fb8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:29.616010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b13a7-f454-401c-ace3-557845dea5e2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:29.625091 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2d521-eb4f-496a-89a1-c1cc4de90fb8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:29.645850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:29.656357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1448f1-f039-49d3-91b9-fe0936f5c4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:29.657349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1448f1-f039-49d3-91b9-fe0936f5c4e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:29.657705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1448f1-f039-49d3-91b9-fe0936f5c4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:29.658086 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1448f1-f039-49d3-91b9-fe0936f5c4e4 None admin] PATH_INFO: `/v3/projects/9fe63d8beeec45e7a7ad93fa39cc20f6/users/9bcbcac888534699a368bba89ae10030/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:29.660558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1448f1-f039-49d3-91b9-fe0936f5c4e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fe63d8beeec45e7a7ad93fa39cc20f6, user_id=9bcbcac888534699a368bba89ae10030, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:29.662524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1448f1-f039-49d3-91b9-fe0936f5c4e4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:29.686191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 65/136] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:47:29 2022] PUT /identity/v3/projects/9fe63d8beeec45e7a7ad93fa39cc20f6/users/9bcbcac888534699a368bba89ae10030/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 21:47:29.687819 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2eb1d-8fe1-450e-aa1c-ec96b9cce95a None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:29.688111 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2eb1d-8fe1-450e-aa1c-ec96b9cce95a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:29.688391 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2eb1d-8fe1-450e-aa1c-ec96b9cce95a None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:29.690004 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 66/137] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:29.695410 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82efe2-f244-4ba7-90b8-d4656c07ce72 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:29.695695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82efe2-f244-4ba7-90b8-d4656c07ce72 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:29.696027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82efe2-f244-4ba7-90b8-d4656c07ce72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:29.698508 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290384f-90fc-443e-ae2a-865780830f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:29.699422 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290384f-90fc-443e-ae2a-865780830f8e None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:29.699703 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290384f-90fc-443e-ae2a-865780830f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:29.699978 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290384f-90fc-443e-ae2a-865780830f8e None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c/users/9bcbcac888534699a368bba89ae10030/roles/73d4eafa268f4cc3aca4863c73b794ae` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:29.708648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290384f-90fc-443e-ae2a-865780830f8e None admin] RBAC: Authorizing `identity:create_grant(project_id=eb30985c7f9f457095a0e5e03ed6954c, user_id=9bcbcac888534699a368bba89ae10030, role_id=73d4eafa268f4cc3aca4863c73b794ae)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:29.710690 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290384f-90fc-443e-ae2a-865780830f8e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:29.716473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0c82efe2-f244-4ba7-90b8-d4656c07ce72 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:29.717754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0c82efe2-f244-4ba7-90b8-d4656c07ce72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:29.748587 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 72/138] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:47:29 2022] PUT /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c/users/9bcbcac888534699a368bba89ae10030/roles/73d4eafa268f4cc3aca4863c73b794ae => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 21:47:29.800691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 67/139] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:47:29.827348 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290384f-90fc-443e-ae2a-865780830f8e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:29.866470 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:29.951319 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290384f-90fc-443e-ae2a-865780830f8e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:29.991913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120110bc-6a9c-4c4c-8e43-d6f2b72091ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:29.992720 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120110bc-6a9c-4c4c-8e43-d6f2b72091ae None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:29.993050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120110bc-6a9c-4c4c-8e43-d6f2b72091ae None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:29.993324 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120110bc-6a9c-4c4c-8e43-d6f2b72091ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:29.994612 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120110bc-6a9c-4c4c-8e43-d6f2b72091ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:29.996169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120110bc-6a9c-4c4c-8e43-d6f2b72091ae None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:29.998228 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 73/140] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:47:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:30.003918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82efe2-f244-4ba7-90b8-d4656c07ce72 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:30.131843 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82efe2-f244-4ba7-90b8-d4656c07ce72 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:30.149419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:30.169746 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95eae64-be93-4dbf-9b02-efe593f1ba13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:30.170562 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eae64-be93-4dbf-9b02-efe593f1ba13 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:30.170847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eae64-be93-4dbf-9b02-efe593f1ba13 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:30.171123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eae64-be93-4dbf-9b02-efe593f1ba13 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:30.171899 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95eae64-be93-4dbf-9b02-efe593f1ba13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:30.173373 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95eae64-be93-4dbf-9b02-efe593f1ba13 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:30.194273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 68/141] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:47:30 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:47:30.569718 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9a2e-1436-4967-a66f-185c061f0f5e None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:30.570407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9a2e-1436-4967-a66f-185c061f0f5e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:30.570407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9a2e-1436-4967-a66f-185c061f0f5e None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:30.571916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 74/142] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:30.580737 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dee0a0-38d8-4239-9401-ed87e8f4b5ed None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:30.581090 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dee0a0-38d8-4239-9401-ed87e8f4b5ed None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:30.581518 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dee0a0-38d8-4239-9401-ed87e8f4b5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:30.601687 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-13dee0a0-38d8-4239-9401-ed87e8f4b5ed None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:30.603105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-13dee0a0-38d8-4239-9401-ed87e8f4b5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:30.695371 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 69/143] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:47:30.726105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a9a2e-1436-4967-a66f-185c061f0f5e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:30.848242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:30.855462 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a9a2e-1436-4967-a66f-185c061f0f5e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:30.894150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adaea00-7b85-47fc-b7fa-c0b969c221ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:30.894943 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaea00-7b85-47fc-b7fa-c0b969c221ec None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:30.895224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaea00-7b85-47fc-b7fa-c0b969c221ec None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:30.895499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaea00-7b85-47fc-b7fa-c0b969c221ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:30.910723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adaea00-7b85-47fc-b7fa-c0b969c221ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:30.918767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-5adaea00-7b85-47fc-b7fa-c0b969c221ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:30.918767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:30.918767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:30.918767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:30.918767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:30.918767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:30.918767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:30.918767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:30.918767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:30.918767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:30.918767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:30.918767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:30.918767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:30.918767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:30.918767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:30.918767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:30.920976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:30.920976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:30.920976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:30.920976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:30.920976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:30.920976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:30.920976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:30.920976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:30.920976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:30.920976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:30.920976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:30.920976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:30.920976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:30.920976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:30.920976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:30.920976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:30.923000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:30.923000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:30.923000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:30.923000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:30.923000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:30.923000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:30.923000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:30.923000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:30.923000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:30.923000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:30.923000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:30.923000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:30.923000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 75/144] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:30.931226 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dee0a0-38d8-4239-9401-ed87e8f4b5ed None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:31.052559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dee0a0-38d8-4239-9401-ed87e8f4b5ed None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:31.054418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:31.105702 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c32c16-3a68-487d-9729-374db94e5149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:31.106763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c32c16-3a68-487d-9729-374db94e5149 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:31.107251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c32c16-3a68-487d-9729-374db94e5149 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:31.107726 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c32c16-3a68-487d-9729-374db94e5149 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:31.108694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c32c16-3a68-487d-9729-374db94e5149 None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:31.109210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c32c16-3a68-487d-9729-374db94e5149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:31.110907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c32c16-3a68-487d-9729-374db94e5149 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:31.122782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 70/145] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:31.128060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adaea00-7b85-47fc-b7fa-c0b969c221ec None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:31.293242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adaea00-7b85-47fc-b7fa-c0b969c221ec None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:31.329745 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d1216-2a2c-428f-b721-43701e2f57eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:31.330707 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d1216-2a2c-428f-b721-43701e2f57eb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:31.331670 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d1216-2a2c-428f-b721-43701e2f57eb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:31.331954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d1216-2a2c-428f-b721-43701e2f57eb None admin] PATH_INFO: `/v3/users/9bcbcac888534699a368bba89ae10030` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:31.333185 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d1216-2a2c-428f-b721-43701e2f57eb None admin] RBAC: Authorizing `identity:get_user(user_id=9bcbcac888534699a368bba89ae10030)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:31.334675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d1216-2a2c-428f-b721-43701e2f57eb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:31.336601 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 76/146] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:31 2022] GET /identity/v3/users/9bcbcac888534699a368bba89ae10030 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:31.342163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c32c16-3a68-487d-9729-374db94e5149 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:31.501818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c32c16-3a68-487d-9729-374db94e5149 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:31.547245 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099f9be-94ef-417e-910a-b56e6012045b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:31.548269 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099f9be-94ef-417e-910a-b56e6012045b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:31.548755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099f9be-94ef-417e-910a-b56e6012045b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:31.549236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099f9be-94ef-417e-910a-b56e6012045b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:31.587264 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:31.640165 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099f9be-94ef-417e-910a-b56e6012045b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:31.641662 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099f9be-94ef-417e-910a-b56e6012045b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:31.758698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 71/147] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:47:31.765489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d1216-2a2c-428f-b721-43701e2f57eb None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:31.817602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:31.925805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d1216-2a2c-428f-b721-43701e2f57eb None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:31.961455 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21d0da-f724-43c1-9ae8-6af36fb318c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:31.962348 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21d0da-f724-43c1-9ae8-6af36fb318c5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:31.962686 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21d0da-f724-43c1-9ae8-6af36fb318c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:31.962961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21d0da-f724-43c1-9ae8-6af36fb318c5 None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:31.964788 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21d0da-f724-43c1-9ae8-6af36fb318c5 None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:31.966272 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21d0da-f724-43c1-9ae8-6af36fb318c5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:31.968327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 77/148] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:31 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:31.974168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099f9be-94ef-417e-910a-b56e6012045b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:32.067957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:32.121983 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099f9be-94ef-417e-910a-b56e6012045b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:32.172429 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b7471-2cf4-490e-a5c0-4985a283cf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:32.173451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b7471-2cf4-490e-a5c0-4985a283cf08 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:32.173961 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b7471-2cf4-490e-a5c0-4985a283cf08 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:32.174438 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b7471-2cf4-490e-a5c0-4985a283cf08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:32.175465 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b7471-2cf4-490e-a5c0-4985a283cf08 None admin] RBAC: Adding query filter params (role.id=01ccb434cf384bc79bf82f49b697f1ce, scope.project.id=eb30985c7f9f457095a0e5e03ed6954c, user.id=9bcbcac888534699a368bba89ae10030) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:32.176043 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b7471-2cf4-490e-a5c0-4985a283cf08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:32.177718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b7471-2cf4-490e-a5c0-4985a283cf08 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:32.186589 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 72/149] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:31 2022] GET /identity/v3/role_assignments?user.id=9bcbcac888534699a368bba89ae10030&scope.project.id=eb30985c7f9f457095a0e5e03ed6954c&role.id=01ccb434cf384bc79bf82f49b697f1ce => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:32.326133 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ce016-b72d-424b-9950-24666f50b92b None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:32.326487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ce016-b72d-424b-9950-24666f50b92b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:32.326702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ce016-b72d-424b-9950-24666f50b92b None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:32.328310 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 78/150] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:32.351955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4672e3-9642-40f9-aa7a-4e211c5fa7fa None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:32.352878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4672e3-9642-40f9-aa7a-4e211c5fa7fa None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:32.353379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4672e3-9642-40f9-aa7a-4e211c5fa7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:32.383687 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-7c4672e3-9642-40f9-aa7a-4e211c5fa7fa None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:32.384888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7c4672e3-9642-40f9-aa7a-4e211c5fa7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:32.479954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 73/151] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:32.516446 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ce016-b72d-424b-9950-24666f50b92b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:32.645989 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:32.661599 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ce016-b72d-424b-9950-24666f50b92b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:32.705755 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5ff99-4a12-4737-943d-c1cb1102c9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:32.706594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5ff99-4a12-4737-943d-c1cb1102c9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:32.706873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5ff99-4a12-4737-943d-c1cb1102c9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:32.707144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5ff99-4a12-4737-943d-c1cb1102c9a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:32.720778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5ff99-4a12-4737-943d-c1cb1102c9a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:32.732238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-f7d5ff99-4a12-4737-943d-c1cb1102c9a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:32.732238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:32.732238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:32.732238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:32.732238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:32.732238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:32.732238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:32.732238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:32.732238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:32.732238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:32.732238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:32.732238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:32.732238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:32.732238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:32.732238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:32.732238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:32.733125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:32.733125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:32.733125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:32.733125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:32.733125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:32.733125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:32.733125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:32.733125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:32.733125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:32.733125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:32.733125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:32.733125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:32.733125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:32.733125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:32.733125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:32.733125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:32.733890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:32.733890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:32.733890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:32.733890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:32.733890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:32.733890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:32.733890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:32.733890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:32.733890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:32.733890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:32.733890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:32.733890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:32.733890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 79/152] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:47:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:32.739213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4672e3-9642-40f9-aa7a-4e211c5fa7fa None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:32.829957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:32.883549 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4672e3-9642-40f9-aa7a-4e211c5fa7fa None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:32.925189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8528f7-dd7e-4dcf-b9e4-a15ffcc1e797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:32.926293 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8528f7-dd7e-4dcf-b9e4-a15ffcc1e797 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:32.926804 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8528f7-dd7e-4dcf-b9e4-a15ffcc1e797 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:32.927269 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8528f7-dd7e-4dcf-b9e4-a15ffcc1e797 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:32.928229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8528f7-dd7e-4dcf-b9e4-a15ffcc1e797 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:32.928745 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8528f7-dd7e-4dcf-b9e4-a15ffcc1e797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:32.930373 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8528f7-dd7e-4dcf-b9e4-a15ffcc1e797 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:32.939910 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 74/153] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:32.945441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5ff99-4a12-4737-943d-c1cb1102c9a8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:33.094672 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5ff99-4a12-4737-943d-c1cb1102c9a8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:33.137493 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299a0e1-699c-46af-a30e-f9e4de0ab147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:33.138409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299a0e1-699c-46af-a30e-f9e4de0ab147 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:33.138697 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299a0e1-699c-46af-a30e-f9e4de0ab147 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:33.138971 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299a0e1-699c-46af-a30e-f9e4de0ab147 None admin] PATH_INFO: `/v3/users/6e81933b979640d390f4c808a9dcf7c6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:33.140201 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299a0e1-699c-46af-a30e-f9e4de0ab147 None admin] RBAC: Authorizing `identity:get_user(user_id=6e81933b979640d390f4c808a9dcf7c6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:33.141657 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299a0e1-699c-46af-a30e-f9e4de0ab147 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:33.143556 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 80/154] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:32 2022] GET /identity/v3/users/6e81933b979640d390f4c808a9dcf7c6 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:33.148852 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8528f7-dd7e-4dcf-b9e4-a15ffcc1e797 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:33.289477 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8528f7-dd7e-4dcf-b9e4-a15ffcc1e797 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:33.314996 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:33.338353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680e164-cbe9-4c26-b523-8101e9f1f2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:33.339549 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680e164-cbe9-4c26-b523-8101e9f1f2fb None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:33.339832 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680e164-cbe9-4c26-b523-8101e9f1f2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:33.340104 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680e164-cbe9-4c26-b523-8101e9f1f2fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:33.428258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680e164-cbe9-4c26-b523-8101e9f1f2fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:33.429733 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680e164-cbe9-4c26-b523-8101e9f1f2fb None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:33.534061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 75/155] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:47:33.539942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299a0e1-699c-46af-a30e-f9e4de0ab147 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:33.589650 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:33.621706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fa4d7-1dfe-48c5-8633-d1f19b347e2f None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:33.622234 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fa4d7-1dfe-48c5-8633-d1f19b347e2f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:33.622677 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fa4d7-1dfe-48c5-8633-d1f19b347e2f None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:33.624197 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 76/156] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:47:33.640145 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a4a58-78c9-4a9a-83a5-ec4698aad13f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:33.640688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a4a58-78c9-4a9a-83a5-ec4698aad13f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:33.641302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a4a58-78c9-4a9a-83a5-ec4698aad13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:33.675665 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f60a4a58-78c9-4a9a-83a5-ec4698aad13f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:33.677106 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f60a4a58-78c9-4a9a-83a5-ec4698aad13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:33.719255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:33.763872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299a0e1-699c-46af-a30e-f9e4de0ab147 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:33.787746 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 77/157] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:47:33.788929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd805c1-0988-4141-b59a-28480895873c None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:33.789224 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd805c1-0988-4141-b59a-28480895873c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:33.789506 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd805c1-0988-4141-b59a-28480895873c None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:33.790810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 78/158] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:33.797696 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5696e-e09a-43f1-a4b2-c11a02de15bf None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:33.798027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5696e-e09a-43f1-a4b2-c11a02de15bf None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:33.798310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5696e-e09a-43f1-a4b2-c11a02de15bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:33.826314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-fad5696e-e09a-43f1-a4b2-c11a02de15bf None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:33.827497 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fad5696e-e09a-43f1-a4b2-c11a02de15bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:33.874785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7ee6f-7625-4eca-a9ac-2f3afe16b4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:33.875602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7ee6f-7625-4eca-a9ac-2f3afe16b4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:33.875887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7ee6f-7625-4eca-a9ac-2f3afe16b4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:33.876170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7ee6f-7625-4eca-a9ac-2f3afe16b4f3 None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:33.882719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7ee6f-7625-4eca-a9ac-2f3afe16b4f3 None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:33.884226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7ee6f-7625-4eca-a9ac-2f3afe16b4f3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:33.886396 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 81/159] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:33 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:33.887147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7ee6f-7625-4eca-a9ac-2f3afe16b4f3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:33.947159 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 79/160] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:33.948024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5696e-e09a-43f1-a4b2-c11a02de15bf None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:34.082365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:34.100980 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:34.117554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5696e-e09a-43f1-a4b2-c11a02de15bf None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:34.126359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7ee6f-7625-4eca-a9ac-2f3afe16b4f3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:34.179726 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbcc13-8a8f-4f06-85cd-2cecfca23b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:34.180398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbcc13-8a8f-4f06-85cd-2cecfca23b5b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:34.180708 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbcc13-8a8f-4f06-85cd-2cecfca23b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:34.181074 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbcc13-8a8f-4f06-85cd-2cecfca23b5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:34.182071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbcc13-8a8f-4f06-85cd-2cecfca23b5b None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=eb30985c7f9f457095a0e5e03ed6954c, user.id=6e81933b979640d390f4c808a9dcf7c6) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:34.182394 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbcc13-8a8f-4f06-85cd-2cecfca23b5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:34.184394 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbcc13-8a8f-4f06-85cd-2cecfca23b5b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:34.197390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 80/161] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:33 2022] GET /identity/v3/role_assignments?user.id=6e81933b979640d390f4c808a9dcf7c6&scope.project.id=eb30985c7f9f457095a0e5e03ed6954c&role.id=8f58ef9d28494d97a68de20b84355450 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:34.197999 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbcc13-8a8f-4f06-85cd-2cecfca23b5b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:34.206933 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f813e45-0a5f-494c-a2fc-faca21a16788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:34.208206 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f813e45-0a5f-494c-a2fc-faca21a16788 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:34.208733 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f813e45-0a5f-494c-a2fc-faca21a16788 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:34.209201 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f813e45-0a5f-494c-a2fc-faca21a16788 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:34.241294 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f813e45-0a5f-494c-a2fc-faca21a16788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:34.253961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-2f813e45-0a5f-494c-a2fc-faca21a16788 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:47:34.253961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:34.253961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:34.253961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:34.253961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:34.253961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:34.253961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:34.253961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:34.253961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:34.253961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:34.253961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:34.253961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:34.253961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:34.253961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:34.253961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:34.253961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:34.254908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:34.254908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:34.254908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:34.254908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:34.254908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:34.254908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:34.254908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:34.254908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:34.254908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:34.254908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:34.254908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:34.254908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:34.254908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:34.254908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:34.254908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:34.254908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:34.255676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:34.255676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:34.255676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:34.255676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:34.255676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:34.255676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:34.255676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:34.255676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:34.255676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:34.255676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:34.255676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:47:34.255676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:34.258613 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 82/162] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:34.264252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f813e45-0a5f-494c-a2fc-faca21a16788 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:34.416804 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbcc13-8a8f-4f06-85cd-2cecfca23b5b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:34.466243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f813e45-0a5f-494c-a2fc-faca21a16788 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:34.481362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d0e4f-e58a-4778-b407-b6f100f6519c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:34.482216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d0e4f-e58a-4778-b407-b6f100f6519c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:34.482507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d0e4f-e58a-4778-b407-b6f100f6519c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:34.482787 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d0e4f-e58a-4778-b407-b6f100f6519c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:34.506850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d0e4f-e58a-4778-b407-b6f100f6519c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:34.525204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-313d0e4f-e58a-4778-b407-b6f100f6519c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:34.525204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:34.525204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:34.525204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:34.525204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:34.525204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:34.525204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:34.525204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:34.525204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:34.525204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:34.525204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:34.525204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:34.525204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:34.525204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:34.525204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:34.525204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:34.526222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:34.526222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:34.526222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:34.526222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:34.526222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:34.526222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:34.526222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:34.526222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:34.526222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:34.526222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:34.526222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:34.526222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:34.526222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:34.526222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:34.526222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:34.526222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:34.527067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:34.527067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:34.527067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:34.527067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:34.527067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:34.527067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:34.527067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:34.527067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:34.527067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:34.527067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:34.527067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:34.527067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:34.527067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 81/163] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:34.528262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fc019-195a-49b7-9eb6-f927a70b7daa None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:34.528262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fc019-195a-49b7-9eb6-f927a70b7daa None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:34.529962 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fc019-195a-49b7-9eb6-f927a70b7daa None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:34.529962 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 82/164] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:34.540706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0a40d-5d31-42ad-937a-e81423c4fb76 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:34.541007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0a40d-5d31-42ad-937a-e81423c4fb76 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:34.541264 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0a40d-5d31-42ad-937a-e81423c4fb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:34.545954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41570fad-4563-4d2a-afaf-9324b23f5eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:34.546653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41570fad-4563-4d2a-afaf-9324b23f5eaa None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:34.546942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41570fad-4563-4d2a-afaf-9324b23f5eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:34.547214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41570fad-4563-4d2a-afaf-9324b23f5eaa None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:34.547991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41570fad-4563-4d2a-afaf-9324b23f5eaa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:34.548302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41570fad-4563-4d2a-afaf-9324b23f5eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:34.549733 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41570fad-4563-4d2a-afaf-9324b23f5eaa None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:34.564629 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:34.576148 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 83/165] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:34.577027 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41570fad-4563-4d2a-afaf-9324b23f5eaa None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:34.589916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-5fc0a40d-5d31-42ad-937a-e81423c4fb76 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:34.591146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5fc0a40d-5d31-42ad-937a-e81423c4fb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:34.608560 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:34.735809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41570fad-4563-4d2a-afaf-9324b23f5eaa None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:34.772909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 83/166] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:47:34.775198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0a40d-5d31-42ad-937a-e81423c4fb76 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:34.784015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5e8ca-b658-4394-aa43-c61277a5079a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:34.786725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5e8ca-b658-4394-aa43-c61277a5079a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:34.791252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5e8ca-b658-4394-aa43-c61277a5079a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:34.791751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5e8ca-b658-4394-aa43-c61277a5079a None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:34.792770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5e8ca-b658-4394-aa43-c61277a5079a None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:34.793299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5e8ca-b658-4394-aa43-c61277a5079a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:34.794927 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5e8ca-b658-4394-aa43-c61277a5079a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:34.813408 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 84/167] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:34.814622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5e8ca-b658-4394-aa43-c61277a5079a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:34.911890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:34.921716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0a40d-5d31-42ad-937a-e81423c4fb76 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:34.946462 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5e8ca-b658-4394-aa43-c61277a5079a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:34.958953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1f527-39e9-4441-a9ff-78ca1f6aef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:34.960112 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1f527-39e9-4441-a9ff-78ca1f6aef81 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:34.960536 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1f527-39e9-4441-a9ff-78ca1f6aef81 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:34.960980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1f527-39e9-4441-a9ff-78ca1f6aef81 None admin] PATH_INFO: `/v3/users/926fd1db8b6244018f5f077bed34fa3c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:34.962391 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1f527-39e9-4441-a9ff-78ca1f6aef81 None admin] RBAC: Authorizing `identity:get_user(user_id=926fd1db8b6244018f5f077bed34fa3c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:34.964582 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1f527-39e9-4441-a9ff-78ca1f6aef81 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:34.966452 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 84/168] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:34 2022] GET /identity/v3/users/926fd1db8b6244018f5f077bed34fa3c => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:34.967451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1f527-39e9-4441-a9ff-78ca1f6aef81 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:34.972652 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:34.990601 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ea3ae-ea68-4fcd-9854-237091ac486c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:34.991437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ea3ae-ea68-4fcd-9854-237091ac486c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:34.991793 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ea3ae-ea68-4fcd-9854-237091ac486c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:34.992141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ea3ae-ea68-4fcd-9854-237091ac486c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:35.004197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ea3ae-ea68-4fcd-9854-237091ac486c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:35.012872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c27ea3ae-ea68-4fcd-9854-237091ac486c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:47:35.012872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:35.012872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:35.012872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:35.012872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:35.012872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:35.012872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:35.012872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:35.012872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:35.012872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:35.012872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:35.012872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:35.012872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:35.012872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:35.012872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:35.012872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:35.013792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:35.013792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:35.013792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:35.013792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:35.013792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:35.013792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:35.013792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:35.013792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:35.013792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:35.013792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:35.013792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:35.013792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:35.013792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:35.013792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:35.013792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:35.013792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:35.014627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:35.014627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:35.014627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:35.014627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:35.014627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:35.014627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:35.014627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:35.014627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:35.014627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:35.014627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:35.014627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:47:35.014627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:35.015709 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 85/169] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:47:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:35.016708 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d89ab-f619-478f-8499-8a70b85a5eda None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:35.016999 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d89ab-f619-478f-8499-8a70b85a5eda None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:35.017277 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d89ab-f619-478f-8499-8a70b85a5eda None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:35.018610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 86/170] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:35.019492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d89ab-f619-478f-8499-8a70b85a5eda None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:35.080177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1f527-39e9-4441-a9ff-78ca1f6aef81 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:35.123356 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90ed6e-1bcc-45d5-b0d4-4c046d0a0332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:35.124577 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90ed6e-1bcc-45d5-b0d4-4c046d0a0332 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:35.124862 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90ed6e-1bcc-45d5-b0d4-4c046d0a0332 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:35.125141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90ed6e-1bcc-45d5-b0d4-4c046d0a0332 None admin] PATH_INFO: `/v3/users/9bcbcac888534699a368bba89ae10030` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:35.126500 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90ed6e-1bcc-45d5-b0d4-4c046d0a0332 None admin] RBAC: Authorizing `identity:get_user(user_id=9bcbcac888534699a368bba89ae10030)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:35.128006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90ed6e-1bcc-45d5-b0d4-4c046d0a0332 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:35.134167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 85/171] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:34 2022] GET /identity/v3/users/9bcbcac888534699a368bba89ae10030 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:35.134167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90ed6e-1bcc-45d5-b0d4-4c046d0a0332 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:35.152396 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d89ab-f619-478f-8499-8a70b85a5eda None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:35.183441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:35.189336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a352b1e-91e4-443f-bb79-f820061dad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:35.190557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a352b1e-91e4-443f-bb79-f820061dad58 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:35.190846 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a352b1e-91e4-443f-bb79-f820061dad58 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:35.191124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a352b1e-91e4-443f-bb79-f820061dad58 None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:35.192322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a352b1e-91e4-443f-bb79-f820061dad58 None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:35.193767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a352b1e-91e4-443f-bb79-f820061dad58 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:35.195665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 87/172] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:35 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:35.196839 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07a765-626b-4ff9-b20b-0cee498a59af None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:35.197127 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07a765-626b-4ff9-b20b-0cee498a59af None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:35.197403 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07a765-626b-4ff9-b20b-0cee498a59af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:35.209950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:35.214031 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ad07a765-626b-4ff9-b20b-0cee498a59af None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:35.215232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ad07a765-626b-4ff9-b20b-0cee498a59af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:35.243877 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90ed6e-1bcc-45d5-b0d4-4c046d0a0332 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:35.280431 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c159d6e-ed3c-44f6-a5a8-de56bd22d3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:35.281093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c159d6e-ed3c-44f6-a5a8-de56bd22d3ee None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:35.281377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c159d6e-ed3c-44f6-a5a8-de56bd22d3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:35.281655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c159d6e-ed3c-44f6-a5a8-de56bd22d3ee None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:35.282431 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c159d6e-ed3c-44f6-a5a8-de56bd22d3ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:35.282737 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c159d6e-ed3c-44f6-a5a8-de56bd22d3ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:35.284132 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c159d6e-ed3c-44f6-a5a8-de56bd22d3ee None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:35.286469 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 88/173] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:35.287789 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856ba3f-8a17-4813-af42-132497fa3c64 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:35.288085 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856ba3f-8a17-4813-af42-132497fa3c64 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:35.288364 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856ba3f-8a17-4813-af42-132497fa3c64 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:35.293782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 89/174] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:35.293782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856ba3f-8a17-4813-af42-132497fa3c64 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:35.305872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 86/175] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:47:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:35.305872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c159d6e-ed3c-44f6-a5a8-de56bd22d3ee None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:35.410957 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856ba3f-8a17-4813-af42-132497fa3c64 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:35.420192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c159d6e-ed3c-44f6-a5a8-de56bd22d3ee None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:35.442119 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:35.449755 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67041f-1ce4-4b1e-90cd-bf0daa4fbdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:35.450742 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67041f-1ce4-4b1e-90cd-bf0daa4fbdc2 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:35.450952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67041f-1ce4-4b1e-90cd-bf0daa4fbdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:35.451229 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67041f-1ce4-4b1e-90cd-bf0daa4fbdc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:35.453029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:35.460821 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ff1ef-0e79-4fc2-bed8-00f2da43a2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:35.461715 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff1ef-0e79-4fc2-bed8-00f2da43a2ab None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:35.462030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff1ef-0e79-4fc2-bed8-00f2da43a2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:35.462301 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff1ef-0e79-4fc2-bed8-00f2da43a2ab None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c/users/926fd1db8b6244018f5f077bed34fa3c/roles/822830288b154ed78764b4d57d45d813` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:35.464321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ff1ef-0e79-4fc2-bed8-00f2da43a2ab None admin] RBAC: Authorizing `identity:create_grant(project_id=eb30985c7f9f457095a0e5e03ed6954c, user_id=926fd1db8b6244018f5f077bed34fa3c, role_id=822830288b154ed78764b4d57d45d813)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:35.465770 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ff1ef-0e79-4fc2-bed8-00f2da43a2ab None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:35.478302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 87/176] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:47:35 2022] PUT /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c/users/926fd1db8b6244018f5f077bed34fa3c/roles/822830288b154ed78764b4d57d45d813 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:47:35.479505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f2059-cf04-4fdf-94a2-e0058380df9b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:35.479796 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f2059-cf04-4fdf-94a2-e0058380df9b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:35.480075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f2059-cf04-4fdf-94a2-e0058380df9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:35.498990 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a50f2059-cf04-4fdf-94a2-e0058380df9b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:35.500155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a50f2059-cf04-4fdf-94a2-e0058380df9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:35.537673 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67041f-1ce4-4b1e-90cd-bf0daa4fbdc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:35.539736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67041f-1ce4-4b1e-90cd-bf0daa4fbdc2 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:35.578181 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 88/177] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:35.579126 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f2059-cf04-4fdf-94a2-e0058380df9b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:35.665133 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 90/178] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:47:35.669974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67041f-1ce4-4b1e-90cd-bf0daa4fbdc2 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:35.699831 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:35.708431 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f2059-cf04-4fdf-94a2-e0058380df9b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:35.731398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:35.743909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309b838-c449-41e1-978a-28453dd0e74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:35.744780 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309b838-c449-41e1-978a-28453dd0e74d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:35.745561 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309b838-c449-41e1-978a-28453dd0e74d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:35.745837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309b838-c449-41e1-978a-28453dd0e74d None admin] PATH_INFO: `/v3/users/9bcbcac888534699a368bba89ae10030` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:35.747062 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309b838-c449-41e1-978a-28453dd0e74d None admin] RBAC: Authorizing `identity:get_user(user_id=9bcbcac888534699a368bba89ae10030)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:35.748514 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309b838-c449-41e1-978a-28453dd0e74d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:35.750229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 89/179] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:35 2022] GET /identity/v3/users/9bcbcac888534699a368bba89ae10030 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:35.755683 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78faea-8854-4413-a59c-ffb031957f5c None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:35.755962 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78faea-8854-4413-a59c-ffb031957f5c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:35.756229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78faea-8854-4413-a59c-ffb031957f5c None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:35.757497 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 90/180] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:35.758201 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78faea-8854-4413-a59c-ffb031957f5c None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:35.785784 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67041f-1ce4-4b1e-90cd-bf0daa4fbdc2 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:35.822736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee54bb7-2438-44a0-9f4c-b10eda082850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:35.824292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee54bb7-2438-44a0-9f4c-b10eda082850 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:35.824728 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee54bb7-2438-44a0-9f4c-b10eda082850 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:35.825143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee54bb7-2438-44a0-9f4c-b10eda082850 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:35.836394 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee54bb7-2438-44a0-9f4c-b10eda082850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:35.845003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-9ee54bb7-2438-44a0-9f4c-b10eda082850 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:35.845003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:35.845003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:35.845003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:35.845003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:35.845003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:35.845003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:35.845003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:35.845003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:35.845003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:35.845003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:35.845003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:35.845003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:35.845003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:35.845003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:35.845003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:35.846086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:35.846086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:35.846086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:35.846086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:35.846086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:35.846086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:35.846086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:35.846086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:35.846086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:35.846086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:35.846086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:35.846086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:35.846086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:35.846086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:35.846086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:35.846086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:35.847083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:35.847083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:35.847083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:35.847083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:35.847083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:35.847083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:35.847083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:35.847083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:35.847083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:35.847083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:35.847083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:35.847083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:35.849183 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 91/181] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:47:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:35.850390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee54bb7-2438-44a0-9f4c-b10eda082850 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:35.867107 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78faea-8854-4413-a59c-ffb031957f5c None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:35.903071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22890651-37f9-4aba-b539-74dbda6a5df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:35.903868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22890651-37f9-4aba-b539-74dbda6a5df0 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:35.904166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22890651-37f9-4aba-b539-74dbda6a5df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:35.904414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22890651-37f9-4aba-b539-74dbda6a5df0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:35.914493 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22890651-37f9-4aba-b539-74dbda6a5df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:35.922984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-22890651-37f9-4aba-b539-74dbda6a5df0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:47:35.922984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:35.922984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:35.922984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:35.922984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:35.922984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:35.922984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:35.922984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:35.922984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:35.922984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:35.922984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:35.922984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:35.922984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:35.922984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:35.922984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:35.922984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:35.923869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:35.923869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:35.923869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:35.923869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:35.923869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:35.923869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:35.923869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:35.923869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:35.923869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:35.923869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:35.923869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:35.923869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:35.923869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:35.923869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:35.923869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:35.923869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:35.924663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:35.924663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:35.924663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:35.924663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:35.924663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:35.924663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:35.924663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:35.924663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:35.924663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:35.924663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:35.924663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:47:35.924663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:35.924663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 91/182] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:47:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:35.925309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22890651-37f9-4aba-b539-74dbda6a5df0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:35.954157 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:35.965228 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee54bb7-2438-44a0-9f4c-b10eda082850 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:35.976571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:36.001337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c230c59-7f95-4333-9ade-82730052d285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:36.002221 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c230c59-7f95-4333-9ade-82730052d285 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:36.002508 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c230c59-7f95-4333-9ade-82730052d285 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:36.002781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c230c59-7f95-4333-9ade-82730052d285 None admin] PATH_INFO: `/v3/projects/9fe63d8beeec45e7a7ad93fa39cc20f6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:36.003982 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c230c59-7f95-4333-9ade-82730052d285 None admin] RBAC: Authorizing `identity:get_project(project_id=9fe63d8beeec45e7a7ad93fa39cc20f6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:36.005570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c230c59-7f95-4333-9ade-82730052d285 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:36.012801 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 92/183] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:35 2022] GET /identity/v3/projects/9fe63d8beeec45e7a7ad93fa39cc20f6 => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:36.012801 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0ff64-ac2c-488f-8a67-4a018624d571 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:36.012801 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0ff64-ac2c-488f-8a67-4a018624d571 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:36.012801 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0ff64-ac2c-488f-8a67-4a018624d571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:36.027632 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-06c0ff64-ac2c-488f-8a67-4a018624d571 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:36.028798 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-06c0ff64-ac2c-488f-8a67-4a018624d571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:36.036928 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22890651-37f9-4aba-b539-74dbda6a5df0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:36.073825 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97a3be-4fa1-432d-805f-25797339e4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:36.074498 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97a3be-4fa1-432d-805f-25797339e4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:36.074779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97a3be-4fa1-432d-805f-25797339e4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:36.075054 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97a3be-4fa1-432d-805f-25797339e4d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:36.101070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 93/184] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:36.102132 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0ff64-ac2c-488f-8a67-4a018624d571 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:36.161623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97a3be-4fa1-432d-805f-25797339e4d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:36.163234 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97a3be-4fa1-432d-805f-25797339e4d1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:36.192133 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:36.205138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0ff64-ac2c-488f-8a67-4a018624d571 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:36.213351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:36.244116 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a5411-ab28-4bda-98fc-50ec049ce14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:36.244783 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a5411-ab28-4bda-98fc-50ec049ce14c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:36.245576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a5411-ab28-4bda-98fc-50ec049ce14c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:36.245855 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a5411-ab28-4bda-98fc-50ec049ce14c None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:36.246740 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a5411-ab28-4bda-98fc-50ec049ce14c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:36.247108 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a5411-ab28-4bda-98fc-50ec049ce14c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:36.248641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a5411-ab28-4bda-98fc-50ec049ce14c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:36.258408 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 94/185] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:36.263465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a5411-ab28-4bda-98fc-50ec049ce14c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:36.266367 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 92/186] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:47:36.267200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97a3be-4fa1-432d-805f-25797339e4d1 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:36.374157 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97a3be-4fa1-432d-805f-25797339e4d1 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:36.374942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a5411-ab28-4bda-98fc-50ec049ce14c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:36.409952 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03176b06-64a5-4cc9-93b7-b626ee1d2846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:36.410630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03176b06-64a5-4cc9-93b7-b626ee1d2846 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:36.410850 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e8c13-c340-4f3d-ac6e-5734e05379ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:36.410960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03176b06-64a5-4cc9-93b7-b626ee1d2846 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:36.411175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03176b06-64a5-4cc9-93b7-b626ee1d2846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:36.411462 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e8c13-c340-4f3d-ac6e-5734e05379ad None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:36.411744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e8c13-c340-4f3d-ac6e-5734e05379ad None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:36.411998 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03176b06-64a5-4cc9-93b7-b626ee1d2846 None admin] RBAC: Adding query filter params (role.id=01ccb434cf384bc79bf82f49b697f1ce, scope.project.id=9fe63d8beeec45e7a7ad93fa39cc20f6, user.id=9bcbcac888534699a368bba89ae10030) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:36.412093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e8c13-c340-4f3d-ac6e-5734e05379ad None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:36.412307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03176b06-64a5-4cc9-93b7-b626ee1d2846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:36.412746 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e8c13-c340-4f3d-ac6e-5734e05379ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:36.413054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e8c13-c340-4f3d-ac6e-5734e05379ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:36.413739 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03176b06-64a5-4cc9-93b7-b626ee1d2846 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:36.414449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e8c13-c340-4f3d-ac6e-5734e05379ad None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:36.420408 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 93/187] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:36 2022] GET /identity/v3/role_assignments?user.id=9bcbcac888534699a368bba89ae10030&scope.project.id=9fe63d8beeec45e7a7ad93fa39cc20f6&role.id=01ccb434cf384bc79bf82f49b697f1ce => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:36.421056 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03176b06-64a5-4cc9-93b7-b626ee1d2846 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:36.428654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 95/188] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:47:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:36.430235 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e8c13-c340-4f3d-ac6e-5734e05379ad None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:36.445157 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:36.453471 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:36.539833 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03176b06-64a5-4cc9-93b7-b626ee1d2846 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:36.552842 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e8c13-c340-4f3d-ac6e-5734e05379ad None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:36.579272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc84342-d871-45f9-8d43-8de73180c02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:36.580559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc84342-d871-45f9-8d43-8de73180c02c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:36.581048 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc84342-d871-45f9-8d43-8de73180c02c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:36.581521 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc84342-d871-45f9-8d43-8de73180c02c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:36.583299 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc84342-d871-45f9-8d43-8de73180c02c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:36.585091 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc84342-d871-45f9-8d43-8de73180c02c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:36.587307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 94/189] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:47:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:36.588398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc84342-d871-45f9-8d43-8de73180c02c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:36.592085 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af2246-de4d-4427-9cf5-19212be9f6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:36.593059 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af2246-de4d-4427-9cf5-19212be9f6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:36.593402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af2246-de4d-4427-9cf5-19212be9f6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:36.594579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af2246-de4d-4427-9cf5-19212be9f6e2 None admin] PATH_INFO: `/v3/users/68d1f37df47e451486f7a6045b1503f0` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:36.611771 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af2246-de4d-4427-9cf5-19212be9f6e2 None admin] RBAC: Authorizing `identity:get_user(user_id=68d1f37df47e451486f7a6045b1503f0)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:36.613501 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af2246-de4d-4427-9cf5-19212be9f6e2 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:36.615857 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 96/190] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:36 2022] GET /identity/v3/users/68d1f37df47e451486f7a6045b1503f0 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:36.616875 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af2246-de4d-4427-9cf5-19212be9f6e2 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:36.687598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:36.702497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:36.716065 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc84342-d871-45f9-8d43-8de73180c02c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:36.742955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af2246-de4d-4427-9cf5-19212be9f6e2 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:36.764952 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5cc31c-a9d0-40d5-817a-8ab01858e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:36.765816 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cc31c-a9d0-40d5-817a-8ab01858e88c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:36.766167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cc31c-a9d0-40d5-817a-8ab01858e88c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:36.766438 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cc31c-a9d0-40d5-817a-8ab01858e88c None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:36.767611 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5cc31c-a9d0-40d5-817a-8ab01858e88c None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:36.769050 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5cc31c-a9d0-40d5-817a-8ab01858e88c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:36.770808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 95/191] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:36 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:36.771548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5cc31c-a9d0-40d5-817a-8ab01858e88c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:36.787954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f7f4a-a0a3-448b-88a6-6dcb37266a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:36.788832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f7f4a-a0a3-448b-88a6-6dcb37266a35 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:36.789113 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f7f4a-a0a3-448b-88a6-6dcb37266a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:36.789384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f7f4a-a0a3-448b-88a6-6dcb37266a35 None admin] PATH_INFO: `/v3/users/68d1f37df47e451486f7a6045b1503f0` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:36.790633 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f7f4a-a0a3-448b-88a6-6dcb37266a35 None admin] RBAC: Authorizing `identity:get_user(user_id=68d1f37df47e451486f7a6045b1503f0)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:36.792048 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f7f4a-a0a3-448b-88a6-6dcb37266a35 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:36.793798 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 97/192] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:36 2022] GET /identity/v3/users/68d1f37df47e451486f7a6045b1503f0 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:36.794465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f7f4a-a0a3-448b-88a6-6dcb37266a35 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:36.880657 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5cc31c-a9d0-40d5-817a-8ab01858e88c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:36.900151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f7f4a-a0a3-448b-88a6-6dcb37266a35 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:36.915997 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a0114-da2e-4eb2-9231-f475154da19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:36.916657 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a0114-da2e-4eb2-9231-f475154da19e None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:36.916967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a0114-da2e-4eb2-9231-f475154da19e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:36.917241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a0114-da2e-4eb2-9231-f475154da19e None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:36.918084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a0114-da2e-4eb2-9231-f475154da19e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:36.919681 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a0114-da2e-4eb2-9231-f475154da19e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:36.936638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b9726-1302-4bc8-bdf0-31dc1686b8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:36.937423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b9726-1302-4bc8-bdf0-31dc1686b8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:36.937699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b9726-1302-4bc8-bdf0-31dc1686b8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:36.938012 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b9726-1302-4bc8-bdf0-31dc1686b8d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:36.943430 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 96/193] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:47:36 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:47:36.944052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a0114-da2e-4eb2-9231-f475154da19e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:36.955014 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:36.958221 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:37.037692 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b9726-1302-4bc8-bdf0-31dc1686b8d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:37.039320 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b9726-1302-4bc8-bdf0-31dc1686b8d2 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:37.095696 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a0114-da2e-4eb2-9231-f475154da19e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:37.142070 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0711818-b066-4fc0-a05b-2e0ae6177a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:37.142720 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0711818-b066-4fc0-a05b-2e0ae6177a82 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:37.143001 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0711818-b066-4fc0-a05b-2e0ae6177a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:37.143274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0711818-b066-4fc0-a05b-2e0ae6177a82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:37.144116 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0711818-b066-4fc0-a05b-2e0ae6177a82 None admin] RBAC: Adding query filter params (role.id=73d4eafa268f4cc3aca4863c73b794ae, scope.project.id=eb30985c7f9f457095a0e5e03ed6954c, user.id=9bcbcac888534699a368bba89ae10030) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:37.144426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0711818-b066-4fc0-a05b-2e0ae6177a82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:37.145873 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0711818-b066-4fc0-a05b-2e0ae6177a82 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:37.153616 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 97/194] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:36 2022] GET /identity/v3/role_assignments?user.id=9bcbcac888534699a368bba89ae10030&scope.project.id=eb30985c7f9f457095a0e5e03ed6954c&role.id=73d4eafa268f4cc3aca4863c73b794ae => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:37.154483 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0711818-b066-4fc0-a05b-2e0ae6177a82 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:37.174635 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 98/195] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:47:37.180554 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b9726-1302-4bc8-bdf0-31dc1686b8d2 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:37.230003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:37.251447 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:37.285056 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0711818-b066-4fc0-a05b-2e0ae6177a82 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:37.306394 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b9726-1302-4bc8-bdf0-31dc1686b8d2 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:37.327893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cb122-a991-46aa-a091-47e11272b2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:37.329109 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cb122-a991-46aa-a091-47e11272b2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:37.330342 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cb122-a991-46aa-a091-47e11272b2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:37.330625 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cb122-a991-46aa-a091-47e11272b2c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:37.352351 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b1693-f3ff-4cd2-8b72-b28753e287bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:37.355112 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b1693-f3ff-4cd2-8b72-b28753e287bb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:37.355644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b1693-f3ff-4cd2-8b72-b28753e287bb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:37.356392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b1693-f3ff-4cd2-8b72-b28753e287bb None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:37.358493 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b1693-f3ff-4cd2-8b72-b28753e287bb None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:37.360950 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b1693-f3ff-4cd2-8b72-b28753e287bb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:37.364641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 99/196] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:37 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:37.370307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b1693-f3ff-4cd2-8b72-b28753e287bb None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:37.428786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cb122-a991-46aa-a091-47e11272b2c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:37.431678 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cb122-a991-46aa-a091-47e11272b2c7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:37.516114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b1693-f3ff-4cd2-8b72-b28753e287bb None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:37.525022 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:37.537437 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:37.567450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa9c5a-0559-46c2-bfd3-74bc768d3c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:37.568250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa9c5a-0559-46c2-bfd3-74bc768d3c10 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:37.568553 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa9c5a-0559-46c2-bfd3-74bc768d3c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:37.568807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa9c5a-0559-46c2-bfd3-74bc768d3c10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:37.569640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa9c5a-0559-46c2-bfd3-74bc768d3c10 None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=0dd67400813c49aabd0b08d7febb138b, user.id=68d1f37df47e451486f7a6045b1503f0) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:37.571701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa9c5a-0559-46c2-bfd3-74bc768d3c10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:37.571701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa9c5a-0559-46c2-bfd3-74bc768d3c10 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:37.581380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 100/197] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:37 2022] GET /identity/v3/role_assignments?user.id=68d1f37df47e451486f7a6045b1503f0&scope.project.id=0dd67400813c49aabd0b08d7febb138b&role.id=8f58ef9d28494d97a68de20b84355450 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:37.586118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 98/198] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:47:37.593049 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa9c5a-0559-46c2-bfd3-74bc768d3c10 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:37.715108 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa9c5a-0559-46c2-bfd3-74bc768d3c10 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:37.753477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f02a68-15b8-4663-b3e4-173a69832254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:37.754781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f02a68-15b8-4663-b3e4-173a69832254 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:37.755291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f02a68-15b8-4663-b3e4-173a69832254 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:37.755770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f02a68-15b8-4663-b3e4-173a69832254 None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:37.757277 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f02a68-15b8-4663-b3e4-173a69832254 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:37.758982 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f02a68-15b8-4663-b3e4-173a69832254 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:37.761844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 101/199] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:37 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:37.768216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cb122-a991-46aa-a091-47e11272b2c7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:37.855824 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e431b-2be6-4395-bf6e-5a1925e94ac8 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:37.856423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e431b-2be6-4395-bf6e-5a1925e94ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:37.856878 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e431b-2be6-4395-bf6e-5a1925e94ac8 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:37.858463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 102/200] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:47:37.864448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc806261-8efb-4cc3-bbdb-65a41760396a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:37.864735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc806261-8efb-4cc3-bbdb-65a41760396a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:37.865015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc806261-8efb-4cc3-bbdb-65a41760396a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:37.882978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cb122-a991-46aa-a091-47e11272b2c7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:37.889477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-bc806261-8efb-4cc3-bbdb-65a41760396a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:37.894883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bc806261-8efb-4cc3-bbdb-65a41760396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:37.926949 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9c51c-10e1-446b-aa31-2a81f52bbc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:37.927995 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9c51c-10e1-446b-aa31-2a81f52bbc8f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:37.928479 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9c51c-10e1-446b-aa31-2a81f52bbc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:37.928954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9c51c-10e1-446b-aa31-2a81f52bbc8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:37.930010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9c51c-10e1-446b-aa31-2a81f52bbc8f None admin] RBAC: Adding query filter params (role.id=73d4eafa268f4cc3aca4863c73b794ae, scope.project.id=0dd67400813c49aabd0b08d7febb138b, user.id=68d1f37df47e451486f7a6045b1503f0) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:37.930557 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9c51c-10e1-446b-aa31-2a81f52bbc8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:37.933711 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9c51c-10e1-446b-aa31-2a81f52bbc8f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:37.944463 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 99/201] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:37 2022] GET /identity/v3/role_assignments?user.id=68d1f37df47e451486f7a6045b1503f0&scope.project.id=0dd67400813c49aabd0b08d7febb138b&role.id=73d4eafa268f4cc3aca4863c73b794ae => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:37.953973 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:38.006417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 103/202] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:47:38.043061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9c51c-10e1-446b-aa31-2a81f52bbc8f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:38.092888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:38.184274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9c51c-10e1-446b-aa31-2a81f52bbc8f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:38.230150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f22edc-2fc9-432e-920b-0e8d90decc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:38.230958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f22edc-2fc9-432e-920b-0e8d90decc10 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:38.231247 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f22edc-2fc9-432e-920b-0e8d90decc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:38.231528 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f22edc-2fc9-432e-920b-0e8d90decc10 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:38.246961 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f22edc-2fc9-432e-920b-0e8d90decc10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:38.254716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-b5f22edc-2fc9-432e-920b-0e8d90decc10 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:47:38.254716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:38.254716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:38.254716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:38.254716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:38.254716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:38.254716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:38.254716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:38.254716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:38.254716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:38.254716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:38.254716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:38.254716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:38.254716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:38.254716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:38.254716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:38.255596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:38.255596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:38.255596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:38.255596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:38.255596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:38.255596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:38.255596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:38.255596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:38.255596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:38.255596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:38.255596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:38.255596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:38.255596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:38.255596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:38.255596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:38.255596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:38.256390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:38.256390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:38.256390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:38.256390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:38.256390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:38.256390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:38.256390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:38.256390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:38.256390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:38.256390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:38.256390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:47:38.256390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:38.258536 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 100/203] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:38.265296 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc806261-8efb-4cc3-bbdb-65a41760396a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:38.436364 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc806261-8efb-4cc3-bbdb-65a41760396a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:38.475809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e39b8-e447-439a-a531-6d9faf98ad45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:38.476875 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e39b8-e447-439a-a531-6d9faf98ad45 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:38.477386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e39b8-e447-439a-a531-6d9faf98ad45 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:38.477864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e39b8-e447-439a-a531-6d9faf98ad45 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:38.478851 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e39b8-e447-439a-a531-6d9faf98ad45 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:38.479418 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e39b8-e447-439a-a531-6d9faf98ad45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:38.481003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e39b8-e447-439a-a531-6d9faf98ad45 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:38.489752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 104/204] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:38.496164 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f22edc-2fc9-432e-920b-0e8d90decc10 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:38.604045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:38.614746 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f22edc-2fc9-432e-920b-0e8d90decc10 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:38.666295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596eec0-ef17-440b-95c2-12cf8e814cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:38.667600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596eec0-ef17-440b-95c2-12cf8e814cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:38.668108 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596eec0-ef17-440b-95c2-12cf8e814cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:38.668590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596eec0-ef17-440b-95c2-12cf8e814cf3 None admin] PATH_INFO: `/v3/users/926fd1db8b6244018f5f077bed34fa3c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:38.670080 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596eec0-ef17-440b-95c2-12cf8e814cf3 None admin] RBAC: Authorizing `identity:get_user(user_id=926fd1db8b6244018f5f077bed34fa3c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:38.671740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596eec0-ef17-440b-95c2-12cf8e814cf3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:38.673707 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 101/205] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:38 2022] GET /identity/v3/users/926fd1db8b6244018f5f077bed34fa3c => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:38.679485 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e39b8-e447-439a-a531-6d9faf98ad45 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:38.727047 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:38.818350 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e39b8-e447-439a-a531-6d9faf98ad45 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:38.858304 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd2be4-d104-416c-826f-4126a1f1374f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:38.858937 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd2be4-d104-416c-826f-4126a1f1374f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:38.859228 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd2be4-d104-416c-826f-4126a1f1374f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:38.859506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd2be4-d104-416c-826f-4126a1f1374f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:38.928998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd2be4-d104-416c-826f-4126a1f1374f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:38.930517 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd2be4-d104-416c-826f-4126a1f1374f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:38.959718 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:39.048009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 105/206] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:47:39.053653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596eec0-ef17-440b-95c2-12cf8e814cf3 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:39.177251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596eec0-ef17-440b-95c2-12cf8e814cf3 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:39.219969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fb33b-4a88-4a0e-bc25-d0d6085b09d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:39.220836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fb33b-4a88-4a0e-bc25-d0d6085b09d4 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:39.221122 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fb33b-4a88-4a0e-bc25-d0d6085b09d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:39.221401 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fb33b-4a88-4a0e-bc25-d0d6085b09d4 None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:39.222621 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fb33b-4a88-4a0e-bc25-d0d6085b09d4 None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:39.224070 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fb33b-4a88-4a0e-bc25-d0d6085b09d4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:39.226052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 102/207] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:39 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:39.231923 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd2be4-d104-416c-826f-4126a1f1374f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:39.367126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd2be4-d104-416c-826f-4126a1f1374f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:39.408282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:39.418620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbb049-82d0-4c44-b053-4c317c28b168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:39.419300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbb049-82d0-4c44-b053-4c317c28b168 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:39.419586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbb049-82d0-4c44-b053-4c317c28b168 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:39.419863 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbb049-82d0-4c44-b053-4c317c28b168 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:39.420706 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbb049-82d0-4c44-b053-4c317c28b168 None admin] RBAC: Adding query filter params (role.id=822830288b154ed78764b4d57d45d813, scope.project.id=eb30985c7f9f457095a0e5e03ed6954c, user.id=926fd1db8b6244018f5f077bed34fa3c) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:39.421020 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbb049-82d0-4c44-b053-4c317c28b168 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:39.422523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbb049-82d0-4c44-b053-4c317c28b168 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:39.429029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 106/208] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:39 2022] GET /identity/v3/role_assignments?user.id=926fd1db8b6244018f5f077bed34fa3c&scope.project.id=eb30985c7f9f457095a0e5e03ed6954c&role.id=822830288b154ed78764b4d57d45d813 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:40.198991 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954f0ae-1754-469d-a894-8272ba2bc6c0 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:40.199516 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954f0ae-1754-469d-a894-8272ba2bc6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:40.199516 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954f0ae-1754-469d-a894-8272ba2bc6c0 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:40.201307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 103/209] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:40.207399 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdc0dc-019d-4319-89d6-13a5376eac56 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:40.207699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdc0dc-019d-4319-89d6-13a5376eac56 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:40.207955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdc0dc-019d-4319-89d6-13a5376eac56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:40.225649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-21fdc0dc-019d-4319-89d6-13a5376eac56 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:40.226872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-21fdc0dc-019d-4319-89d6-13a5376eac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:40.287914 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5eff3-01ea-4de9-9964-b7d632c74f3c None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:40.288525 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5eff3-01ea-4de9-9964-b7d632c74f3c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:40.288993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5eff3-01ea-4de9-9964-b7d632c74f3c None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:40.290680 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 104/210] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:40.296042 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef80310-a14e-478f-b869-8a51a2f2114d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:40.296472 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 107/211] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:40.296981 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef80310-a14e-478f-b869-8a51a2f2114d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:40.297448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef80310-a14e-478f-b869-8a51a2f2114d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:40.314381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-eef80310-a14e-478f-b869-8a51a2f2114d None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:40.315855 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-eef80310-a14e-478f-b869-8a51a2f2114d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:40.319543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdc0dc-019d-4319-89d6-13a5376eac56 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:40.341438 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:40.391807 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 105/212] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:47:40.414689 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef80310-a14e-478f-b869-8a51a2f2114d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:40.447639 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdc0dc-019d-4319-89d6-13a5376eac56 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:40.480604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:40.496697 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e496c7-0f72-4b49-bdb0-6f71da8a5e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:40.497538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e496c7-0f72-4b49-bdb0-6f71da8a5e68 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:40.498120 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e496c7-0f72-4b49-bdb0-6f71da8a5e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:40.499288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e496c7-0f72-4b49-bdb0-6f71da8a5e68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:40.511406 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e496c7-0f72-4b49-bdb0-6f71da8a5e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:40.519006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-d0e496c7-0f72-4b49-bdb0-6f71da8a5e68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:40.519006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:40.519006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:40.519006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:40.519006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:40.519006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:40.519006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:40.519006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:40.519006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:40.519006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:40.519006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:40.519006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:40.519006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:40.519006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:40.519006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:40.519006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:40.519887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:40.519887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:40.519887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:40.519887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:40.519887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:40.519887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:40.519887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:40.519887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:40.519887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:40.519887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:40.519887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:40.519887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:40.519887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:40.519887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:40.519887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:40.519887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:40.520691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:40.520691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:40.520691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:40.520691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:40.520691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:40.520691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:40.520691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:40.520691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:40.520691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:40.520691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:40.520691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:40.520691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:40.520691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 108/213] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:47:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:47:40.526860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e496c7-0f72-4b49-bdb0-6f71da8a5e68 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:40.531319 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef80310-a14e-478f-b869-8a51a2f2114d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:40.573782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3619c-4053-4b54-85b8-7004d3d1f35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:40.574608 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3619c-4053-4b54-85b8-7004d3d1f35a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:40.574889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3619c-4053-4b54-85b8-7004d3d1f35a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:40.575155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3619c-4053-4b54-85b8-7004d3d1f35a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:40.585133 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3619c-4053-4b54-85b8-7004d3d1f35a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:40.592736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-8ad3619c-4053-4b54-85b8-7004d3d1f35a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:40.592736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:40.592736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:40.592736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:40.592736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:40.592736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:40.592736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:40.592736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:40.592736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:40.592736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:40.592736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:40.592736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:40.592736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:40.592736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:40.592736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:40.592736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:40.593602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:40.593602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:40.593602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:40.593602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:40.593602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:40.593602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:40.593602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:40.593602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:40.593602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:40.593602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:40.593602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:40.593602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:40.593602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:40.593602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:40.593602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:40.593602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:40.594742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:40.594742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:40.594742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:40.594742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:40.594742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:40.594742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:40.594742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:40.594742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:40.594742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:40.594742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:40.594742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:40.594742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:40.594742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 106/214] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:47:40.599723 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6e30a-ba93-4598-93ad-360bb906b653 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:40.600015 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6e30a-ba93-4598-93ad-360bb906b653 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:40.600292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6e30a-ba93-4598-93ad-360bb906b653 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:40.601608 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 107/215] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:40.602779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303b56-4988-4760-a802-2f025d2050a1 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:40.603123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303b56-4988-4760-a802-2f025d2050a1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:40.603402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303b56-4988-4760-a802-2f025d2050a1 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:40.605272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 108/216] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:40.606706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303b56-4988-4760-a802-2f025d2050a1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:40.629228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:40.631614 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e496c7-0f72-4b49-bdb0-6f71da8a5e68 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:40.665786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea15dfb-dcd2-45d5-9cd3-28d6d5695920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:40.666483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea15dfb-dcd2-45d5-9cd3-28d6d5695920 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:40.667428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea15dfb-dcd2-45d5-9cd3-28d6d5695920 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:40.667722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea15dfb-dcd2-45d5-9cd3-28d6d5695920 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:40.668495 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea15dfb-dcd2-45d5-9cd3-28d6d5695920 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:40.668784 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea15dfb-dcd2-45d5-9cd3-28d6d5695920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:40.670201 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea15dfb-dcd2-45d5-9cd3-28d6d5695920 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:40.678217 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 109/217] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:40.678217 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b7a5d-2591-477d-90ce-baaa9bf7001b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:40.678217 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b7a5d-2591-477d-90ce-baaa9bf7001b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:40.678217 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b7a5d-2591-477d-90ce-baaa9bf7001b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:40.697638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-665b7a5d-2591-477d-90ce-baaa9bf7001b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:40.698887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-665b7a5d-2591-477d-90ce-baaa9bf7001b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:40.714467 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303b56-4988-4760-a802-2f025d2050a1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:40.740581 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:40.748095 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20bd16-a07d-4d4b-a03f-b625d5be5fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:40.748749 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20bd16-a07d-4d4b-a03f-b625d5be5fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:40.749030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20bd16-a07d-4d4b-a03f-b625d5be5fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:40.749300 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20bd16-a07d-4d4b-a03f-b625d5be5fd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:40.750091 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20bd16-a07d-4d4b-a03f-b625d5be5fd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:40.750374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20bd16-a07d-4d4b-a03f-b625d5be5fd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:40.751736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20bd16-a07d-4d4b-a03f-b625d5be5fd6 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:40.759494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 109/218] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:40.760662 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa639b7-a2ce-4c81-8332-ac8c818c2dc2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:40.760944 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa639b7-a2ce-4c81-8332-ac8c818c2dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:40.761216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa639b7-a2ce-4c81-8332-ac8c818c2dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:40.769077 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 110/219] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:40.769972 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b7a5d-2591-477d-90ce-baaa9bf7001b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:40.778255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-bfa639b7-a2ce-4c81-8332-ac8c818c2dc2 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:40.779434 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-bfa639b7-a2ce-4c81-8332-ac8c818c2dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:40.846769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 110/220] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:40.847616 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa639b7-a2ce-4c81-8332-ac8c818c2dc2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:40.862101 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:40.876617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b7a5d-2591-477d-90ce-baaa9bf7001b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:40.911029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1466277-d6d5-4e36-be99-703aa0c7fd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:40.911899 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1466277-d6d5-4e36-be99-703aa0c7fd5a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:40.912182 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1466277-d6d5-4e36-be99-703aa0c7fd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:40.912455 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1466277-d6d5-4e36-be99-703aa0c7fd5a None admin] PATH_INFO: `/v3/users/68d1f37df47e451486f7a6045b1503f0` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:40.913657 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1466277-d6d5-4e36-be99-703aa0c7fd5a None admin] RBAC: Authorizing `identity:get_user(user_id=68d1f37df47e451486f7a6045b1503f0)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:40.915159 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1466277-d6d5-4e36-be99-703aa0c7fd5a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:40.917484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 111/221] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:40 2022] GET /identity/v3/users/68d1f37df47e451486f7a6045b1503f0 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:40.918128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1466277-d6d5-4e36-be99-703aa0c7fd5a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:40.950883 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa639b7-a2ce-4c81-8332-ac8c818c2dc2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:40.966488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:40.985984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7990f-6c6a-43f9-a5a7-2161cbe02e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:40.986858 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7990f-6c6a-43f9-a5a7-2161cbe02e55 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:40.987146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7990f-6c6a-43f9-a5a7-2161cbe02e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:40.987422 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7990f-6c6a-43f9-a5a7-2161cbe02e55 None admin] PATH_INFO: `/v3/users/2f9918197abc4798bed5eb7db6c44fa4` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:41.000836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7990f-6c6a-43f9-a5a7-2161cbe02e55 None admin] RBAC: Authorizing `identity:get_user(user_id=2f9918197abc4798bed5eb7db6c44fa4)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:41.002293 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7990f-6c6a-43f9-a5a7-2161cbe02e55 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:41.004008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 111/222] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:40 2022] GET /identity/v3/users/2f9918197abc4798bed5eb7db6c44fa4 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:41.006776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7990f-6c6a-43f9-a5a7-2161cbe02e55 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:41.021171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1466277-d6d5-4e36-be99-703aa0c7fd5a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:41.055625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b1368-4411-4db6-b8a3-52dc05434a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:41.056428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b1368-4411-4db6-b8a3-52dc05434a6a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:41.056705 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b1368-4411-4db6-b8a3-52dc05434a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:41.056979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b1368-4411-4db6-b8a3-52dc05434a6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:41.058187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b1368-4411-4db6-b8a3-52dc05434a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:41.059664 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b1368-4411-4db6-b8a3-52dc05434a6a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:41.061271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 112/223] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:47:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:41.062814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b1368-4411-4db6-b8a3-52dc05434a6a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:41.076934 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:41.109015 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7990f-6c6a-43f9-a5a7-2161cbe02e55 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:41.143773 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fab935-b330-46a3-a262-9495c4d6a262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:41.144719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fab935-b330-46a3-a262-9495c4d6a262 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:41.145091 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fab935-b330-46a3-a262-9495c4d6a262 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:41.145349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fab935-b330-46a3-a262-9495c4d6a262 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:41.156514 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fab935-b330-46a3-a262-9495c4d6a262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:41.162658 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b1368-4411-4db6-b8a3-52dc05434a6a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:41.164458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-93fab935-b330-46a3-a262-9495c4d6a262 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:47:41.164458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:41.164458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:41.164458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:41.164458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:41.164458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:41.164458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:41.164458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:41.164458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:41.164458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:41.164458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:41.164458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:41.164458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:41.164458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:41.164458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:41.164458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:41.165494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:41.165494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:41.165494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:41.165494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:41.165494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:41.165494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:41.165494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:41.165494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:41.165494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:41.165494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:41.165494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:41.165494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:41.165494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:41.165494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:41.165494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:41.165494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:41.171113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:41.171113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:41.171113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:41.171113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:41.171113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:41.171113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:41.171113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:41.171113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:41.171113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:41.171113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:41.171113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:47:41.171113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:41.171113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 112/224] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:47:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:41.171113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fab935-b330-46a3-a262-9495c4d6a262 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:41.176861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:41.197645 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d224a-38eb-4e60-acc1-5c471732494c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:41.199191 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d224a-38eb-4e60-acc1-5c471732494c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:41.199474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d224a-38eb-4e60-acc1-5c471732494c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:41.199744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d224a-38eb-4e60-acc1-5c471732494c None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:41.200918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d224a-38eb-4e60-acc1-5c471732494c None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:41.202434 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d224a-38eb-4e60-acc1-5c471732494c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:41.204140 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 113/225] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:41 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:41.204883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d224a-38eb-4e60-acc1-5c471732494c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:41.267608 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fab935-b330-46a3-a262-9495c4d6a262 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:41.295736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:41.301653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0abfd-9b52-4c8e-b86b-77b5a13b6e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:41.302573 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0abfd-9b52-4c8e-b86b-77b5a13b6e4c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:41.303039 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0abfd-9b52-4c8e-b86b-77b5a13b6e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:41.303508 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0abfd-9b52-4c8e-b86b-77b5a13b6e4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:41.305503 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d224a-38eb-4e60-acc1-5c471732494c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:41.339389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ff5a4-dc7b-46cc-9f74-753f01a9fbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:41.340063 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ff5a4-dc7b-46cc-9f74-753f01a9fbce None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:41.340344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ff5a4-dc7b-46cc-9f74-753f01a9fbce None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:41.340619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ff5a4-dc7b-46cc-9f74-753f01a9fbce None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:41.341329 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ff5a4-dc7b-46cc-9f74-753f01a9fbce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:41.342812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ff5a4-dc7b-46cc-9f74-753f01a9fbce None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:41.372548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 114/226] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:47:41 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:47:41.373439 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ff5a4-dc7b-46cc-9f74-753f01a9fbce None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:41.374251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0abfd-9b52-4c8e-b86b-77b5a13b6e4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:41.375758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0abfd-9b52-4c8e-b86b-77b5a13b6e4c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:41.412112 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:41.489112 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ff5a4-dc7b-46cc-9f74-753f01a9fbce None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:41.495156 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 113/227] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:47:41.496088 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0abfd-9b52-4c8e-b86b-77b5a13b6e4c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:41.531368 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:41.537411 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6162d70-f872-409f-9c91-1ab8ee333f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:41.537411 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6162d70-f872-409f-9c91-1ab8ee333f07 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:41.537666 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6162d70-f872-409f-9c91-1ab8ee333f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:41.537945 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6162d70-f872-409f-9c91-1ab8ee333f07 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:41.538749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6162d70-f872-409f-9c91-1ab8ee333f07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:41.539028 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6162d70-f872-409f-9c91-1ab8ee333f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:41.540474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6162d70-f872-409f-9c91-1ab8ee333f07 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:41.550678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 115/228] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:47:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:41.554993 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6162d70-f872-409f-9c91-1ab8ee333f07 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:41.616602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0abfd-9b52-4c8e-b86b-77b5a13b6e4c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:41.659485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba93bfe-173f-4ef2-9483-2e4bde8e36bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:41.660384 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba93bfe-173f-4ef2-9483-2e4bde8e36bc None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:41.660668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba93bfe-173f-4ef2-9483-2e4bde8e36bc None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:41.660946 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba93bfe-173f-4ef2-9483-2e4bde8e36bc None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b/users/68d1f37df47e451486f7a6045b1503f0/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:41.663640 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba93bfe-173f-4ef2-9483-2e4bde8e36bc None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd67400813c49aabd0b08d7febb138b, user_id=68d1f37df47e451486f7a6045b1503f0, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:41.665359 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba93bfe-173f-4ef2-9483-2e4bde8e36bc None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:41.677416 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:41.680398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 114/229] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:47:41 2022] PUT /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b/users/68d1f37df47e451486f7a6045b1503f0/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:47:41.681033 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba93bfe-173f-4ef2-9483-2e4bde8e36bc None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:41.685911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6162d70-f872-409f-9c91-1ab8ee333f07 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:41.753042 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193136a-a8bf-4290-a2fc-6877c06997ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:41.753977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193136a-a8bf-4290-a2fc-6877c06997ed None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:41.754258 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193136a-a8bf-4290-a2fc-6877c06997ed None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:41.754540 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193136a-a8bf-4290-a2fc-6877c06997ed None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:41.756324 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193136a-a8bf-4290-a2fc-6877c06997ed None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:41.758336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193136a-a8bf-4290-a2fc-6877c06997ed None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:41.762080 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 116/230] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:41 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:41.771608 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193136a-a8bf-4290-a2fc-6877c06997ed None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:41.822444 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba93bfe-173f-4ef2-9483-2e4bde8e36bc None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:41.826308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:41.860935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ef8f7-131b-4d64-802f-ff13dcee969e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:41.861954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ef8f7-131b-4d64-802f-ff13dcee969e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:41.862335 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ef8f7-131b-4d64-802f-ff13dcee969e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:41.862687 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ef8f7-131b-4d64-802f-ff13dcee969e None admin] PATH_INFO: `/v3/users/68d1f37df47e451486f7a6045b1503f0` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:41.864120 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ef8f7-131b-4d64-802f-ff13dcee969e None admin] RBAC: Authorizing `identity:get_user(user_id=68d1f37df47e451486f7a6045b1503f0)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:41.865698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ef8f7-131b-4d64-802f-ff13dcee969e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:41.867608 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 115/231] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:41 2022] GET /identity/v3/users/68d1f37df47e451486f7a6045b1503f0 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:41.873374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ef8f7-131b-4d64-802f-ff13dcee969e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:41.954672 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193136a-a8bf-4290-a2fc-6877c06997ed None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:41.990779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ef8f7-131b-4d64-802f-ff13dcee969e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:42.004432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4842ae-7c83-4dde-8b2f-d84d6da07253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:42.005322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4842ae-7c83-4dde-8b2f-d84d6da07253 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:42.006027 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4842ae-7c83-4dde-8b2f-d84d6da07253 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:42.006450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4842ae-7c83-4dde-8b2f-d84d6da07253 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:42.008157 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4842ae-7c83-4dde-8b2f-d84d6da07253 None admin] RBAC: Adding query filter params (role.id=01ccb434cf384bc79bf82f49b697f1ce, scope.project.id=0dd67400813c49aabd0b08d7febb138b, user.id=2f9918197abc4798bed5eb7db6c44fa4) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:42.008642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4842ae-7c83-4dde-8b2f-d84d6da07253 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:42.010948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4842ae-7c83-4dde-8b2f-d84d6da07253 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:42.018859 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 117/232] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:41 2022] GET /identity/v3/role_assignments?user.id=2f9918197abc4798bed5eb7db6c44fa4&scope.project.id=0dd67400813c49aabd0b08d7febb138b&role.id=01ccb434cf384bc79bf82f49b697f1ce => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:42.058545 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce99cba-cf11-41dd-a918-9b56a1ae32f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:42.059645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce99cba-cf11-41dd-a918-9b56a1ae32f7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:42.060027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce99cba-cf11-41dd-a918-9b56a1ae32f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:42.060420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce99cba-cf11-41dd-a918-9b56a1ae32f7 None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:42.061911 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce99cba-cf11-41dd-a918-9b56a1ae32f7 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:42.063574 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce99cba-cf11-41dd-a918-9b56a1ae32f7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:42.065694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 116/233] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:41 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:42.071368 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4842ae-7c83-4dde-8b2f-d84d6da07253 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:42.133998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:42.221365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4842ae-7c83-4dde-8b2f-d84d6da07253 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:42.264263 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c1c15-c1f5-4505-8d7b-b931e8b636ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:42.265407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c1c15-c1f5-4505-8d7b-b931e8b636ec None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:42.265857 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c1c15-c1f5-4505-8d7b-b931e8b636ec None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:42.266290 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c1c15-c1f5-4505-8d7b-b931e8b636ec None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b/users/68d1f37df47e451486f7a6045b1503f0/roles/73d4eafa268f4cc3aca4863c73b794ae` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:42.269211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c1c15-c1f5-4505-8d7b-b931e8b636ec None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd67400813c49aabd0b08d7febb138b, user_id=68d1f37df47e451486f7a6045b1503f0, role_id=73d4eafa268f4cc3aca4863c73b794ae)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:42.270895 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c1c15-c1f5-4505-8d7b-b931e8b636ec None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:42.292902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 118/234] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:47:42 2022] PUT /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b/users/68d1f37df47e451486f7a6045b1503f0/roles/73d4eafa268f4cc3aca4863c73b794ae => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:47:44.275966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fd0e5-b799-443c-a49c-565b9ec0f87a None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:44.276560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fd0e5-b799-443c-a49c-565b9ec0f87a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:44.276560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fd0e5-b799-443c-a49c-565b9ec0f87a None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:44.277981 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 117/235] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:44.283466 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d604f60-9bfb-4f73-be64-d5933c7c82e9 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:44.283908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d604f60-9bfb-4f73-be64-d5933c7c82e9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:44.284085 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d604f60-9bfb-4f73-be64-d5933c7c82e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:44.306039 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0d604f60-9bfb-4f73-be64-d5933c7c82e9 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:44.307239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0d604f60-9bfb-4f73-be64-d5933c7c82e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:44.343824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852c1ac-22b0-4cbe-a4f4-711b752efa78 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:44.344122 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852c1ac-22b0-4cbe-a4f4-711b752efa78 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:44.344383 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852c1ac-22b0-4cbe-a4f4-711b752efa78 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:44.345768 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 118/236] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:44.363979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f940235-d3df-40a7-8c8d-eb0dadf07f7c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:44.364783 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f940235-d3df-40a7-8c8d-eb0dadf07f7c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:44.364783 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f940235-d3df-40a7-8c8d-eb0dadf07f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:44.399728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-7f940235-d3df-40a7-8c8d-eb0dadf07f7c None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:44.400929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7f940235-d3df-40a7-8c8d-eb0dadf07f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:44.406436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 119/237] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:44.430302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d604f60-9bfb-4f73-be64-d5933c7c82e9 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:44.441941 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:44.454054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:44.498055 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 119/238] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:47:44.499617 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf50c2-bfaf-4d9c-aead-d532983a80bb None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:44.499975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf50c2-bfaf-4d9c-aead-d532983a80bb None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:44.500253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf50c2-bfaf-4d9c-aead-d532983a80bb None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:44.502916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 120/239] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:44.506966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0febbb-c9c9-4d8f-8718-ec5e801a810b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:44.507257 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0febbb-c9c9-4d8f-8718-ec5e801a810b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:44.507542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0febbb-c9c9-4d8f-8718-ec5e801a810b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:44.539231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4f0febbb-c9c9-4d8f-8718-ec5e801a810b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:44.540547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4f0febbb-c9c9-4d8f-8718-ec5e801a810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:44.547854 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d604f60-9bfb-4f73-be64-d5933c7c82e9 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:44.591222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6e27a-96d2-467a-a2bf-23268af04a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:44.592138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6e27a-96d2-467a-a2bf-23268af04a13 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:44.592426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6e27a-96d2-467a-a2bf-23268af04a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:44.592703 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6e27a-96d2-467a-a2bf-23268af04a13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:44.605199 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6e27a-96d2-467a-a2bf-23268af04a13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:44.613834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-a8b6e27a-96d2-467a-a2bf-23268af04a13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:47:44.613834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:44.613834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:44.613834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:44.613834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:44.613834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:44.613834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:44.613834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:44.613834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:44.613834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:44.613834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:44.613834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:44.613834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:44.613834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:44.613834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:44.613834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:44.614830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:44.614830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:44.614830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:44.614830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:44.614830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:44.614830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:44.614830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:44.614830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:44.614830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:44.614830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:44.614830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:44.614830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:44.614830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:44.614830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:44.614830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:44.614830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:44.615653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:44.615653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:44.615653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:44.615653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:44.615653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:44.615653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:44.615653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:44.615653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:44.615653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:44.615653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:44.615653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:47:44.615653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:44.620446 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 120/240] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:47:44.621691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6e27a-96d2-467a-a2bf-23268af04a13 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:44.623173 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 121/241] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:47:44.623892 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0febbb-c9c9-4d8f-8718-ec5e801a810b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:44.713651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:44.739818 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6e27a-96d2-467a-a2bf-23268af04a13 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:44.746576 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:44.765748 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0febbb-c9c9-4d8f-8718-ec5e801a810b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:44.790730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d4816-8953-4909-b21c-dd0feabd0702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:44.791921 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d4816-8953-4909-b21c-dd0feabd0702 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:44.792226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d4816-8953-4909-b21c-dd0feabd0702 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:44.792503 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d4816-8953-4909-b21c-dd0feabd0702 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:44.802958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513a7ea-b82c-4050-9706-72d93d87e9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:44.803767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513a7ea-b82c-4050-9706-72d93d87e9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:44.804152 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513a7ea-b82c-4050-9706-72d93d87e9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:44.804530 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513a7ea-b82c-4050-9706-72d93d87e9e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:44.805386 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513a7ea-b82c-4050-9706-72d93d87e9e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:44.805795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513a7ea-b82c-4050-9706-72d93d87e9e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:44.805987 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d4816-8953-4909-b21c-dd0feabd0702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:44.807934 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513a7ea-b82c-4050-9706-72d93d87e9e1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:44.815702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-b63d4816-8953-4909-b21c-dd0feabd0702 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:44.815702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:44.815702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:44.815702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:44.815702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:44.815702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:44.815702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:44.815702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:44.815702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:44.815702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:44.815702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:44.815702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:44.815702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:44.815702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:44.815702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:44.815702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:44.817547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:44.817547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:44.817547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:44.817547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:44.817547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:44.817547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:44.817547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:44.817547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:44.817547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:44.817547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:44.817547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:44.817547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:44.817547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:44.817547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:44.817547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:44.817547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:44.819502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:44.819502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:44.819502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:44.819502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:44.819502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:44.819502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:44.819502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:44.819502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:44.819502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:44.819502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:44.819502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:47:44.819502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:44.819502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 121/242] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:47:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:44.819502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d4816-8953-4909-b21c-dd0feabd0702 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:44.825966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 122/243] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:44.827484 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513a7ea-b82c-4050-9706-72d93d87e9e1 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:44.934000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513a7ea-b82c-4050-9706-72d93d87e9e1 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:44.960619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d4816-8953-4909-b21c-dd0feabd0702 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:44.970459 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d062c-0a95-428b-b0f8-ce75ae40f890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:44.971517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d062c-0a95-428b-b0f8-ce75ae40f890 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:44.972027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d062c-0a95-428b-b0f8-ce75ae40f890 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:44.972498 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d062c-0a95-428b-b0f8-ce75ae40f890 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:44.973472 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d062c-0a95-428b-b0f8-ce75ae40f890 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:44.974010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d062c-0a95-428b-b0f8-ce75ae40f890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:44.975864 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d062c-0a95-428b-b0f8-ce75ae40f890 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:44.989594 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 123/244] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:44.990888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d062c-0a95-428b-b0f8-ce75ae40f890 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:44.999731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3245049-f63f-42e8-a8c9-96f314fe0ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:45.000524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3245049-f63f-42e8-a8c9-96f314fe0ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:45.000807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3245049-f63f-42e8-a8c9-96f314fe0ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:45.001082 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3245049-f63f-42e8-a8c9-96f314fe0ed5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:45.002291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3245049-f63f-42e8-a8c9-96f314fe0ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:45.003758 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3245049-f63f-42e8-a8c9-96f314fe0ed5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:45.005367 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 122/245] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:47:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:45.006543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d20ee-34e0-4652-94f4-12f5e6e2221b None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:45.006829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d20ee-34e0-4652-94f4-12f5e6e2221b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:45.007102 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d20ee-34e0-4652-94f4-12f5e6e2221b None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:45.008478 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 123/246] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:45.009001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d20ee-34e0-4652-94f4-12f5e6e2221b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:45.011135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:45.021118 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:45.111197 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d062c-0a95-428b-b0f8-ce75ae40f890 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:45.119813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d20ee-34e0-4652-94f4-12f5e6e2221b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:45.144081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec58c22-694d-4527-9a24-9c0b04a1633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:45.144950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58c22-694d-4527-9a24-9c0b04a1633a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:45.145231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58c22-694d-4527-9a24-9c0b04a1633a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:45.145509 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58c22-694d-4527-9a24-9c0b04a1633a None admin] PATH_INFO: `/v3/users/9e8ca6de226f4026b140147be570a9ae` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:45.153626 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c7e98-ce9a-4d7f-9366-4580e49c4b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:45.154519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c7e98-ce9a-4d7f-9366-4580e49c4b7a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:45.154804 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c7e98-ce9a-4d7f-9366-4580e49c4b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:45.155081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c7e98-ce9a-4d7f-9366-4580e49c4b7a None admin] PATH_INFO: `/v3/users/68d1f37df47e451486f7a6045b1503f0` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:45.156259 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c7e98-ce9a-4d7f-9366-4580e49c4b7a None admin] RBAC: Authorizing `identity:get_user(user_id=68d1f37df47e451486f7a6045b1503f0)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:45.157708 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c7e98-ce9a-4d7f-9366-4580e49c4b7a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:45.158866 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec58c22-694d-4527-9a24-9c0b04a1633a None admin] RBAC: Authorizing `identity:get_user(user_id=9e8ca6de226f4026b140147be570a9ae)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:45.159384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 124/247] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:45 2022] GET /identity/v3/users/68d1f37df47e451486f7a6045b1503f0 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:45.159384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c7e98-ce9a-4d7f-9366-4580e49c4b7a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:45.164003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec58c22-694d-4527-9a24-9c0b04a1633a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:45.164003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 124/248] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:44 2022] GET /identity/v3/users/9e8ca6de226f4026b140147be570a9ae => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:45.164003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710e517-ce75-41eb-a7c5-3736e8292938 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:45.164003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710e517-ce75-41eb-a7c5-3736e8292938 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:45.164283 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710e517-ce75-41eb-a7c5-3736e8292938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:45.180373 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-7710e517-ce75-41eb-a7c5-3736e8292938 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:45.181564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7710e517-ce75-41eb-a7c5-3736e8292938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:45.237206 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:45.242850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:45.248832 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 125/249] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:45.250278 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd7c4d-9b65-4f51-ac2b-b20f22086618 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:45.250572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd7c4d-9b65-4f51-ac2b-b20f22086618 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:45.250850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd7c4d-9b65-4f51-ac2b-b20f22086618 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:45.252125 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 126/250] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:45.252820 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd7c4d-9b65-4f51-ac2b-b20f22086618 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:45.270822 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c7e98-ce9a-4d7f-9366-4580e49c4b7a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:45.304409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643e50b-db07-44b6-82e7-d8d5d1b8df6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:45.305074 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643e50b-db07-44b6-82e7-d8d5d1b8df6d None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:45.305357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643e50b-db07-44b6-82e7-d8d5d1b8df6d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:45.305629 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643e50b-db07-44b6-82e7-d8d5d1b8df6d None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:45.306365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643e50b-db07-44b6-82e7-d8d5d1b8df6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:45.307881 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643e50b-db07-44b6-82e7-d8d5d1b8df6d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:45.328859 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 125/251] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:47:45 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:47:45.338154 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643e50b-db07-44b6-82e7-d8d5d1b8df6d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:45.367615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd7c4d-9b65-4f51-ac2b-b20f22086618 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:45.410088 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a79d9-0346-47ba-b77b-9dd6cdb8f692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:45.410772 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a79d9-0346-47ba-b77b-9dd6cdb8f692 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:45.411053 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a79d9-0346-47ba-b77b-9dd6cdb8f692 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:45.411328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a79d9-0346-47ba-b77b-9dd6cdb8f692 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:45.458179 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643e50b-db07-44b6-82e7-d8d5d1b8df6d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:45.486610 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:45.491619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:45.491798 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a79d9-0346-47ba-b77b-9dd6cdb8f692 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:45.493053 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a79d9-0346-47ba-b77b-9dd6cdb8f692 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:45.500015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df86f1c-8cdf-4d32-b0eb-a6d74bdc2c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:45.501154 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df86f1c-8cdf-4d32-b0eb-a6d74bdc2c23 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:45.501823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df86f1c-8cdf-4d32-b0eb-a6d74bdc2c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:45.502490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df86f1c-8cdf-4d32-b0eb-a6d74bdc2c23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:45.585474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df86f1c-8cdf-4d32-b0eb-a6d74bdc2c23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:45.589964 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df86f1c-8cdf-4d32-b0eb-a6d74bdc2c23 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:45.617444 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 127/252] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:47:45.619192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6a334-45b3-4b1f-b648-f2cace189b15 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:45.619483 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6a334-45b3-4b1f-b648-f2cace189b15 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:45.620509 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6a334-45b3-4b1f-b648-f2cace189b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:45.641016 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-cad6a334-45b3-4b1f-b648-f2cace189b15 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:45.642267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-cad6a334-45b3-4b1f-b648-f2cace189b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:45.716829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 126/253] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:47:45.718975 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df86f1c-8cdf-4d32-b0eb-a6d74bdc2c23 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:45.729725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 128/254] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:45.734791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6a334-45b3-4b1f-b648-f2cace189b15 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:45.761845 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:45.776596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:45.846500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df86f1c-8cdf-4d32-b0eb-a6d74bdc2c23 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:45.866318 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6a334-45b3-4b1f-b648-f2cace189b15 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:45.882857 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c7664-5c2f-4517-8c41-d66adec25f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:45.883606 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c7664-5c2f-4517-8c41-d66adec25f90 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:45.883952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c7664-5c2f-4517-8c41-d66adec25f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:45.884293 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c7664-5c2f-4517-8c41-d66adec25f90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:45.895753 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c7664-5c2f-4517-8c41-d66adec25f90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:45.903751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-fd0c7664-5c2f-4517-8c41-d66adec25f90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:45.903751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:45.903751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:45.903751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:45.903751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:45.903751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:45.903751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:45.903751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:45.903751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:45.903751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:45.903751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:45.903751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:45.903751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:45.903751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:45.903751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:45.903751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:45.904651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:45.904651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:45.904651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:45.904651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:45.904651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:45.904651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:45.904651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:45.904651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:45.904651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:45.904651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:45.904651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:45.904651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:45.904651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:45.904651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:45.904651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:45.904651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:45.905432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:45.905432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:45.905432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:45.905432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:45.905432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:45.905432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:45.905432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:45.905432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:45.905432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:45.905432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:45.905432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:45.905432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:45.905432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 127/255] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:45.906138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c7664-5c2f-4517-8c41-d66adec25f90 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:45.921622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b524f8-5f2c-4369-a7ee-2fcf65562e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:45.923284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b524f8-5f2c-4369-a7ee-2fcf65562e7b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:45.923722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b524f8-5f2c-4369-a7ee-2fcf65562e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:45.924443 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b524f8-5f2c-4369-a7ee-2fcf65562e7b None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:45.926070 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b524f8-5f2c-4369-a7ee-2fcf65562e7b None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:45.928005 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b524f8-5f2c-4369-a7ee-2fcf65562e7b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:45.930648 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 129/256] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:45 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:45.931934 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b524f8-5f2c-4369-a7ee-2fcf65562e7b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:46.013361 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:46.024400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c7664-5c2f-4517-8c41-d66adec25f90 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:46.052199 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:46.058265 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b524f8-5f2c-4369-a7ee-2fcf65562e7b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:46.062980 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebffe1-8e5b-4340-bc07-16a25e0437ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:46.063863 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebffe1-8e5b-4340-bc07-16a25e0437ea None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:46.064146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebffe1-8e5b-4340-bc07-16a25e0437ea None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:46.064422 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebffe1-8e5b-4340-bc07-16a25e0437ea None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:46.065615 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebffe1-8e5b-4340-bc07-16a25e0437ea None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:46.067124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebffe1-8e5b-4340-bc07-16a25e0437ea None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:46.074398 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 128/257] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:45 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:46.075393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebffe1-8e5b-4340-bc07-16a25e0437ea None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:46.096857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a1365-a152-4f14-8e9b-7011534bda89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:46.097910 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1365-a152-4f14-8e9b-7011534bda89 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:46.098351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1365-a152-4f14-8e9b-7011534bda89 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:46.098770 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1365-a152-4f14-8e9b-7011534bda89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:46.110188 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a1365-a152-4f14-8e9b-7011534bda89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:46.118468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-157a1365-a152-4f14-8e9b-7011534bda89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:47:46.118468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:46.118468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:46.118468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:46.118468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:46.118468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:46.118468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:46.118468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:46.118468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:46.118468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:46.118468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:46.118468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:46.118468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:46.118468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:46.118468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:46.118468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:46.119539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:46.119539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:46.119539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:46.119539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:46.119539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:46.119539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:46.119539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:46.119539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:46.119539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:46.119539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:46.119539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:46.119539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:46.119539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:46.119539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:46.119539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:46.119539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:46.120975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:46.120975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:46.120975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:46.120975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:46.120975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:46.120975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:46.120975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:46.120975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:46.120975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:46.120975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:46.120975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:47:46.120975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:46.122900 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 130/258] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:47:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:46.123813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a1365-a152-4f14-8e9b-7011534bda89 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:46.189882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebffe1-8e5b-4340-bc07-16a25e0437ea None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:46.225904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a1365-a152-4f14-8e9b-7011534bda89 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:46.228231 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccecbf4-943f-4c07-830a-54749bafa2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:46.229959 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccecbf4-943f-4c07-830a-54749bafa2dc None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:46.229959 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccecbf4-943f-4c07-830a-54749bafa2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:46.230166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccecbf4-943f-4c07-830a-54749bafa2dc None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:46.230956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccecbf4-943f-4c07-830a-54749bafa2dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:46.231266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccecbf4-943f-4c07-830a-54749bafa2dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:46.232732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccecbf4-943f-4c07-830a-54749bafa2dc None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:46.242368 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 129/259] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:46.242984 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccecbf4-943f-4c07-830a-54749bafa2dc None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:46.263665 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2595d0-e1df-4d3c-a6b0-8a8667dc931f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:46.264562 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2595d0-e1df-4d3c-a6b0-8a8667dc931f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:46.264986 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2595d0-e1df-4d3c-a6b0-8a8667dc931f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:46.265402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2595d0-e1df-4d3c-a6b0-8a8667dc931f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:46.266448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2595d0-e1df-4d3c-a6b0-8a8667dc931f None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=0dd67400813c49aabd0b08d7febb138b, user.id=68d1f37df47e451486f7a6045b1503f0) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:46.266904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2595d0-e1df-4d3c-a6b0-8a8667dc931f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:46.268504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2595d0-e1df-4d3c-a6b0-8a8667dc931f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:46.270066 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:46.275691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 131/260] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:46 2022] GET /identity/v3/role_assignments?user.id=68d1f37df47e451486f7a6045b1503f0&scope.project.id=0dd67400813c49aabd0b08d7febb138b&role.id=8f58ef9d28494d97a68de20b84355450 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:46.276792 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2595d0-e1df-4d3c-a6b0-8a8667dc931f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:46.301467 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:46.363758 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccecbf4-943f-4c07-830a-54749bafa2dc None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:46.398644 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2595d0-e1df-4d3c-a6b0-8a8667dc931f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:46.404963 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9cc90-72fc-488c-8641-ab3a492cd777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:46.405648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9cc90-72fc-488c-8641-ab3a492cd777 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:46.406009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9cc90-72fc-488c-8641-ab3a492cd777 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:46.406290 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9cc90-72fc-488c-8641-ab3a492cd777 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:46.407134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9cc90-72fc-488c-8641-ab3a492cd777 None admin] RBAC: Adding query filter params (role.id=822830288b154ed78764b4d57d45d813, scope.project.id=0dd67400813c49aabd0b08d7febb138b, user.id=9e8ca6de226f4026b140147be570a9ae) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:46.407444 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9cc90-72fc-488c-8641-ab3a492cd777 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:46.409366 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9cc90-72fc-488c-8641-ab3a492cd777 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:46.415419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 130/261] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:46 2022] GET /identity/v3/role_assignments?user.id=9e8ca6de226f4026b140147be570a9ae&scope.project.id=0dd67400813c49aabd0b08d7febb138b&role.id=822830288b154ed78764b4d57d45d813 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:46.416388 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9cc90-72fc-488c-8641-ab3a492cd777 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:46.438287 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc8545-576d-4019-bd32-34ad0ba987d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:46.439217 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc8545-576d-4019-bd32-34ad0ba987d7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:46.439667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc8545-576d-4019-bd32-34ad0ba987d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:46.440135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc8545-576d-4019-bd32-34ad0ba987d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:46.441033 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc8545-576d-4019-bd32-34ad0ba987d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:46.441488 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc8545-576d-4019-bd32-34ad0ba987d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:46.443096 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc8545-576d-4019-bd32-34ad0ba987d7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:46.453444 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 132/262] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:47:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:46.459016 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc8545-576d-4019-bd32-34ad0ba987d7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:46.537866 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:46.555172 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:46.557894 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9cc90-72fc-488c-8641-ab3a492cd777 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:46.575781 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc8545-576d-4019-bd32-34ad0ba987d7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:46.600884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3aaf3-8614-4ca0-a299-40ed2bbbe439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:46.601790 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3aaf3-8614-4ca0-a299-40ed2bbbe439 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:46.602107 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3aaf3-8614-4ca0-a299-40ed2bbbe439 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:46.602383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3aaf3-8614-4ca0-a299-40ed2bbbe439 None admin] PATH_INFO: `/v3/users/2f9918197abc4798bed5eb7db6c44fa4` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:46.604943 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3aaf3-8614-4ca0-a299-40ed2bbbe439 None admin] RBAC: Authorizing `identity:get_user(user_id=2f9918197abc4798bed5eb7db6c44fa4)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:46.606504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3aaf3-8614-4ca0-a299-40ed2bbbe439 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:46.608293 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 131/263] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:46 2022] GET /identity/v3/users/2f9918197abc4798bed5eb7db6c44fa4 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:46.613910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3aaf3-8614-4ca0-a299-40ed2bbbe439 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:46.622392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969988d-0cee-455a-92b8-3643558d13e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:46.623616 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969988d-0cee-455a-92b8-3643558d13e6 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:46.624079 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969988d-0cee-455a-92b8-3643558d13e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:46.624556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969988d-0cee-455a-92b8-3643558d13e6 None admin] PATH_INFO: `/v3/users/68d1f37df47e451486f7a6045b1503f0` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:46.626097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969988d-0cee-455a-92b8-3643558d13e6 None admin] RBAC: Authorizing `identity:get_user(user_id=68d1f37df47e451486f7a6045b1503f0)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:46.627750 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969988d-0cee-455a-92b8-3643558d13e6 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:46.630097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 133/264] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:46 2022] GET /identity/v3/users/68d1f37df47e451486f7a6045b1503f0 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:46.635396 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969988d-0cee-455a-92b8-3643558d13e6 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:46.732495 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3aaf3-8614-4ca0-a299-40ed2bbbe439 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:46.775348 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c604b-88e8-4324-a99f-99550905ad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:46.776923 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c604b-88e8-4324-a99f-99550905ad92 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:46.777290 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c604b-88e8-4324-a99f-99550905ad92 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:46.777637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c604b-88e8-4324-a99f-99550905ad92 None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:46.777739 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969988d-0cee-455a-92b8-3643558d13e6 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:46.780019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c604b-88e8-4324-a99f-99550905ad92 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:46.781712 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c604b-88e8-4324-a99f-99550905ad92 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:46.783928 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 132/265] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:46 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:46.789685 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c604b-88e8-4324-a99f-99550905ad92 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:46.817457 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:46.829604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538c455-59c9-4e70-8810-f67bac239f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:46.830822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538c455-59c9-4e70-8810-f67bac239f27 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:46.831284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538c455-59c9-4e70-8810-f67bac239f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:46.831770 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538c455-59c9-4e70-8810-f67bac239f27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:46.856568 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:46.923476 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c604b-88e8-4324-a99f-99550905ad92 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:46.946760 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538c455-59c9-4e70-8810-f67bac239f27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:46.949046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538c455-59c9-4e70-8810-f67bac239f27 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:46.984571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2cacb-ff39-48e5-b2f1-6e150a32add1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:46.985741 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2cacb-ff39-48e5-b2f1-6e150a32add1 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:46.986213 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2cacb-ff39-48e5-b2f1-6e150a32add1 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:46.986656 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2cacb-ff39-48e5-b2f1-6e150a32add1 None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b/users/2f9918197abc4798bed5eb7db6c44fa4/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:46.991851 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2cacb-ff39-48e5-b2f1-6e150a32add1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd67400813c49aabd0b08d7febb138b, user_id=2f9918197abc4798bed5eb7db6c44fa4, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:46.993551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2cacb-ff39-48e5-b2f1-6e150a32add1 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:47.014726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 133/266] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:47:46 2022] PUT /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b/users/2f9918197abc4798bed5eb7db6c44fa4/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 21:47:47.103551 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 134/267] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:47:47.108937 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2cacb-ff39-48e5-b2f1-6e150a32add1 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:47.200181 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:47.220371 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2cacb-ff39-48e5-b2f1-6e150a32add1 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:47.256994 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f238d-99ae-48e1-8633-6787a75b7bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:47.258154 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f238d-99ae-48e1-8633-6787a75b7bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:47.258605 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f238d-99ae-48e1-8633-6787a75b7bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:47.259062 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f238d-99ae-48e1-8633-6787a75b7bb5 None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:47.260497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f238d-99ae-48e1-8633-6787a75b7bb5 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:47.262166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f238d-99ae-48e1-8633-6787a75b7bb5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:47.264481 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 134/268] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:47 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:47.270036 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538c455-59c9-4e70-8810-f67bac239f27 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:47.345318 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:47.412174 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538c455-59c9-4e70-8810-f67bac239f27 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:47.452141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac658d-abc5-4512-aef1-53ac4d9b51c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:47.452803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac658d-abc5-4512-aef1-53ac4d9b51c4 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:47.453086 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac658d-abc5-4512-aef1-53ac4d9b51c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:47.453363 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac658d-abc5-4512-aef1-53ac4d9b51c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:47.454224 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac658d-abc5-4512-aef1-53ac4d9b51c4 None admin] RBAC: Adding query filter params (role.id=73d4eafa268f4cc3aca4863c73b794ae, scope.project.id=0dd67400813c49aabd0b08d7febb138b, user.id=68d1f37df47e451486f7a6045b1503f0) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:47.454552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac658d-abc5-4512-aef1-53ac4d9b51c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:47.455969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac658d-abc5-4512-aef1-53ac4d9b51c4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:47.463279 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 135/269] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:47 2022] GET /identity/v3/role_assignments?user.id=68d1f37df47e451486f7a6045b1503f0&scope.project.id=0dd67400813c49aabd0b08d7febb138b&role.id=73d4eafa268f4cc3aca4863c73b794ae => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:48.155105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9875c-d376-4ab1-9efb-701d399e0f20 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:48.155647 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9875c-d376-4ab1-9efb-701d399e0f20 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:48.155647 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9875c-d376-4ab1-9efb-701d399e0f20 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:48.157266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 135/270] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:48.162744 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d74b76-a3d2-4fca-b4d3-45b59c660915 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:48.163038 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d74b76-a3d2-4fca-b4d3-45b59c660915 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:48.163317 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d74b76-a3d2-4fca-b4d3-45b59c660915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:48.180914 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-61d74b76-a3d2-4fca-b4d3-45b59c660915 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:48.182154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-61d74b76-a3d2-4fca-b4d3-45b59c660915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:48.245251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3075a-01ce-4147-ad7d-9beff0f5e930 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:48.245530 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3075a-01ce-4147-ad7d-9beff0f5e930 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:48.245805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3075a-01ce-4147-ad7d-9beff0f5e930 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:48.247329 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 136/271] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:48.253523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f15cc4-1430-4086-8b71-c1e271f3d57b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:48.253806 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f15cc4-1430-4086-8b71-c1e271f3d57b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:48.254105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f15cc4-1430-4086-8b71-c1e271f3d57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:48.255614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 136/272] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:48.271357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d1f15cc4-1430-4086-8b71-c1e271f3d57b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:48.272520 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d1f15cc4-1430-4086-8b71-c1e271f3d57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:48.281066 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d74b76-a3d2-4fca-b4d3-45b59c660915 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:48.330482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:48.366013 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 137/273] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:47:48.393535 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d74b76-a3d2-4fca-b4d3-45b59c660915 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:48.394945 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f15cc4-1430-4086-8b71-c1e271f3d57b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:48.428963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da49e96-6bac-4731-94d7-0ca801bffd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:48.429908 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da49e96-6bac-4731-94d7-0ca801bffd66 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:48.430406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da49e96-6bac-4731-94d7-0ca801bffd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:48.430704 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da49e96-6bac-4731-94d7-0ca801bffd66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:48.431874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da49e96-6bac-4731-94d7-0ca801bffd66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:48.433950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da49e96-6bac-4731-94d7-0ca801bffd66 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:48.435844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 137/274] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:47:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:48.441013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da49e96-6bac-4731-94d7-0ca801bffd66 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:48.489677 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:48.511239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f15cc4-1430-4086-8b71-c1e271f3d57b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:48.547386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d649a-99e5-495a-b012-851c0ea2166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:48.548428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d649a-99e5-495a-b012-851c0ea2166b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:48.548880 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d649a-99e5-495a-b012-851c0ea2166b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:48.549294 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d649a-99e5-495a-b012-851c0ea2166b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:48.560847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d649a-99e5-495a-b012-851c0ea2166b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:48.568852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-ad6d649a-99e5-495a-b012-851c0ea2166b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:48.568852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:48.568852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:48.568852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:48.568852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:48.568852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:48.568852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:48.568852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:48.568852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:48.568852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:48.568852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:48.568852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:48.568852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:48.568852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:48.568852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:48.568852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:48.569726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:48.569726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:48.569726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:48.569726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:48.569726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:48.569726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:48.569726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:48.569726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:48.569726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:48.569726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:48.569726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:48.569726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:48.569726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:48.569726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:48.569726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:48.569726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:48.570544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:48.570544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:48.570544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:48.570544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:48.570544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:48.570544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:48.570544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:48.570544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:48.570544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:48.570544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:48.570544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:48.570544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:48.573400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 138/275] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:48.575439 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da49e96-6bac-4731-94d7-0ca801bffd66 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:48.579207 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d649a-99e5-495a-b012-851c0ea2166b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:48.593210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:48.625612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99566b-bd9c-48bd-b720-e8eec7795653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:48.626431 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99566b-bd9c-48bd-b720-e8eec7795653 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:48.627187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99566b-bd9c-48bd-b720-e8eec7795653 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:48.627538 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99566b-bd9c-48bd-b720-e8eec7795653 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:48.628675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99566b-bd9c-48bd-b720-e8eec7795653 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:48.630528 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99566b-bd9c-48bd-b720-e8eec7795653 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:48.658284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 138/276] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:47:48 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 21:47:48.697707 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d649a-99e5-495a-b012-851c0ea2166b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:48.739086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc247086-9b85-4787-ab6a-b039ec04577c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:48.740012 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc247086-9b85-4787-ab6a-b039ec04577c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:48.740433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc247086-9b85-4787-ab6a-b039ec04577c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:48.740914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc247086-9b85-4787-ab6a-b039ec04577c None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:48.741818 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc247086-9b85-4787-ab6a-b039ec04577c None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:48.742290 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc247086-9b85-4787-ab6a-b039ec04577c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:48.743907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc247086-9b85-4787-ab6a-b039ec04577c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:48.759124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 139/277] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:48.763157 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99566b-bd9c-48bd-b720-e8eec7795653 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:48.874888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99566b-bd9c-48bd-b720-e8eec7795653 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:48.912244 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8e6ce-ab1e-4df7-8713-fb342f324ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:48.913413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8e6ce-ab1e-4df7-8713-fb342f324ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:48.913838 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8e6ce-ab1e-4df7-8713-fb342f324ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:48.914352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8e6ce-ab1e-4df7-8713-fb342f324ce5 None admin] PATH_INFO: `/v3/users/cf6dabee3cfa48ea87bf64853f2770eb` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:48.932499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8e6ce-ab1e-4df7-8713-fb342f324ce5 None admin] RBAC: Authorizing `identity:get_user(user_id=cf6dabee3cfa48ea87bf64853f2770eb)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:48.934296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8e6ce-ab1e-4df7-8713-fb342f324ce5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:48.936264 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 139/278] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:48 2022] GET /identity/v3/users/cf6dabee3cfa48ea87bf64853f2770eb => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:48.942279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc247086-9b85-4787-ab6a-b039ec04577c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:48.946008 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:49.056410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc247086-9b85-4787-ab6a-b039ec04577c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:49.095411 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630ea3f-255d-456d-b8bc-b55969d08bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:49.096072 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630ea3f-255d-456d-b8bc-b55969d08bda None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:49.096357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630ea3f-255d-456d-b8bc-b55969d08bda None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:49.096636 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630ea3f-255d-456d-b8bc-b55969d08bda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:49.097476 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630ea3f-255d-456d-b8bc-b55969d08bda None admin] RBAC: Adding query filter params (role.id=01ccb434cf384bc79bf82f49b697f1ce, user.id=cf6dabee3cfa48ea87bf64853f2770eb, scope.system=all) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:49.097796 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630ea3f-255d-456d-b8bc-b55969d08bda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:49.099299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630ea3f-255d-456d-b8bc-b55969d08bda None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:49.105527 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 140/279] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jun 7 21:47:48 2022] GET /identity/v3/role_assignments?user.id=cf6dabee3cfa48ea87bf64853f2770eb&scope.system=all&role.id=01ccb434cf384bc79bf82f49b697f1ce => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:49.251467 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a377068-3dee-4691-915d-d416aa614e02 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:49.251808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a377068-3dee-4691-915d-d416aa614e02 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:49.252031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a377068-3dee-4691-915d-d416aa614e02 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:49.253420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 140/280] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:49.258919 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de151da2-4bc2-4097-850b-8c0f92e544d3 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:49.259393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de151da2-4bc2-4097-850b-8c0f92e544d3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:49.259495 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de151da2-4bc2-4097-850b-8c0f92e544d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:49.282387 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-de151da2-4bc2-4097-850b-8c0f92e544d3 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:49.283606 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-de151da2-4bc2-4097-850b-8c0f92e544d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:49.377660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:49.390351 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 141/281] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:49.415976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a377068-3dee-4691-915d-d416aa614e02 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:49.447328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:49.527952 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a377068-3dee-4691-915d-d416aa614e02 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:49.574638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceaf36-c780-4781-8b95-b1b9e6563557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:49.575439 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceaf36-c780-4781-8b95-b1b9e6563557 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:49.575722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceaf36-c780-4781-8b95-b1b9e6563557 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:49.575994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceaf36-c780-4781-8b95-b1b9e6563557 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:49.591729 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceaf36-c780-4781-8b95-b1b9e6563557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:49.599731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-c4ceaf36-c780-4781-8b95-b1b9e6563557 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:47:49.599731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:49.599731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:49.599731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:49.599731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:49.599731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:49.599731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:49.599731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:49.599731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:49.599731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:49.599731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:49.599731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:49.599731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:49.599731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:49.599731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:49.599731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:49.600588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:49.600588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:49.600588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:49.600588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:49.600588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:49.600588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:49.600588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:49.600588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:49.600588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:49.600588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:49.600588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:49.600588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:49.600588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:49.600588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:49.600588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:49.600588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:49.601355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:49.601355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:49.601355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:49.601355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:49.601355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:49.601355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:49.601355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:49.601355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:49.601355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:49.601355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:49.601355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:47:49.601355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:49.601355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 141/282] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:49.611035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de151da2-4bc2-4097-850b-8c0f92e544d3 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:49.675910 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a10a6-bff6-4fa1-bc8d-462b4e223e68 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:49.676518 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a10a6-bff6-4fa1-bc8d-462b4e223e68 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:49.676992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a10a6-bff6-4fa1-bc8d-462b4e223e68 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:49.678619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 142/283] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:47:49.683765 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2c56c-4284-4a79-af81-052bdadb18d0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:49.684280 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2c56c-4284-4a79-af81-052bdadb18d0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:49.684754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2c56c-4284-4a79-af81-052bdadb18d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:49.710012 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-fca2c56c-4284-4a79-af81-052bdadb18d0 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:49.711199 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fca2c56c-4284-4a79-af81-052bdadb18d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:49.782904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 143/284] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:49.789585 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de151da2-4bc2-4097-850b-8c0f92e544d3 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:49.806414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2c56c-4284-4a79-af81-052bdadb18d0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:49.836911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ef862-7113-48bc-8975-1e9bc46d3d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:49.837858 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ef862-7113-48bc-8975-1e9bc46d3d41 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:49.838720 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ef862-7113-48bc-8975-1e9bc46d3d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:49.839146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ef862-7113-48bc-8975-1e9bc46d3d41 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:49.840203 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ef862-7113-48bc-8975-1e9bc46d3d41 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:49.840783 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ef862-7113-48bc-8975-1e9bc46d3d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:49.842513 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ef862-7113-48bc-8975-1e9bc46d3d41 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:49.843478 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:49.853294 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 142/285] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:49.860576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ef862-7113-48bc-8975-1e9bc46d3d41 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:49.938548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2c56c-4284-4a79-af81-052bdadb18d0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:49.959512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:49.973207 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a868feb-957d-4828-91ee-cf80b08fef21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:49.974288 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a868feb-957d-4828-91ee-cf80b08fef21 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:49.975025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a868feb-957d-4828-91ee-cf80b08fef21 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:49.975508 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a868feb-957d-4828-91ee-cf80b08fef21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:49.995109 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a868feb-957d-4828-91ee-cf80b08fef21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:50.003147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-5a868feb-957d-4828-91ee-cf80b08fef21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:50.003147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:50.003147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:50.003147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:50.003147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:50.003147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:50.003147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:50.003147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:50.003147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:50.003147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:50.003147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:50.003147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:50.003147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:50.003147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:50.003147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:50.003147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:50.003987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:50.003987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:50.003987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:50.003987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:50.003987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:50.003987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:50.003987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:50.003987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:50.003987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:50.003987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:50.003987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:50.003987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:50.003987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:50.003987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:50.003987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:50.003987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:50.004775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:50.004775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:50.004775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:50.004775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:50.004775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:50.004775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:50.004775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:50.004775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:50.004775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:50.004775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:50.004775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:50.004775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:50.007425 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 144/286] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:47:50.013568 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a868feb-957d-4828-91ee-cf80b08fef21 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:50.043255 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ef862-7113-48bc-8975-1e9bc46d3d41 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:50.115845 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:50.146619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c247ea-ba0a-4d02-b20f-5c724d178285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:50.147596 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c247ea-ba0a-4d02-b20f-5c724d178285 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:50.147793 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c247ea-ba0a-4d02-b20f-5c724d178285 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:50.148043 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c247ea-ba0a-4d02-b20f-5c724d178285 None admin] PATH_INFO: `/v3/users/9e8ca6de226f4026b140147be570a9ae` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:50.151535 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a868feb-957d-4828-91ee-cf80b08fef21 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:50.154661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c247ea-ba0a-4d02-b20f-5c724d178285 None admin] RBAC: Authorizing `identity:get_user(user_id=9e8ca6de226f4026b140147be570a9ae)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:50.156317 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c247ea-ba0a-4d02-b20f-5c724d178285 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:50.158061 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 143/287] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:49 2022] GET /identity/v3/users/9e8ca6de226f4026b140147be570a9ae => generated 297 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:50.167125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c247ea-ba0a-4d02-b20f-5c724d178285 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:50.194315 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14b78d-cc3e-4bad-bf11-0a9a291499f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:50.195359 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14b78d-cc3e-4bad-bf11-0a9a291499f9 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:50.195921 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14b78d-cc3e-4bad-bf11-0a9a291499f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:50.196426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14b78d-cc3e-4bad-bf11-0a9a291499f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:50.197371 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14b78d-cc3e-4bad-bf11-0a9a291499f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:50.198016 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14b78d-cc3e-4bad-bf11-0a9a291499f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:50.199657 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14b78d-cc3e-4bad-bf11-0a9a291499f9 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:50.209101 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 145/288] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:50.215786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14b78d-cc3e-4bad-bf11-0a9a291499f9 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:50.340091 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14b78d-cc3e-4bad-bf11-0a9a291499f9 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:50.386088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c247ea-ba0a-4d02-b20f-5c724d178285 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:50.406709 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc34c3-1c11-4a03-85fe-9cdf354cffee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:50.408065 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc34c3-1c11-4a03-85fe-9cdf354cffee None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:50.408548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc34c3-1c11-4a03-85fe-9cdf354cffee None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:50.409157 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc34c3-1c11-4a03-85fe-9cdf354cffee None admin] PATH_INFO: `/v3/users/2f9918197abc4798bed5eb7db6c44fa4` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:50.414722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc34c3-1c11-4a03-85fe-9cdf354cffee None admin] RBAC: Authorizing `identity:get_user(user_id=2f9918197abc4798bed5eb7db6c44fa4)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:50.416520 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc34c3-1c11-4a03-85fe-9cdf354cffee None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:50.421763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 146/289] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:50 2022] GET /identity/v3/users/2f9918197abc4798bed5eb7db6c44fa4 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:50.430570 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc34c3-1c11-4a03-85fe-9cdf354cffee None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:50.446414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:50.450934 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:50.475274 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e2078-a080-4ed2-8c47-4c0d43e17424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:50.476149 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e2078-a080-4ed2-8c47-4c0d43e17424 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:50.476432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e2078-a080-4ed2-8c47-4c0d43e17424 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:50.476703 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e2078-a080-4ed2-8c47-4c0d43e17424 None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:50.478150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e2078-a080-4ed2-8c47-4c0d43e17424 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:50.479420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e2078-a080-4ed2-8c47-4c0d43e17424 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:50.490667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 144/290] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:50 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:50.491585 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e2078-a080-4ed2-8c47-4c0d43e17424 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:50.628772 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc34c3-1c11-4a03-85fe-9cdf354cffee None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:50.679779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5adf0-2bbf-45b3-9583-abaf37e78371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:50.680826 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5adf0-2bbf-45b3-9583-abaf37e78371 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:50.681533 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5adf0-2bbf-45b3-9583-abaf37e78371 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:50.682032 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5adf0-2bbf-45b3-9583-abaf37e78371 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:50.764104 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5adf0-2bbf-45b3-9583-abaf37e78371 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:50.766621 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5adf0-2bbf-45b3-9583-abaf37e78371 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:50.786830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e2078-a080-4ed2-8c47-4c0d43e17424 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:50.789059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:50.852524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47c9d1-9178-4a81-a28a-1d127ce53ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:50.853775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47c9d1-9178-4a81-a28a-1d127ce53ffb None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:50.854370 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47c9d1-9178-4a81-a28a-1d127ce53ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:50.854842 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47c9d1-9178-4a81-a28a-1d127ce53ffb None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b/users/9e8ca6de226f4026b140147be570a9ae/roles/822830288b154ed78764b4d57d45d813` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:50.859299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47c9d1-9178-4a81-a28a-1d127ce53ffb None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd67400813c49aabd0b08d7febb138b, user_id=9e8ca6de226f4026b140147be570a9ae, role_id=822830288b154ed78764b4d57d45d813)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:50.863391 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47c9d1-9178-4a81-a28a-1d127ce53ffb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:50.892495 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 145/291] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:47:50 2022] PUT /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b/users/9e8ca6de226f4026b140147be570a9ae/roles/822830288b154ed78764b4d57d45d813 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:47:50.928773 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 147/292] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:47:50.935127 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47c9d1-9178-4a81-a28a-1d127ce53ffb None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:51.005371 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:51.066338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47c9d1-9178-4a81-a28a-1d127ce53ffb None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:51.107570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349ebbf-2dba-496d-b68e-4aafc3d9c4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:51.108819 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349ebbf-2dba-496d-b68e-4aafc3d9c4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:51.109299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349ebbf-2dba-496d-b68e-4aafc3d9c4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:51.109766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349ebbf-2dba-496d-b68e-4aafc3d9c4c5 None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:51.111167 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349ebbf-2dba-496d-b68e-4aafc3d9c4c5 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:51.112921 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349ebbf-2dba-496d-b68e-4aafc3d9c4c5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:51.114861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 146/293] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:50 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:51.121396 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5adf0-2bbf-45b3-9583-abaf37e78371 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:51.229255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5adf0-2bbf-45b3-9583-abaf37e78371 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:51.238057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:51.268199 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71a5c9-e734-44d2-9c8e-70d40afbe68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:51.269255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a5c9-e734-44d2-9c8e-70d40afbe68c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:51.269768 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a5c9-e734-44d2-9c8e-70d40afbe68c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:51.270277 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a5c9-e734-44d2-9c8e-70d40afbe68c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:51.271371 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71a5c9-e734-44d2-9c8e-70d40afbe68c None admin] RBAC: Adding query filter params (role.id=01ccb434cf384bc79bf82f49b697f1ce, scope.project.id=0dd67400813c49aabd0b08d7febb138b, user.id=2f9918197abc4798bed5eb7db6c44fa4) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:51.271900 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71a5c9-e734-44d2-9c8e-70d40afbe68c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:51.273638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71a5c9-e734-44d2-9c8e-70d40afbe68c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:51.281985 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 148/294] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:51 2022] GET /identity/v3/role_assignments?user.id=2f9918197abc4798bed5eb7db6c44fa4&scope.project.id=0dd67400813c49aabd0b08d7febb138b&role.id=01ccb434cf384bc79bf82f49b697f1ce => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:51.422877 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bea7c-40dc-4792-aa84-c491c2da327e None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:51.423388 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bea7c-40dc-4792-aa84-c491c2da327e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:51.423461 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bea7c-40dc-4792-aa84-c491c2da327e None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:51.425000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 147/295] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:51.430438 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76eac0-0663-49cb-8629-ce6766e7d2c9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:51.430729 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76eac0-0663-49cb-8629-ce6766e7d2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:51.431012 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76eac0-0663-49cb-8629-ce6766e7d2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:51.448840 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-cc76eac0-0663-49cb-8629-ce6766e7d2c9 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:51.450118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-cc76eac0-0663-49cb-8629-ce6766e7d2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:51.527026 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 149/296] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:51.550731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bea7c-40dc-4792-aa84-c491c2da327e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:51.658328 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bea7c-40dc-4792-aa84-c491c2da327e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:51.685287 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:51.697205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a4305-cd38-46d0-8e0b-1420e7e1db61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:51.698109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a4305-cd38-46d0-8e0b-1420e7e1db61 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:51.698483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a4305-cd38-46d0-8e0b-1420e7e1db61 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:51.700074 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e4c57-67c6-4270-838b-5c97bcfc4639 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:51.700357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e4c57-67c6-4270-838b-5c97bcfc4639 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:51.700630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e4c57-67c6-4270-838b-5c97bcfc4639 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:51.702151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a4305-cd38-46d0-8e0b-1420e7e1db61 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:51.702263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 150/297] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:47:51.707601 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ce11d-82ed-4a4a-bb68-42dede0c6479 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:51.708172 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ce11d-82ed-4a4a-bb68-42dede0c6479 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:51.708649 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ce11d-82ed-4a4a-bb68-42dede0c6479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:51.717856 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a4305-cd38-46d0-8e0b-1420e7e1db61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:51.727814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-480ce11d-82ed-4a4a-bb68-42dede0c6479 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:51.728620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-dc3a4305-cd38-46d0-8e0b-1420e7e1db61 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:47:51.728620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:51.728620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:51.728620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:51.728620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:51.728620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:51.728620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:51.728620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:51.728620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:51.728620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:51.728620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:51.728620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:51.728620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:51.728620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:51.728620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:51.728620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:51.729570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:51.729570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:51.729570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:51.729570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:51.729570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:51.729570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:51.729570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:51.729570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:51.729570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:51.729570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:51.729570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:51.729570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:51.729570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:51.729570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:51.729570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:51.729570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:51.730383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:51.730383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:51.730383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:51.730383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:51.730383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:51.730383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:51.730383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:51.730383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:51.730383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:51.730383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:51.730383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:47:51.730383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:51.730383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 148/298] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:51.736557 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-480ce11d-82ed-4a4a-bb68-42dede0c6479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:51.742176 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a4305-cd38-46d0-8e0b-1420e7e1db61 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:51.811644 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 151/299] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:51.836326 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ce11d-82ed-4a4a-bb68-42dede0c6479 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:51.873155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:51.873643 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a4305-cd38-46d0-8e0b-1420e7e1db61 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:51.919734 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f2861-24b3-4ef9-98ff-2a7e50e6c1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:51.921332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f2861-24b3-4ef9-98ff-2a7e50e6c1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:51.922087 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f2861-24b3-4ef9-98ff-2a7e50e6c1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:51.922581 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f2861-24b3-4ef9-98ff-2a7e50e6c1e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:51.924659 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f2861-24b3-4ef9-98ff-2a7e50e6c1e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:51.925182 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f2861-24b3-4ef9-98ff-2a7e50e6c1e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:51.926805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f2861-24b3-4ef9-98ff-2a7e50e6c1e4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:51.943335 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 149/300] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:51.945050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f2861-24b3-4ef9-98ff-2a7e50e6c1e4 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:51.963632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ce11d-82ed-4a4a-bb68-42dede0c6479 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:52.008610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:52.012828 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f250ff7-f577-4109-8c34-33850917df8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:52.013772 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f250ff7-f577-4109-8c34-33850917df8d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:52.014080 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f250ff7-f577-4109-8c34-33850917df8d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:52.014355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f250ff7-f577-4109-8c34-33850917df8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:52.016431 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f250ff7-f577-4109-8c34-33850917df8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:52.017914 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f250ff7-f577-4109-8c34-33850917df8d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:52.024466 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 152/301] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:47:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:52.026128 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f250ff7-f577-4109-8c34-33850917df8d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:52.093615 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f2861-24b3-4ef9-98ff-2a7e50e6c1e4 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:52.131491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c587f4-0be4-456f-8537-35ff651d44dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:52.132314 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c587f4-0be4-456f-8537-35ff651d44dd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:52.132594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c587f4-0be4-456f-8537-35ff651d44dd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:52.132863 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c587f4-0be4-456f-8537-35ff651d44dd None admin] PATH_INFO: `/v3/users/87af63db11f144a19ff6d3711a79a9d7` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:52.147202 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c587f4-0be4-456f-8537-35ff651d44dd None admin] RBAC: Authorizing `identity:get_user(user_id=87af63db11f144a19ff6d3711a79a9d7)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:52.147957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:52.148726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c587f4-0be4-456f-8537-35ff651d44dd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:52.155132 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 150/302] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:51 2022] GET /identity/v3/users/87af63db11f144a19ff6d3711a79a9d7 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:52.156285 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c587f4-0be4-456f-8537-35ff651d44dd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:52.158252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f250ff7-f577-4109-8c34-33850917df8d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:52.204959 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef9c9c-b1ca-4639-aff4-a5bf284f0530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:52.205566 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef9c9c-b1ca-4639-aff4-a5bf284f0530 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:52.205843 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef9c9c-b1ca-4639-aff4-a5bf284f0530 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:52.206160 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef9c9c-b1ca-4639-aff4-a5bf284f0530 None admin] PATH_INFO: `/v3/groups` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:52.206860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef9c9c-b1ca-4639-aff4-a5bf284f0530 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:52.208393 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef9c9c-b1ca-4639-aff4-a5bf284f0530 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:52.225967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 153/303] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Jun 7 21:47:52 2022] POST /identity/v3/groups => generated 229 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:47:52.281361 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c587f4-0be4-456f-8537-35ff651d44dd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:52.283367 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:52.321590 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d0349-06ee-46cd-bf0e-0bbc8136a8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:52.322668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d0349-06ee-46cd-bf0e-0bbc8136a8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:52.323189 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d0349-06ee-46cd-bf0e-0bbc8136a8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:52.323630 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d0349-06ee-46cd-bf0e-0bbc8136a8f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:52.324671 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d0349-06ee-46cd-bf0e-0bbc8136a8f6 None admin] RBAC: Adding query filter params (role.id=822830288b154ed78764b4d57d45d813, user.id=87af63db11f144a19ff6d3711a79a9d7, scope.system=all) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:52.325173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d0349-06ee-46cd-bf0e-0bbc8136a8f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:52.326889 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d0349-06ee-46cd-bf0e-0bbc8136a8f6 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:52.333665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 151/304] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jun 7 21:47:52 2022] GET /identity/v3/role_assignments?user.id=87af63db11f144a19ff6d3711a79a9d7&scope.system=all&role.id=822830288b154ed78764b4d57d45d813 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:52.336698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e299b3-17e1-444d-b5a1-261cc6c16938 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:52.336992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e299b3-17e1-444d-b5a1-261cc6c16938 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:52.337273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e299b3-17e1-444d-b5a1-261cc6c16938 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:52.343586 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 154/305] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:52.345601 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88784e68-7e91-4bc1-acf6-67fd38635780 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:52.345891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88784e68-7e91-4bc1-acf6-67fd38635780 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:52.346203 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88784e68-7e91-4bc1-acf6-67fd38635780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:52.384108 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-88784e68-7e91-4bc1-acf6-67fd38635780 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:52.385392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-88784e68-7e91-4bc1-acf6-67fd38635780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:52.466070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 152/306] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:52.489678 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e299b3-17e1-444d-b5a1-261cc6c16938 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:52.605635 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e299b3-17e1-444d-b5a1-261cc6c16938 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:52.641417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc9c48-89dd-4824-99c9-2ccb97ff8cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:52.642302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc9c48-89dd-4824-99c9-2ccb97ff8cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:52.642634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc9c48-89dd-4824-99c9-2ccb97ff8cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:52.642904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc9c48-89dd-4824-99c9-2ccb97ff8cf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:52.654603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc9c48-89dd-4824-99c9-2ccb97ff8cf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:52.662406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-bcbc9c48-89dd-4824-99c9-2ccb97ff8cf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:52.662406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:52.662406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:52.662406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:52.662406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:52.662406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:52.662406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:52.662406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:52.662406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:52.662406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:52.662406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:52.662406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:52.662406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:52.662406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:52.662406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:52.662406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:52.663292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:52.663292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:52.663292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:52.663292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:52.663292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:52.663292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:52.663292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:52.663292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:52.663292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:52.663292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:52.663292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:52.663292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:52.663292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:52.663292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:52.663292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:52.663292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:52.664077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:52.664077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:52.664077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:52.664077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:52.664077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:52.664077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:52.664077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:52.664077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:52.664077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:52.664077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:52.664077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:52.664077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:52.668455 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 155/307] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:52.669889 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88784e68-7e91-4bc1-acf6-67fd38635780 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:52.766871 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:52.772611 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88784e68-7e91-4bc1-acf6-67fd38635780 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:52.808497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe8c1f-8ae8-4c63-a269-1cc9102f8bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:52.809170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe8c1f-8ae8-4c63-a269-1cc9102f8bac None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:52.809455 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe8c1f-8ae8-4c63-a269-1cc9102f8bac None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:52.809727 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe8c1f-8ae8-4c63-a269-1cc9102f8bac None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:52.810506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe8c1f-8ae8-4c63-a269-1cc9102f8bac None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:52.810811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe8c1f-8ae8-4c63-a269-1cc9102f8bac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:52.812189 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe8c1f-8ae8-4c63-a269-1cc9102f8bac None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:52.821026 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 153/308] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:52.827039 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc9c48-89dd-4824-99c9-2ccb97ff8cf7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:52.848758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:52.932552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc9c48-89dd-4824-99c9-2ccb97ff8cf7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:52.968071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a82ac-3f29-4c1e-8740-dac491a74e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:52.969160 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a82ac-3f29-4c1e-8740-dac491a74e2b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:52.969577 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a82ac-3f29-4c1e-8740-dac491a74e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:52.970008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a82ac-3f29-4c1e-8740-dac491a74e2b None admin] PATH_INFO: `/v3/users/cf6dabee3cfa48ea87bf64853f2770eb` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:52.971369 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a82ac-3f29-4c1e-8740-dac491a74e2b None admin] RBAC: Authorizing `identity:get_user(user_id=cf6dabee3cfa48ea87bf64853f2770eb)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:52.972947 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a82ac-3f29-4c1e-8740-dac491a74e2b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:52.980144 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 156/309] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:52 2022] GET /identity/v3/users/cf6dabee3cfa48ea87bf64853f2770eb => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:52.981629 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe8c1f-8ae8-4c63-a269-1cc9102f8bac None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:53.089484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe8c1f-8ae8-4c63-a269-1cc9102f8bac None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:53.124588 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ee715-5005-45f9-8697-4e962b20fe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:53.125462 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ee715-5005-45f9-8697-4e962b20fe18 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:53.125746 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ee715-5005-45f9-8697-4e962b20fe18 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:53.126051 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ee715-5005-45f9-8697-4e962b20fe18 None admin] PATH_INFO: `/v3/system/users/cf6dabee3cfa48ea87bf64853f2770eb/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:53.127572 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ee715-5005-45f9-8697-4e962b20fe18 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cf6dabee3cfa48ea87bf64853f2770eb, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:53.128971 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ee715-5005-45f9-8697-4e962b20fe18 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:53.141386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 154/310] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Jun 7 21:47:52 2022] PUT /identity/v3/system/users/cf6dabee3cfa48ea87bf64853f2770eb/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:47:53.619894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab30ad2-388d-426f-a97d-71293bb6fa87 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:53.620380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab30ad2-388d-426f-a97d-71293bb6fa87 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:53.620380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab30ad2-388d-426f-a97d-71293bb6fa87 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:53.622023 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 157/311] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:53.627434 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2a5c7-e26a-412b-864d-84e6310df822 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:53.627863 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2a5c7-e26a-412b-864d-84e6310df822 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:53.628002 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2a5c7-e26a-412b-864d-84e6310df822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:53.646226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-38e2a5c7-e26a-412b-864d-84e6310df822 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:53.647710 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-38e2a5c7-e26a-412b-864d-84e6310df822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:53.665952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:53.722754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 155/312] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:53.745646 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab30ad2-388d-426f-a97d-71293bb6fa87 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:53.835415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:53.847972 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab30ad2-388d-426f-a97d-71293bb6fa87 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:53.882707 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7470f5-ba51-43f4-aba0-bf1c02f88ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:53.883402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7470f5-ba51-43f4-aba0-bf1c02f88ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:53.883680 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7470f5-ba51-43f4-aba0-bf1c02f88ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:53.883945 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7470f5-ba51-43f4-aba0-bf1c02f88ee9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:53.894026 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7470f5-ba51-43f4-aba0-bf1c02f88ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:53.902399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-9a7470f5-ba51-43f4-aba0-bf1c02f88ee9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:47:53.902399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:53.902399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:53.902399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:53.902399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:53.902399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:53.902399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:53.902399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:53.902399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:53.902399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:53.902399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:53.902399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:53.902399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:53.902399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:53.902399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:53.902399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:53.904007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:53.904007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:53.904007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:53.904007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:53.904007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:53.904007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:53.904007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:53.904007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:53.904007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:53.904007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:53.904007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:53.904007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:53.904007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:53.904007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:53.904007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:53.904007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:53.905583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:53.905583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:53.905583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:53.905583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:53.905583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:53.905583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:53.905583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:53.905583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:53.905583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:53.905583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:53.905583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:47:53.905583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:53.909975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 158/313] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:53.910420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2a5c7-e26a-412b-864d-84e6310df822 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:54.013670 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2a5c7-e26a-412b-864d-84e6310df822 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:54.048620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031699a3-4479-434e-b2cf-7c47465cb15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:54.049504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031699a3-4479-434e-b2cf-7c47465cb15e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:54.049940 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031699a3-4479-434e-b2cf-7c47465cb15e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:54.050346 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031699a3-4479-434e-b2cf-7c47465cb15e None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:54.051231 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031699a3-4479-434e-b2cf-7c47465cb15e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:54.051770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031699a3-4479-434e-b2cf-7c47465cb15e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:54.053380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031699a3-4479-434e-b2cf-7c47465cb15e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:54.066041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 156/314] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:54.067780 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7470f5-ba51-43f4-aba0-bf1c02f88ee9 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:54.170103 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7470f5-ba51-43f4-aba0-bf1c02f88ee9 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:54.204366 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a56fa-a941-480c-a153-72cd4dce2d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:54.205499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a56fa-a941-480c-a153-72cd4dce2d29 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:54.205995 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a56fa-a941-480c-a153-72cd4dce2d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:54.206416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a56fa-a941-480c-a153-72cd4dce2d29 None admin] PATH_INFO: `/v3/users/9e8ca6de226f4026b140147be570a9ae` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:54.207885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a56fa-a941-480c-a153-72cd4dce2d29 None admin] RBAC: Authorizing `identity:get_user(user_id=9e8ca6de226f4026b140147be570a9ae)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:54.209450 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a56fa-a941-480c-a153-72cd4dce2d29 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:54.215726 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 159/315] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:54 2022] GET /identity/v3/users/9e8ca6de226f4026b140147be570a9ae => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:54.217274 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031699a3-4479-434e-b2cf-7c47465cb15e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:54.243231 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:54.322163 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031699a3-4479-434e-b2cf-7c47465cb15e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:54.367647 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad6ad3-0ef3-427f-a929-37e205d57c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:54.368313 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad6ad3-0ef3-427f-a929-37e205d57c4d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:54.368599 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad6ad3-0ef3-427f-a929-37e205d57c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:54.368874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad6ad3-0ef3-427f-a929-37e205d57c4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:54.438977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad6ad3-0ef3-427f-a929-37e205d57c4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:54.440376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad6ad3-0ef3-427f-a929-37e205d57c4d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:54.463029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:54.545991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 157/316] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 21:47:54.547373 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a56fa-a941-480c-a153-72cd4dce2d29 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:54.582830 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:54.649831 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a56fa-a941-480c-a153-72cd4dce2d29 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:54.686088 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d4286-6dbc-4cb8-919f-eb71ed492de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:54.687246 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d4286-6dbc-4cb8-919f-eb71ed492de3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:54.687532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d4286-6dbc-4cb8-919f-eb71ed492de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:54.687805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d4286-6dbc-4cb8-919f-eb71ed492de3 None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:54.689091 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d4286-6dbc-4cb8-919f-eb71ed492de3 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:54.690534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d4286-6dbc-4cb8-919f-eb71ed492de3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:54.697147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 160/317] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:54 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:54.698709 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad6ad3-0ef3-427f-a929-37e205d57c4d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:54.804677 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad6ad3-0ef3-427f-a929-37e205d57c4d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:54.819878 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:54.840026 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0aae77-8259-487b-b4ca-8210c5b1dce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:54.840775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aae77-8259-487b-b4ca-8210c5b1dce2 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:54.841057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aae77-8259-487b-b4ca-8210c5b1dce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:54.841327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aae77-8259-487b-b4ca-8210c5b1dce2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:54.842179 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0aae77-8259-487b-b4ca-8210c5b1dce2 None admin] RBAC: Adding query filter params (role.id=822830288b154ed78764b4d57d45d813, scope.project.id=0dd67400813c49aabd0b08d7febb138b, user.id=9e8ca6de226f4026b140147be570a9ae) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:54.842752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0aae77-8259-487b-b4ca-8210c5b1dce2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:54.844663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0aae77-8259-487b-b4ca-8210c5b1dce2 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:54.858126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 158/318] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:47:54 2022] GET /identity/v3/role_assignments?user.id=9e8ca6de226f4026b140147be570a9ae&scope.project.id=0dd67400813c49aabd0b08d7febb138b&role.id=822830288b154ed78764b4d57d45d813 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:55.226592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eca20-aea6-4618-a7ce-b4c272cc6e18 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:55.227002 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eca20-aea6-4618-a7ce-b4c272cc6e18 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:55.227179 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eca20-aea6-4618-a7ce-b4c272cc6e18 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:55.228816 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 161/319] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:55.233965 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce5269-7fc6-4304-aeb5-2ede6cb9757b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:55.234490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce5269-7fc6-4304-aeb5-2ede6cb9757b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:55.234777 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce5269-7fc6-4304-aeb5-2ede6cb9757b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:55.251546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-41ce5269-7fc6-4304-aeb5-2ede6cb9757b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:55.252732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-41ce5269-7fc6-4304-aeb5-2ede6cb9757b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:55.287417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309de717-3664-4e33-8091-d3aea4de096a None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:55.287718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309de717-3664-4e33-8091-d3aea4de096a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:55.287989 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309de717-3664-4e33-8091-d3aea4de096a None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:55.290486 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 162/320] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:55.295437 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ebd22-bb75-4458-9631-5dd56daab61f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:55.295725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ebd22-bb75-4458-9631-5dd56daab61f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:55.296003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ebd22-bb75-4458-9631-5dd56daab61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:55.312777 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-379ebd22-bb75-4458-9631-5dd56daab61f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:55.313985 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-379ebd22-bb75-4458-9631-5dd56daab61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:55.322039 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 159/321] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:55.344696 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce5269-7fc6-4304-aeb5-2ede6cb9757b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:55.392685 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 163/322] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:47:55.415164 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ebd22-bb75-4458-9631-5dd56daab61f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:55.430299 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:55.459769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce5269-7fc6-4304-aeb5-2ede6cb9757b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:55.469382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:55.495725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce9140-d6b3-4c2d-982a-76f3fa1b8c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:55.496439 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce9140-d6b3-4c2d-982a-76f3fa1b8c6a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:55.496716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce9140-d6b3-4c2d-982a-76f3fa1b8c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:55.496981 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce9140-d6b3-4c2d-982a-76f3fa1b8c6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:55.498160 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce9140-d6b3-4c2d-982a-76f3fa1b8c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:55.499603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce9140-d6b3-4c2d-982a-76f3fa1b8c6a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:55.501194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 160/323] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:47:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:55.502360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65954fb9-ac79-4ea0-81a7-d83fe3ce5f28 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:55.502637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65954fb9-ac79-4ea0-81a7-d83fe3ce5f28 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:55.502907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65954fb9-ac79-4ea0-81a7-d83fe3ce5f28 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:55.504110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 161/324] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:55.506559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65954fb9-ac79-4ea0-81a7-d83fe3ce5f28 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:55.521516 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ebd22-bb75-4458-9631-5dd56daab61f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:55.554948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3b2a7-da76-4286-a559-bc54a76a1990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:55.555728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3b2a7-da76-4286-a559-bc54a76a1990 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:55.556004 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3b2a7-da76-4286-a559-bc54a76a1990 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:55.556276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3b2a7-da76-4286-a559-bc54a76a1990 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:55.566327 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3b2a7-da76-4286-a559-bc54a76a1990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:55.573782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-7ed3b2a7-da76-4286-a559-bc54a76a1990 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:47:55.573782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:55.573782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:55.573782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:55.573782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:55.573782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:55.573782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:55.573782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:55.573782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:55.573782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:55.573782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:55.573782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:55.573782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:55.573782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:55.573782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:55.573782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:55.574906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:55.574906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:55.574906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:55.574906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:55.574906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:55.574906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:55.574906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:55.574906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:55.574906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:55.574906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:55.574906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:55.574906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:55.574906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:55.574906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:55.574906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:55.574906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:55.575913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:55.575913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:55.575913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:55.575913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:55.575913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:55.575913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:55.575913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:55.575913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:55.575913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:55.575913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:55.575913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:47:55.575913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:55.575913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 164/325] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:47:55.576633 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd691d8-2c9a-46ab-a42b-fdc78a8cd9dd None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:55.576633 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd691d8-2c9a-46ab-a42b-fdc78a8cd9dd None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:55.576930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd691d8-2c9a-46ab-a42b-fdc78a8cd9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:55.594072 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1fd691d8-2c9a-46ab-a42b-fdc78a8cd9dd None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:55.595221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1fd691d8-2c9a-46ab-a42b-fdc78a8cd9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:55.608076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65954fb9-ac79-4ea0-81a7-d83fe3ce5f28 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:55.641618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82b56a-3d6c-4c79-8cb1-d6f2e5d3947e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:55.642299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82b56a-3d6c-4c79-8cb1-d6f2e5d3947e None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:55.642576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82b56a-3d6c-4c79-8cb1-d6f2e5d3947e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:55.642849 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82b56a-3d6c-4c79-8cb1-d6f2e5d3947e None admin] PATH_INFO: `/v3/groups` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:55.643520 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82b56a-3d6c-4c79-8cb1-d6f2e5d3947e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:55.644956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82b56a-3d6c-4c79-8cb1-d6f2e5d3947e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:55.659368 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 162/326] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Jun 7 21:47:55 2022] POST /identity/v3/groups => generated 226 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:47:55.660162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82b56a-3d6c-4c79-8cb1-d6f2e5d3947e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:55.663651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 165/327] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:55.688426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd691d8-2c9a-46ab-a42b-fdc78a8cd9dd None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:55.690718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:55.706002 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:55.781966 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82b56a-3d6c-4c79-8cb1-d6f2e5d3947e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:55.816971 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fe924-287f-4da9-8141-2c054b45e9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:55.817659 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fe924-287f-4da9-8141-2c054b45e9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:55.817961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fe924-287f-4da9-8141-2c054b45e9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:55.818318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fe924-287f-4da9-8141-2c054b45e9a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:55.819080 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fe924-287f-4da9-8141-2c054b45e9a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:55.819384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fe924-287f-4da9-8141-2c054b45e9a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:55.820775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fe924-287f-4da9-8141-2c054b45e9a1 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:55.821755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd691d8-2c9a-46ab-a42b-fdc78a8cd9dd None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:55.834507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 163/328] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:55.835994 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fe924-287f-4da9-8141-2c054b45e9a1 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:55.859697 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b1515-71d4-4f90-9919-19a8cf320a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:55.860507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b1515-71d4-4f90-9919-19a8cf320a50 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:55.860787 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b1515-71d4-4f90-9919-19a8cf320a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:55.861056 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b1515-71d4-4f90-9919-19a8cf320a50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:55.873055 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b1515-71d4-4f90-9919-19a8cf320a50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:55.880894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-d72b1515-71d4-4f90-9919-19a8cf320a50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:55.880894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:55.880894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:55.880894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:55.880894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:55.880894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:55.880894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:55.880894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:55.880894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:55.880894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:55.880894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:55.880894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:55.880894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:55.880894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:55.880894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:55.880894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:55.881805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:55.881805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:55.881805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:55.881805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:55.881805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:55.881805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:55.881805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:55.881805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:55.881805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:55.881805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:55.881805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:55.881805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:55.881805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:55.881805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:55.881805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:55.881805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:55.882666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:55.882666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:55.882666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:55.882666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:55.882666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:55.882666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:55.882666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:55.882666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:55.882666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:55.882666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:55.882666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:55.882666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:55.882666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 166/329] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:47:55.887756 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b1515-71d4-4f90-9919-19a8cf320a50 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:55.945874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:55.951292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fe924-287f-4da9-8141-2c054b45e9a1 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:55.968559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:55.998126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4dc6ff-846d-457b-8c3f-5d5ee13a167c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:55.999244 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dc6ff-846d-457b-8c3f-5d5ee13a167c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:55.999708 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dc6ff-846d-457b-8c3f-5d5ee13a167c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:55.999989 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dc6ff-846d-457b-8c3f-5d5ee13a167c None admin] PATH_INFO: `/v3/users/87af63db11f144a19ff6d3711a79a9d7` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:56.001665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4dc6ff-846d-457b-8c3f-5d5ee13a167c None admin] RBAC: Authorizing `identity:get_user(user_id=87af63db11f144a19ff6d3711a79a9d7)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:56.003237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4dc6ff-846d-457b-8c3f-5d5ee13a167c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:56.005811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 164/330] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:55 2022] GET /identity/v3/users/87af63db11f144a19ff6d3711a79a9d7 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:56.011393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4dc6ff-846d-457b-8c3f-5d5ee13a167c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:56.018035 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b1515-71d4-4f90-9919-19a8cf320a50 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:56.059496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738cd07-86b2-4d72-a40f-2225ce12590e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:56.060390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738cd07-86b2-4d72-a40f-2225ce12590e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:56.060675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738cd07-86b2-4d72-a40f-2225ce12590e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:56.060946 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738cd07-86b2-4d72-a40f-2225ce12590e None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:56.061694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738cd07-86b2-4d72-a40f-2225ce12590e None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:56.062982 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738cd07-86b2-4d72-a40f-2225ce12590e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:56.063403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738cd07-86b2-4d72-a40f-2225ce12590e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:56.072484 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 167/331] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:56.078718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738cd07-86b2-4d72-a40f-2225ce12590e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:56.140323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4dc6ff-846d-457b-8c3f-5d5ee13a167c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:56.181608 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1c4b1-acc8-4822-aeff-190f854b481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:56.182880 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1c4b1-acc8-4822-aeff-190f854b481e None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:56.183356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1c4b1-acc8-4822-aeff-190f854b481e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:56.183895 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1c4b1-acc8-4822-aeff-190f854b481e None admin] PATH_INFO: `/v3/system/users/87af63db11f144a19ff6d3711a79a9d7/roles/822830288b154ed78764b4d57d45d813` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:56.185692 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1c4b1-acc8-4822-aeff-190f854b481e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=87af63db11f144a19ff6d3711a79a9d7, role_id=822830288b154ed78764b4d57d45d813)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:56.187397 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1c4b1-acc8-4822-aeff-190f854b481e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:56.198626 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 165/332] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Jun 7 21:47:56 2022] PUT /identity/v3/system/users/87af63db11f144a19ff6d3711a79a9d7/roles/822830288b154ed78764b4d57d45d813 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 21:47:56.214137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738cd07-86b2-4d72-a40f-2225ce12590e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:56.243250 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:56.256470 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311a12c-7a3a-493e-8015-5624b2ce2fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:56.257742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311a12c-7a3a-493e-8015-5624b2ce2fea None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:56.258258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311a12c-7a3a-493e-8015-5624b2ce2fea None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:56.258768 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311a12c-7a3a-493e-8015-5624b2ce2fea None admin] PATH_INFO: `/v3/users/cf6dabee3cfa48ea87bf64853f2770eb` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:56.261054 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311a12c-7a3a-493e-8015-5624b2ce2fea None admin] RBAC: Authorizing `identity:get_user(user_id=cf6dabee3cfa48ea87bf64853f2770eb)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:56.262826 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311a12c-7a3a-493e-8015-5624b2ce2fea None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:56.265056 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 168/333] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:47:56 2022] GET /identity/v3/users/cf6dabee3cfa48ea87bf64853f2770eb => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:56.271082 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1c4b1-acc8-4822-aeff-190f854b481e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:56.308231 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:56.394694 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1c4b1-acc8-4822-aeff-190f854b481e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:56.432503 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942accc7-222f-4f9f-9f3b-5469aeb7e8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:56.433160 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942accc7-222f-4f9f-9f3b-5469aeb7e8ef None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:56.433441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942accc7-222f-4f9f-9f3b-5469aeb7e8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:56.433716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942accc7-222f-4f9f-9f3b-5469aeb7e8ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:56.434579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942accc7-222f-4f9f-9f3b-5469aeb7e8ef None admin] RBAC: Adding query filter params (role.id=01ccb434cf384bc79bf82f49b697f1ce, user.id=cf6dabee3cfa48ea87bf64853f2770eb, scope.system=all) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:56.434882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942accc7-222f-4f9f-9f3b-5469aeb7e8ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:56.436319 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942accc7-222f-4f9f-9f3b-5469aeb7e8ef None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:56.449977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 166/334] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jun 7 21:47:56 2022] GET /identity/v3/role_assignments?user.id=cf6dabee3cfa48ea87bf64853f2770eb&scope.system=all&role.id=01ccb434cf384bc79bf82f49b697f1ce => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:58.524126 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb174a1e-d837-4c2e-b9a8-a54edd42d29d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:58.524648 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb174a1e-d837-4c2e-b9a8-a54edd42d29d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:58.524723 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb174a1e-d837-4c2e-b9a8-a54edd42d29d None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:58.526531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 169/335] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:58.532019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708e05f-ddf2-404f-b4fb-46bdad9be4d9 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:58.532500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708e05f-ddf2-404f-b4fb-46bdad9be4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:58.532573 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708e05f-ddf2-404f-b4fb-46bdad9be4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:58.550479 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929901fc-b491-4598-a6c4-9b2ea8e7014a None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:58.550777 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929901fc-b491-4598-a6c4-9b2ea8e7014a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:58.551041 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929901fc-b491-4598-a6c4-9b2ea8e7014a None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:58.552693 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 170/336] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:58.553813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c708e05f-ddf2-404f-b4fb-46bdad9be4d9 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:58.555100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c708e05f-ddf2-404f-b4fb-46bdad9be4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:58.558152 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64900b3a-3acb-493f-92b5-8d08c92e2df0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:58.558439 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64900b3a-3acb-493f-92b5-8d08c92e2df0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:58.558712 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64900b3a-3acb-493f-92b5-8d08c92e2df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:58.594967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-64900b3a-3acb-493f-92b5-8d08c92e2df0 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:58.596174 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-64900b3a-3acb-493f-92b5-8d08c92e2df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:58.646958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 167/337] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:58.718106 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 171/338] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:58.735939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708e05f-ddf2-404f-b4fb-46bdad9be4d9 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:58.745847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64900b3a-3acb-493f-92b5-8d08c92e2df0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:58.767464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:58.889102 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64900b3a-3acb-493f-92b5-8d08c92e2df0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:58.919360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708e05f-ddf2-404f-b4fb-46bdad9be4d9 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:58.923399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:58.946135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b4224-7d83-4d67-b37c-eead8c551630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:58.946937 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b4224-7d83-4d67-b37c-eead8c551630 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:58.947217 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b4224-7d83-4d67-b37c-eead8c551630 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:58.948106 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b4224-7d83-4d67-b37c-eead8c551630 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:58.960741 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211b3d0-a592-4820-9228-68b58354e6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:58.961555 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211b3d0-a592-4820-9228-68b58354e6fe None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:58.961829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211b3d0-a592-4820-9228-68b58354e6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:58.962243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211b3d0-a592-4820-9228-68b58354e6fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:58.967319 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b4224-7d83-4d67-b37c-eead8c551630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:58.972881 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211b3d0-a592-4820-9228-68b58354e6fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:58.980045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-983b4224-7d83-4d67-b37c-eead8c551630 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:58.980045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:58.980045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:58.980045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:58.980045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:58.980045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:58.980045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:58.980045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:58.980045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:58.980045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:58.980045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:58.980045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:58.980045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:58.980045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:58.980045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:58.980045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:58.982143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:58.982143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:58.982143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:58.982143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:58.982143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:58.982143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:58.982143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:58.982143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:58.982143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:58.982143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:58.982143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:58.982143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:58.982143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:58.982143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:58.982143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:58.982143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:58.984058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:58.984058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:58.984058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:58.984058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:58.984058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:58.984058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:58.984058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:58.984058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:58.984058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:58.984058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:58.984058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:47:58.984058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:47:58.984058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 172/339] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:47:58.985617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-9211b3d0-a592-4820-9228-68b58354e6fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:47:58.985617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:58.985617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:58.985617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:58.985617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:58.985617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:58.985617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:58.985617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:58.985617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:58.985617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:58.985617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:58.985617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:58.985617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:58.985617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:58.985617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:58.985617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:58.990896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:58.990896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:58.990896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:58.990896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:58.990896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:58.990896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:58.990896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:58.990896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:58.990896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:58.990896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:58.990896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:58.990896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:58.990896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:58.990896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:58.990896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:58.990896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:47:58.992794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:47:58.992794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:47:58.992794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:47:58.992794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:47:58.992794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:47:58.992794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:47:58.992794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:47:58.992794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:47:58.992794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:47:58.992794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:47:58.992794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:47:58.992794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:47:58.992794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 168/340] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:47:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:47:58.998478 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b4224-7d83-4d67-b37c-eead8c551630 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:58.998627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211b3d0-a592-4820-9228-68b58354e6fe None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:59.110901 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:59.118336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211b3d0-a592-4820-9228-68b58354e6fe None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:59.156064 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c99c88-a56b-4ac6-9908-efe5c524fb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:59.156736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c99c88-a56b-4ac6-9908-efe5c524fb05 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:59.157015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c99c88-a56b-4ac6-9908-efe5c524fb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:59.157288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c99c88-a56b-4ac6-9908-efe5c524fb05 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:59.158084 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c99c88-a56b-4ac6-9908-efe5c524fb05 None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:59.158392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c99c88-a56b-4ac6-9908-efe5c524fb05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:59.159876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c99c88-a56b-4ac6-9908-efe5c524fb05 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:59.169339 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 169/341] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:47:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:59.176084 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c99c88-a56b-4ac6-9908-efe5c524fb05 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:59.198147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b4224-7d83-4d67-b37c-eead8c551630 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:59.266150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a3b8d-442d-44f5-99b6-ada55a207642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:59.266824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a3b8d-442d-44f5-99b6-ada55a207642 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:59.267101 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a3b8d-442d-44f5-99b6-ada55a207642 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:59.267372 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a3b8d-442d-44f5-99b6-ada55a207642 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:59.268123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a3b8d-442d-44f5-99b6-ada55a207642 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:47:59.268513 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a3b8d-442d-44f5-99b6-ada55a207642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:59.270184 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a3b8d-442d-44f5-99b6-ada55a207642 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:59.284400 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 173/342] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:47:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:47:59.286126 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488e4ae-704a-4fec-90a4-19a221fd3409 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:59.286427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488e4ae-704a-4fec-90a4-19a221fd3409 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:59.286701 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488e4ae-704a-4fec-90a4-19a221fd3409 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:59.288287 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 174/343] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:59.293919 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488e4ae-704a-4fec-90a4-19a221fd3409 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:59.328313 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c99c88-a56b-4ac6-9908-efe5c524fb05 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:59.364898 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:59.365111 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c55c5-78f7-4d58-9290-802f48d9cfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:59.365677 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c55c5-78f7-4d58-9290-802f48d9cfd3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:59.365677 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c55c5-78f7-4d58-9290-802f48d9cfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:59.365938 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c55c5-78f7-4d58-9290-802f48d9cfd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:59.378832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:59.445243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c55c5-78f7-4d58-9290-802f48d9cfd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:59.449949 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c55c5-78f7-4d58-9290-802f48d9cfd3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:59.456171 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488e4ae-704a-4fec-90a4-19a221fd3409 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:59.507674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477af3a4-0177-46cd-94ba-f19f55629a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:59.508652 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477af3a4-0177-46cd-94ba-f19f55629a08 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:59.509070 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477af3a4-0177-46cd-94ba-f19f55629a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:59.509487 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477af3a4-0177-46cd-94ba-f19f55629a08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:59.555567 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 170/344] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 21:47:59.557053 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835d1c8-2e09-41da-90b4-2643c339ce2e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:59.557306 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835d1c8-2e09-41da-90b4-2643c339ce2e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:59.557578 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835d1c8-2e09-41da-90b4-2643c339ce2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:59.577179 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1835d1c8-2e09-41da-90b4-2643c339ce2e None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:47:59.578811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1835d1c8-2e09-41da-90b4-2643c339ce2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:47:59.620049 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:59.632050 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477af3a4-0177-46cd-94ba-f19f55629a08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:59.634108 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477af3a4-0177-46cd-94ba-f19f55629a08 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:59.656890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 171/345] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:47:59.657563 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835d1c8-2e09-41da-90b4-2643c339ce2e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:59.738886 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:59.785056 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835d1c8-2e09-41da-90b4-2643c339ce2e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:59.803290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 175/346] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:47:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 21:47:59.804284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477af3a4-0177-46cd-94ba-f19f55629a08 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:59.829263 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d3563-3068-4713-99f4-a83b1710ff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:59.830894 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d3563-3068-4713-99f4-a83b1710ff7c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:59.831176 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d3563-3068-4713-99f4-a83b1710ff7c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:59.831453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d3563-3068-4713-99f4-a83b1710ff7c None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:59.834031 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d3563-3068-4713-99f4-a83b1710ff7c None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:47:59.835527 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d3563-3068-4713-99f4-a83b1710ff7c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:47:59.837831 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 172/347] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:59 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:47:59.840136 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16525b9-cc81-4cc3-a8cc-f9b1c1ca9dc6 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:59.840421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16525b9-cc81-4cc3-a8cc-f9b1c1ca9dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:59.840696 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16525b9-cc81-4cc3-a8cc-f9b1c1ca9dc6 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:59.842606 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 173/348] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:47:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:47:59.847512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16525b9-cc81-4cc3-a8cc-f9b1c1ca9dc6 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:47:59.910321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:47:59.936036 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477af3a4-0177-46cd-94ba-f19f55629a08 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:59.973961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16525b9-cc81-4cc3-a8cc-f9b1c1ca9dc6 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:47:59.974474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146e74a-b7d4-498d-aca8-9e0b97a2bdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:47:59.975525 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146e74a-b7d4-498d-aca8-9e0b97a2bdeb None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:47:59.975809 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146e74a-b7d4-498d-aca8-9e0b97a2bdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:47:59.976085 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146e74a-b7d4-498d-aca8-9e0b97a2bdeb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:47:59.989287 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146e74a-b7d4-498d-aca8-9e0b97a2bdeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:47:59.998262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-d146e74a-b7d4-498d-aca8-9e0b97a2bdeb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:47:59.998262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:47:59.998262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:47:59.998262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:47:59.998262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:47:59.998262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:47:59.998262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:47:59.998262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:47:59.998262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:47:59.998262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:47:59.998262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:47:59.998262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:47:59.998262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:47:59.998262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:47:59.998262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:47:59.998262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:47:59.999221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:47:59.999221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:47:59.999221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:47:59.999221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:47:59.999221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:47:59.999221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:47:59.999221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:47:59.999221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:47:59.999221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:47:59.999221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:47:59.999221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:47:59.999221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:47:59.999221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:47:59.999221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:47:59.999221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:47:59.999221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:00.000069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:00.000069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:00.000069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:00.000069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:00.000069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:00.000069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:00.000069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:00.000069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:00.000069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:00.000069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:00.000069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 21:48:00.000069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:00.000069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 176/349] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:47:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:00.001299 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146e74a-b7d4-498d-aca8-9e0b97a2bdeb None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:00.006083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:00.022602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3a588-a04e-44a1-9d19-b6a702683010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:00.024273 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3a588-a04e-44a1-9d19-b6a702683010 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:00.025014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3a588-a04e-44a1-9d19-b6a702683010 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:00.025500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3a588-a04e-44a1-9d19-b6a702683010 None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:00.027568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3a588-a04e-44a1-9d19-b6a702683010 None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:00.029233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3a588-a04e-44a1-9d19-b6a702683010 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:00.032269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 174/350] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:47:59 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:00.033919 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80b8b0-90d6-40ff-a7d0-d18fd39b7373 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:00.034848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80b8b0-90d6-40ff-a7d0-d18fd39b7373 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:00.035584 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80b8b0-90d6-40ff-a7d0-d18fd39b7373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:00.056014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7e80b8b0-90d6-40ff-a7d0-d18fd39b7373 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:00.058484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7e80b8b0-90d6-40ff-a7d0-d18fd39b7373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:00.121432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146e74a-b7d4-498d-aca8-9e0b97a2bdeb None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:00.146913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 175/351] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:00.148090 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80b8b0-90d6-40ff-a7d0-d18fd39b7373 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:00.167588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56777e83-05ba-473c-8d0a-fde621996d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:00.168432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56777e83-05ba-473c-8d0a-fde621996d8d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:00.168712 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56777e83-05ba-473c-8d0a-fde621996d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:00.169036 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56777e83-05ba-473c-8d0a-fde621996d8d None admin] PATH_INFO: `/v3/groups/b864a58f705e4f61809d17bb821e9685` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:00.176793 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56777e83-05ba-473c-8d0a-fde621996d8d None admin] RBAC: Authorizing `identity:get_group(group_id=b864a58f705e4f61809d17bb821e9685)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:00.178316 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56777e83-05ba-473c-8d0a-fde621996d8d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:00.180006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 177/352] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 7 21:47:59 2022] GET /identity/v3/groups/b864a58f705e4f61809d17bb821e9685 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:00.181091 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56777e83-05ba-473c-8d0a-fde621996d8d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:00.194590 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:00.257522 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:00.272774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80b8b0-90d6-40ff-a7d0-d18fd39b7373 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:00.297695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56777e83-05ba-473c-8d0a-fde621996d8d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:00.315662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b26965-723c-40a9-aced-df5eeabc43fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:00.316534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b26965-723c-40a9-aced-df5eeabc43fe None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:00.316893 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b26965-723c-40a9-aced-df5eeabc43fe None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:00.317236 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b26965-723c-40a9-aced-df5eeabc43fe None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:00.318012 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b26965-723c-40a9-aced-df5eeabc43fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:00.318318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b26965-723c-40a9-aced-df5eeabc43fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:00.319701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b26965-723c-40a9-aced-df5eeabc43fe None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:00.329595 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 176/353] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:48:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:00.330984 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad5e7b-f6ee-42ff-bbce-b2ca701b3190 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:00.331275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad5e7b-f6ee-42ff-bbce-b2ca701b3190 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:00.331554 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad5e7b-f6ee-42ff-bbce-b2ca701b3190 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:00.332787 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 177/354] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:00.333460 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad5e7b-f6ee-42ff-bbce-b2ca701b3190 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:00.343102 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4f3eb-0019-4e32-96aa-fcf68f5b7c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:00.343969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4f3eb-0019-4e32-96aa-fcf68f5b7c71 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:00.344251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4f3eb-0019-4e32-96aa-fcf68f5b7c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:00.344522 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4f3eb-0019-4e32-96aa-fcf68f5b7c71 None admin] PATH_INFO: `/v3/groups/b864a58f705e4f61809d17bb821e9685` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:00.346407 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4f3eb-0019-4e32-96aa-fcf68f5b7c71 None admin] RBAC: Authorizing `identity:get_group(group_id=b864a58f705e4f61809d17bb821e9685)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:00.347882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4f3eb-0019-4e32-96aa-fcf68f5b7c71 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:00.350483 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 178/355] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 7 21:48:00 2022] GET /identity/v3/groups/b864a58f705e4f61809d17bb821e9685 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:00.351781 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4f3eb-0019-4e32-96aa-fcf68f5b7c71 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:00.459526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:00.465571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad5e7b-f6ee-42ff-bbce-b2ca701b3190 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:00.499040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4f3eb-0019-4e32-96aa-fcf68f5b7c71 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:00.503763 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df60243-cec3-434b-98a7-13cbf9e48a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:00.504607 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60243-cec3-434b-98a7-13cbf9e48a35 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:00.504910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60243-cec3-434b-98a7-13cbf9e48a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:00.505187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60243-cec3-434b-98a7-13cbf9e48a35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:00.516983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df60243-cec3-434b-98a7-13cbf9e48a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:00.527750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-9df60243-cec3-434b-98a7-13cbf9e48a35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:48:00.527750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:00.527750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:00.527750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:00.527750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:00.527750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:00.527750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:00.527750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:00.527750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:00.527750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:00.527750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:00.527750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:00.527750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:00.527750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:00.527750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:00.527750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:00.528678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:00.528678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:00.528678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:00.528678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:00.528678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:00.528678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:00.528678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:00.528678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:00.528678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:00.528678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:00.528678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:00.528678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:00.528678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:00.528678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:00.528678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:00.528678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:00.529458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:00.529458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:00.529458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:00.529458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:00.529458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:00.529458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:00.529458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:00.529458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:00.529458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:00.529458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:00.529458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:48:00.529458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:00.533311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 178/356] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:00.534235 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df60243-cec3-434b-98a7-13cbf9e48a35 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:00.554185 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0131ec-df23-4b99-aa29-4003da847830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:00.555115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0131ec-df23-4b99-aa29-4003da847830 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:00.555407 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0131ec-df23-4b99-aa29-4003da847830 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:00.555928 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0131ec-df23-4b99-aa29-4003da847830 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:00.557727 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0131ec-df23-4b99-aa29-4003da847830 None admin] RBAC: Adding query filter params (group.id=b864a58f705e4f61809d17bb821e9685, role.id=01ccb434cf384bc79bf82f49b697f1ce, scope.project.id=eb30985c7f9f457095a0e5e03ed6954c) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:00.559278 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0131ec-df23-4b99-aa29-4003da847830 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:00.559521 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0131ec-df23-4b99-aa29-4003da847830 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:00.563522 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:00.569828 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 179/357] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 7 21:48:00 2022] GET /identity/v3/role_assignments?group.id=b864a58f705e4f61809d17bb821e9685&scope.project.id=eb30985c7f9f457095a0e5e03ed6954c&role.id=01ccb434cf384bc79bf82f49b697f1ce => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:00.570019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb4b07-50ac-4592-acab-d34dcf248c56 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:00.574017 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb4b07-50ac-4592-acab-d34dcf248c56 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:00.574017 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb4b07-50ac-4592-acab-d34dcf248c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:00.600818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d5eb4b07-50ac-4592-acab-d34dcf248c56 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:00.602399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d5eb4b07-50ac-4592-acab-d34dcf248c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:00.656702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df60243-cec3-434b-98a7-13cbf9e48a35 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:00.695211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72790ca-027f-44ed-a932-4fe88a550259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:00.695903 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 180/358] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:00.696328 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72790ca-027f-44ed-a932-4fe88a550259 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:00.696502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72790ca-027f-44ed-a932-4fe88a550259 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:00.696771 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb4b07-50ac-4592-acab-d34dcf248c56 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:00.696866 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72790ca-027f-44ed-a932-4fe88a550259 None admin] PATH_INFO: `/v3/users/87af63db11f144a19ff6d3711a79a9d7` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:00.698096 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72790ca-027f-44ed-a932-4fe88a550259 None admin] RBAC: Authorizing `identity:get_user(user_id=87af63db11f144a19ff6d3711a79a9d7)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:00.699583 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72790ca-027f-44ed-a932-4fe88a550259 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:00.701532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 179/359] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:48:00 2022] GET /identity/v3/users/87af63db11f144a19ff6d3711a79a9d7 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:00.702393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72790ca-027f-44ed-a932-4fe88a550259 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:00.738894 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:00.823769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb4b07-50ac-4592-acab-d34dcf248c56 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:00.826775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72790ca-027f-44ed-a932-4fe88a550259 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:00.868703 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892037fa-a685-4aac-85bc-3e23bc82a182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:00.870189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892037fa-a685-4aac-85bc-3e23bc82a182 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:00.870629 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892037fa-a685-4aac-85bc-3e23bc82a182 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:00.871056 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892037fa-a685-4aac-85bc-3e23bc82a182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:00.872027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892037fa-a685-4aac-85bc-3e23bc82a182 None admin] RBAC: Adding query filter params (group.id=b864a58f705e4f61809d17bb821e9685, role.id=73d4eafa268f4cc3aca4863c73b794ae, scope.project.id=eb30985c7f9f457095a0e5e03ed6954c) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:00.872286 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d33434-e9aa-4f2f-a042-12762fd99824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:00.872964 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d33434-e9aa-4f2f-a042-12762fd99824 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:00.873247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d33434-e9aa-4f2f-a042-12762fd99824 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:00.873568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d33434-e9aa-4f2f-a042-12762fd99824 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:00.874605 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d33434-e9aa-4f2f-a042-12762fd99824 None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:00.874735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d33434-e9aa-4f2f-a042-12762fd99824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:00.875061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:00.876042 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d33434-e9aa-4f2f-a042-12762fd99824 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:00.876331 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892037fa-a685-4aac-85bc-3e23bc82a182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:00.878195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892037fa-a685-4aac-85bc-3e23bc82a182 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:00.885786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 181/360] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 7 21:48:00 2022] GET /identity/v3/role_assignments?group.id=b864a58f705e4f61809d17bb821e9685&scope.project.id=eb30985c7f9f457095a0e5e03ed6954c&role.id=73d4eafa268f4cc3aca4863c73b794ae => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:00.886882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892037fa-a685-4aac-85bc-3e23bc82a182 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:00.887150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 180/361] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:48:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:00.891920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d33434-e9aa-4f2f-a042-12762fd99824 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:01.036554 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:01.052474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d33434-e9aa-4f2f-a042-12762fd99824 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:01.085487 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892037fa-a685-4aac-85bc-3e23bc82a182 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:01.116209 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f4dc2-eaa0-41f2-b2ca-b86e1df1eefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:01.117034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f4dc2-eaa0-41f2-b2ca-b86e1df1eefa None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:01.117313 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f4dc2-eaa0-41f2-b2ca-b86e1df1eefa None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:01.117584 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f4dc2-eaa0-41f2-b2ca-b86e1df1eefa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:01.137210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f4dc2-eaa0-41f2-b2ca-b86e1df1eefa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:01.139828 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa28de-2ddc-4c68-a9ca-76f2944f803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:01.140727 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa28de-2ddc-4c68-a9ca-76f2944f803d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:01.141212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa28de-2ddc-4c68-a9ca-76f2944f803d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:01.141690 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa28de-2ddc-4c68-a9ca-76f2944f803d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:01.142783 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa28de-2ddc-4c68-a9ca-76f2944f803d None admin] RBAC: Adding query filter params (role.id=822830288b154ed78764b4d57d45d813, user.id=87af63db11f144a19ff6d3711a79a9d7, scope.system=all) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:01.143288 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa28de-2ddc-4c68-a9ca-76f2944f803d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:01.144927 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa28de-2ddc-4c68-a9ca-76f2944f803d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:01.149603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-496f4dc2-eaa0-41f2-b2ca-b86e1df1eefa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:48:01.149603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:01.149603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:01.149603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:01.149603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:01.149603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:01.149603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:01.149603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:01.149603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:01.149603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:01.149603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:01.149603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:01.149603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:01.149603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:01.149603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:01.149603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:01.150543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:01.150543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:01.150543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:01.150543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:01.150543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:01.150543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:01.150543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:01.150543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:01.150543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:01.150543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:01.150543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:01.150543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:01.150543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:01.150543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:01.150543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:01.150543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:01.151380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:01.151380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:01.151380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:01.151380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:01.151380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:01.151380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:01.151380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:01.151380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:01.151380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:01.151380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:01.151380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:48:01.151380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:01.151380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 181/362] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:48:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:01.152060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f4dc2-eaa0-41f2-b2ca-b86e1df1eefa None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:01.164437 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 182/363] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jun 7 21:48:00 2022] GET /identity/v3/role_assignments?user.id=87af63db11f144a19ff6d3711a79a9d7&scope.system=all&role.id=822830288b154ed78764b4d57d45d813 => generated 510 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:01.166946 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa28de-2ddc-4c68-a9ca-76f2944f803d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:01.252529 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:01.318277 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f4dc2-eaa0-41f2-b2ca-b86e1df1eefa None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:01.324653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa28de-2ddc-4c68-a9ca-76f2944f803d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:01.388143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fddbe-7d97-47c2-a0f8-09124868307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:01.388815 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fddbe-7d97-47c2-a0f8-09124868307b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:01.389102 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fddbe-7d97-47c2-a0f8-09124868307b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:01.389379 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fddbe-7d97-47c2-a0f8-09124868307b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:01.391830 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98520cd6-2e38-4e7e-a82b-d93bf69ce662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:01.392516 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98520cd6-2e38-4e7e-a82b-d93bf69ce662 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:01.392793 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98520cd6-2e38-4e7e-a82b-d93bf69ce662 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:01.393068 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98520cd6-2e38-4e7e-a82b-d93bf69ce662 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:01.393835 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98520cd6-2e38-4e7e-a82b-d93bf69ce662 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:01.394167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98520cd6-2e38-4e7e-a82b-d93bf69ce662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:01.395590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98520cd6-2e38-4e7e-a82b-d93bf69ce662 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:01.416532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 183/364] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:01.417827 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41195ac1-b1f1-4a68-a203-bd6e91193beb None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:01.418049 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41195ac1-b1f1-4a68-a203-bd6e91193beb None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:01.418326 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41195ac1-b1f1-4a68-a203-bd6e91193beb None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:01.420216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 184/365] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:01.423268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41195ac1-b1f1-4a68-a203-bd6e91193beb None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:01.431635 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:01.508697 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fddbe-7d97-47c2-a0f8-09124868307b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:01.510236 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fddbe-7d97-47c2-a0f8-09124868307b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:01.573753 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41195ac1-b1f1-4a68-a203-bd6e91193beb None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:01.591212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:01.617488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 182/366] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:01.617886 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424be95b-37b2-447c-abf6-389b59464992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:01.618730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99d967-5f8b-4cbe-85f6-63cbd9753fdd None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:01.619015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99d967-5f8b-4cbe-85f6-63cbd9753fdd None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:01.619224 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424be95b-37b2-447c-abf6-389b59464992 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:01.619867 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99d967-5f8b-4cbe-85f6-63cbd9753fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:01.620345 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424be95b-37b2-447c-abf6-389b59464992 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:01.620824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424be95b-37b2-447c-abf6-389b59464992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:01.636843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0f99d967-5f8b-4cbe-85f6-63cbd9753fdd None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:01.638055 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0f99d967-5f8b-4cbe-85f6-63cbd9753fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:01.695450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:01.703795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424be95b-37b2-447c-abf6-389b59464992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:01.705748 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424be95b-37b2-447c-abf6-389b59464992 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:01.726113 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 183/367] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:01.727302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99d967-5f8b-4cbe-85f6-63cbd9753fdd None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:01.845095 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 185/368] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:01.846562 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424be95b-37b2-447c-abf6-389b59464992 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:01.849242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99d967-5f8b-4cbe-85f6-63cbd9753fdd None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:01.864546 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:01.893797 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3e80c-7721-49d7-bd58-161d889d2a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:01.894621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3e80c-7721-49d7-bd58-161d889d2a06 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:01.894900 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3e80c-7721-49d7-bd58-161d889d2a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:01.895171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3e80c-7721-49d7-bd58-161d889d2a06 None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:01.896357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3e80c-7721-49d7-bd58-161d889d2a06 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:01.897802 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3e80c-7721-49d7-bd58-161d889d2a06 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:01.900255 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 184/369] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:48:01 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:01.901618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3e80c-7721-49d7-bd58-161d889d2a06 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:01.967976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:01.992638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424be95b-37b2-447c-abf6-389b59464992 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:02.038346 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3e80c-7721-49d7-bd58-161d889d2a06 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:02.038836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b5051-145d-41fc-9a3c-d61d1c77cd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:02.039649 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b5051-145d-41fc-9a3c-d61d1c77cd25 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:02.040241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b5051-145d-41fc-9a3c-d61d1c77cd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:02.040518 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b5051-145d-41fc-9a3c-d61d1c77cd25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:02.055294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b5051-145d-41fc-9a3c-d61d1c77cd25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:02.065059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-a17b5051-145d-41fc-9a3c-d61d1c77cd25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:02.065059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:02.065059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:02.065059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:02.065059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:02.065059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:02.065059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:02.065059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:02.065059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:02.065059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:02.065059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:02.065059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:02.065059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:02.065059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:02.065059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:02.065059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:02.066020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:02.066020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:02.066020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:02.066020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:02.066020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:02.066020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:02.066020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:02.066020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:02.066020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:02.066020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:02.066020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:02.066020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:02.066020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:02.066020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:02.066020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:02.066020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:02.066823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:02.066823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:02.066823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:02.066823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:02.066823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:02.066823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:02.066823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:02.066823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:02.066823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:02.066823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:02.066823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:02.066823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:02.067434 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 186/370] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:48:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:02.069959 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b5051-145d-41fc-9a3c-d61d1c77cd25 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:02.079938 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ac121-d9bf-41a0-a811-2cb56e7b1edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:02.080892 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ac121-d9bf-41a0-a811-2cb56e7b1edd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:02.081172 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ac121-d9bf-41a0-a811-2cb56e7b1edd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:02.081444 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ac121-d9bf-41a0-a811-2cb56e7b1edd None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:02.082752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ac121-d9bf-41a0-a811-2cb56e7b1edd None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:02.084369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ac121-d9bf-41a0-a811-2cb56e7b1edd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:02.086494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 185/371] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:48:01 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:02.087251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ac121-d9bf-41a0-a811-2cb56e7b1edd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:02.160166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:02.188868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b5051-145d-41fc-9a3c-d61d1c77cd25 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:02.202440 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ac121-d9bf-41a0-a811-2cb56e7b1edd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:02.217860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:02.226314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb704d26-1751-403b-9c6c-429690a0c03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:02.227178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb704d26-1751-403b-9c6c-429690a0c03a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:02.227458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb704d26-1751-403b-9c6c-429690a0c03a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:02.227736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb704d26-1751-403b-9c6c-429690a0c03a None admin] PATH_INFO: `/v3/groups/b864a58f705e4f61809d17bb821e9685` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:02.228936 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb704d26-1751-403b-9c6c-429690a0c03a None admin] RBAC: Authorizing `identity:get_group(group_id=b864a58f705e4f61809d17bb821e9685)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:02.230409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb704d26-1751-403b-9c6c-429690a0c03a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:02.238810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 187/372] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 7 21:48:02 2022] GET /identity/v3/groups/b864a58f705e4f61809d17bb821e9685 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:02.238960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb704d26-1751-403b-9c6c-429690a0c03a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:02.242189 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6c51a-e637-428a-821a-d2e1a57cb906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:02.243149 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6c51a-e637-428a-821a-d2e1a57cb906 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:02.243614 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6c51a-e637-428a-821a-d2e1a57cb906 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:02.244072 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6c51a-e637-428a-821a-d2e1a57cb906 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:02.245525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6c51a-e637-428a-821a-d2e1a57cb906 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:02.246038 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6c51a-e637-428a-821a-d2e1a57cb906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:02.247771 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6c51a-e637-428a-821a-d2e1a57cb906 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:02.257165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 186/373] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:02.258326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6c51a-e637-428a-821a-d2e1a57cb906 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:02.342933 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb704d26-1751-403b-9c6c-429690a0c03a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:02.368390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6c51a-e637-428a-821a-d2e1a57cb906 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:02.378573 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cedeb2-c52a-408a-bd58-f4e70a14a891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:02.379624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cedeb2-c52a-408a-bd58-f4e70a14a891 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:02.379732 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cedeb2-c52a-408a-bd58-f4e70a14a891 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:02.379952 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cedeb2-c52a-408a-bd58-f4e70a14a891 None admin] PATH_INFO: `/v3/groups/b864a58f705e4f61809d17bb821e9685` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:02.381111 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cedeb2-c52a-408a-bd58-f4e70a14a891 None admin] RBAC: Authorizing `identity:get_group(group_id=b864a58f705e4f61809d17bb821e9685)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:02.382657 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cedeb2-c52a-408a-bd58-f4e70a14a891 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:02.384268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 188/374] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 7 21:48:02 2022] GET /identity/v3/groups/b864a58f705e4f61809d17bb821e9685 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:02.384980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cedeb2-c52a-408a-bd58-f4e70a14a891 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:02.404482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:02.412660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622452a0-4d5b-411c-b0c6-943c09b90492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:02.413594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622452a0-4d5b-411c-b0c6-943c09b90492 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:02.414077 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622452a0-4d5b-411c-b0c6-943c09b90492 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:02.414542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622452a0-4d5b-411c-b0c6-943c09b90492 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:02.415658 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622452a0-4d5b-411c-b0c6-943c09b90492 None admin] RBAC: Adding query filter params (group.id=b864a58f705e4f61809d17bb821e9685, role.id=01ccb434cf384bc79bf82f49b697f1ce, scope.project.id=0dd67400813c49aabd0b08d7febb138b) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:02.416139 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622452a0-4d5b-411c-b0c6-943c09b90492 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:02.418451 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622452a0-4d5b-411c-b0c6-943c09b90492 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:02.425051 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 187/375] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 7 21:48:02 2022] GET /identity/v3/role_assignments?group.id=b864a58f705e4f61809d17bb821e9685&scope.project.id=0dd67400813c49aabd0b08d7febb138b&role.id=01ccb434cf384bc79bf82f49b697f1ce => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:02.426207 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622452a0-4d5b-411c-b0c6-943c09b90492 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:02.475045 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:02.504229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cedeb2-c52a-408a-bd58-f4e70a14a891 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:02.538891 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2e9f7-8476-403e-9b68-a306f43a0357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:02.539549 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2e9f7-8476-403e-9b68-a306f43a0357 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:02.539829 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2e9f7-8476-403e-9b68-a306f43a0357 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:02.540107 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2e9f7-8476-403e-9b68-a306f43a0357 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:02.545516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622452a0-4d5b-411c-b0c6-943c09b90492 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:02.584581 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f77cc-6eb2-47e3-b9f0-d3f723cd3578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:02.585598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f77cc-6eb2-47e3-b9f0-d3f723cd3578 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:02.586275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f77cc-6eb2-47e3-b9f0-d3f723cd3578 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:02.586722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f77cc-6eb2-47e3-b9f0-d3f723cd3578 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:02.587861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f77cc-6eb2-47e3-b9f0-d3f723cd3578 None admin] RBAC: Adding query filter params (group.id=b864a58f705e4f61809d17bb821e9685, role.id=73d4eafa268f4cc3aca4863c73b794ae, scope.project.id=0dd67400813c49aabd0b08d7febb138b) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:02.588412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f77cc-6eb2-47e3-b9f0-d3f723cd3578 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:02.590157 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f77cc-6eb2-47e3-b9f0-d3f723cd3578 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:02.597171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 188/376] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 7 21:48:02 2022] GET /identity/v3/role_assignments?group.id=b864a58f705e4f61809d17bb821e9685&scope.project.id=0dd67400813c49aabd0b08d7febb138b&role.id=73d4eafa268f4cc3aca4863c73b794ae => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:02.621438 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2e9f7-8476-403e-9b68-a306f43a0357 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:02.622938 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2e9f7-8476-403e-9b68-a306f43a0357 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:02.640548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:02.750533 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 189/377] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:02.756161 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f77cc-6eb2-47e3-b9f0-d3f723cd3578 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:02.869905 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f77cc-6eb2-47e3-b9f0-d3f723cd3578 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:02.872766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:02.919109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624dcea-f9a3-4bce-871a-1687c905294d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:02.920006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624dcea-f9a3-4bce-871a-1687c905294d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:02.920279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624dcea-f9a3-4bce-871a-1687c905294d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:02.920550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624dcea-f9a3-4bce-871a-1687c905294d None admin] PATH_INFO: `/v3/projects/d15d054b930a4d03bfa50272128a53b7` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:02.921809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624dcea-f9a3-4bce-871a-1687c905294d None admin] RBAC: Authorizing `identity:get_project(project_id=d15d054b930a4d03bfa50272128a53b7)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:02.923339 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624dcea-f9a3-4bce-871a-1687c905294d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:02.925428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 189/378] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:48:02 2022] GET /identity/v3/projects/d15d054b930a4d03bfa50272128a53b7 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:02.930855 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2e9f7-8476-403e-9b68-a306f43a0357 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:03.059885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2e9f7-8476-403e-9b68-a306f43a0357 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:03.075459 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:03.106311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b89b6-11c9-49ed-94b2-1de1df43ae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:03.107326 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b89b6-11c9-49ed-94b2-1de1df43ae67 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:03.107615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b89b6-11c9-49ed-94b2-1de1df43ae67 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:03.107894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b89b6-11c9-49ed-94b2-1de1df43ae67 None admin] PATH_INFO: `/v3/groups/957d7a22e3154d79bde6e479d896768b` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:03.114534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b89b6-11c9-49ed-94b2-1de1df43ae67 None admin] RBAC: Authorizing `identity:get_group(group_id=957d7a22e3154d79bde6e479d896768b)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:03.115988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b89b6-11c9-49ed-94b2-1de1df43ae67 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:03.117676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 190/379] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 7 21:48:02 2022] GET /identity/v3/groups/957d7a22e3154d79bde6e479d896768b => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:03.124196 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624dcea-f9a3-4bce-871a-1687c905294d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:03.257920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624dcea-f9a3-4bce-871a-1687c905294d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:03.300888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea1cab-100c-4b7a-8fbb-777c6f48deb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:03.302015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea1cab-100c-4b7a-8fbb-777c6f48deb4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:03.302517 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea1cab-100c-4b7a-8fbb-777c6f48deb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:03.303021 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea1cab-100c-4b7a-8fbb-777c6f48deb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:03.304642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea1cab-100c-4b7a-8fbb-777c6f48deb4 None admin] RBAC: Adding query filter params (group.id=957d7a22e3154d79bde6e479d896768b, role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=d15d054b930a4d03bfa50272128a53b7) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:03.305210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea1cab-100c-4b7a-8fbb-777c6f48deb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:03.308736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea1cab-100c-4b7a-8fbb-777c6f48deb4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:03.320351 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 190/380] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 7 21:48:03 2022] GET /identity/v3/role_assignments?group.id=957d7a22e3154d79bde6e479d896768b&scope.project.id=d15d054b930a4d03bfa50272128a53b7&role.id=8f58ef9d28494d97a68de20b84355450 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:03.428597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a1a5f-70de-40e2-b992-5b85543e0ab7 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:03.428597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a1a5f-70de-40e2-b992-5b85543e0ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:03.428597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a1a5f-70de-40e2-b992-5b85543e0ab7 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:03.429319 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 191/381] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:03.435794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137c53b-ca4c-463a-8cb0-9b74fc1f001c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:03.436078 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137c53b-ca4c-463a-8cb0-9b74fc1f001c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:03.436347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137c53b-ca4c-463a-8cb0-9b74fc1f001c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:03.459915 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d137c53b-ca4c-463a-8cb0-9b74fc1f001c None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:03.461208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d137c53b-ca4c-463a-8cb0-9b74fc1f001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:03.505349 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:03.564234 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 191/382] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:03.599266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a1a5f-70de-40e2-b992-5b85543e0ab7 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:03.733344 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a1a5f-70de-40e2-b992-5b85543e0ab7 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:03.778510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e4da1-e2d6-4efb-b12a-9759d4290144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:03.780020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e4da1-e2d6-4efb-b12a-9759d4290144 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:03.780500 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e4da1-e2d6-4efb-b12a-9759d4290144 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:03.780943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e4da1-e2d6-4efb-b12a-9759d4290144 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:03.795898 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e4da1-e2d6-4efb-b12a-9759d4290144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:03.803776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-fa7e4da1-e2d6-4efb-b12a-9759d4290144 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:48:03.803776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:03.803776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:03.803776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:03.803776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:03.803776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:03.803776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:03.803776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:03.803776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:03.803776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:03.803776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:03.803776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:03.803776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:03.803776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:03.803776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:03.803776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:03.804631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:03.804631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:03.804631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:03.804631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:03.804631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:03.804631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:03.804631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:03.804631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:03.804631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:03.804631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:03.804631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:03.804631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:03.804631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:03.804631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:03.804631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:03.804631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:03.805402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:03.805402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:03.805402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:03.805402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:03.805402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:03.805402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:03.805402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:03.805402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:03.805402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:03.805402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:03.805402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:48:03.805402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:03.808122 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 192/383] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:03.815045 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137c53b-ca4c-463a-8cb0-9b74fc1f001c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:03.946600 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137c53b-ca4c-463a-8cb0-9b74fc1f001c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:03.984883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d73bd-45bb-43cb-9aea-68a5a8e2764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:03.985817 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d73bd-45bb-43cb-9aea-68a5a8e2764d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:03.986266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d73bd-45bb-43cb-9aea-68a5a8e2764d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:03.986678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d73bd-45bb-43cb-9aea-68a5a8e2764d None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:03.987557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d73bd-45bb-43cb-9aea-68a5a8e2764d None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:03.988002 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d73bd-45bb-43cb-9aea-68a5a8e2764d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:03.989520 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d73bd-45bb-43cb-9aea-68a5a8e2764d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:03.999600 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 192/384] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:48:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:04.005641 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e4da1-e2d6-4efb-b12a-9759d4290144 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:04.053591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:04.142153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e4da1-e2d6-4efb-b12a-9759d4290144 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:04.185609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66a38c-b1b5-4dbd-98f2-453233d7c56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:04.186501 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66a38c-b1b5-4dbd-98f2-453233d7c56a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:04.186776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66a38c-b1b5-4dbd-98f2-453233d7c56a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:04.187048 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66a38c-b1b5-4dbd-98f2-453233d7c56a None admin] PATH_INFO: `/v3/groups/b864a58f705e4f61809d17bb821e9685` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:04.190212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66a38c-b1b5-4dbd-98f2-453233d7c56a None admin] RBAC: Authorizing `identity:get_group(group_id=b864a58f705e4f61809d17bb821e9685)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:04.191654 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66a38c-b1b5-4dbd-98f2-453233d7c56a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:04.193595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 193/385] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 7 21:48:04 2022] GET /identity/v3/groups/b864a58f705e4f61809d17bb821e9685 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:04.199115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d73bd-45bb-43cb-9aea-68a5a8e2764d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:04.259448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1c08b-b1dd-4586-9f13-6329304581c8 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:04.260153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1c08b-b1dd-4586-9f13-6329304581c8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:04.260571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1c08b-b1dd-4586-9f13-6329304581c8 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:04.262717 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 194/386] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:04.266647 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:04.270645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a0921-fcd9-4894-8fc4-59ccabf66670 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:04.271229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a0921-fcd9-4894-8fc4-59ccabf66670 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:04.271646 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a0921-fcd9-4894-8fc4-59ccabf66670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:04.298970 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a57a0921-fcd9-4894-8fc4-59ccabf66670 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:04.300179 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a57a0921-fcd9-4894-8fc4-59ccabf66670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:04.358047 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d73bd-45bb-43cb-9aea-68a5a8e2764d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:04.415202 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126de6b6-bc6f-43ba-bb0e-b6a69c0503cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:04.417004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126de6b6-bc6f-43ba-bb0e-b6a69c0503cb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:04.417505 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126de6b6-bc6f-43ba-bb0e-b6a69c0503cb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:04.418006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126de6b6-bc6f-43ba-bb0e-b6a69c0503cb None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:04.422651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126de6b6-bc6f-43ba-bb0e-b6a69c0503cb None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:04.424355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126de6b6-bc6f-43ba-bb0e-b6a69c0503cb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:04.426665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 193/387] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:48:04 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:04.431822 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126de6b6-bc6f-43ba-bb0e-b6a69c0503cb None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:04.433649 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 195/388] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:04.468057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a0921-fcd9-4894-8fc4-59ccabf66670 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:04.522576 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:04.613503 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:04.617510 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126de6b6-bc6f-43ba-bb0e-b6a69c0503cb None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:04.659822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a0921-fcd9-4894-8fc4-59ccabf66670 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:04.687042 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa12e0-e607-492b-b218-e94dcf8477c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:04.690077 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa12e0-e607-492b-b218-e94dcf8477c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:04.690383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa12e0-e607-492b-b218-e94dcf8477c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:04.690668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa12e0-e607-492b-b218-e94dcf8477c7 None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c/groups/b864a58f705e4f61809d17bb821e9685/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:04.694876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa12e0-e607-492b-b218-e94dcf8477c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb30985c7f9f457095a0e5e03ed6954c, group_id=b864a58f705e4f61809d17bb821e9685, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:04.696338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa12e0-e607-492b-b218-e94dcf8477c7 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:04.726107 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 194/389] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jun 7 21:48:04 2022] PUT /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c/groups/b864a58f705e4f61809d17bb821e9685/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 21:48:04.726487 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7ec16-2e15-4b7b-ac34-a83899b9f87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:04.727362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7ec16-2e15-4b7b-ac34-a83899b9f87e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:04.727644 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7ec16-2e15-4b7b-ac34-a83899b9f87e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:04.728016 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7ec16-2e15-4b7b-ac34-a83899b9f87e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:04.741331 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7ec16-2e15-4b7b-ac34-a83899b9f87e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:04.749705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-a9c7ec16-2e15-4b7b-ac34-a83899b9f87e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:48:04.749705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:04.749705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:04.749705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:04.749705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:04.749705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:04.749705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:04.749705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:04.749705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:04.749705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:04.749705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:04.749705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:04.749705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:04.749705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:04.749705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:04.749705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:04.750636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:04.750636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:04.750636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:04.750636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:04.750636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:04.750636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:04.750636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:04.750636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:04.750636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:04.750636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:04.750636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:04.750636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:04.750636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:04.750636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:04.750636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:04.750636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:04.751448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:04.751448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:04.751448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:04.751448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:04.751448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:04.751448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:04.751448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:04.751448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:04.751448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:04.751448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:04.751448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:48:04.751448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:04.751448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 196/390] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:48:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:04.758591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa12e0-e607-492b-b218-e94dcf8477c7 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:04.884392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa12e0-e607-492b-b218-e94dcf8477c7 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:04.926317 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da608ce-f18e-4b6c-8aba-d7d9b3609449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:04.927003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da608ce-f18e-4b6c-8aba-d7d9b3609449 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:04.927332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da608ce-f18e-4b6c-8aba-d7d9b3609449 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:04.927616 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da608ce-f18e-4b6c-8aba-d7d9b3609449 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:04.928385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da608ce-f18e-4b6c-8aba-d7d9b3609449 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:04.928753 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da608ce-f18e-4b6c-8aba-d7d9b3609449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:04.930232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da608ce-f18e-4b6c-8aba-d7d9b3609449 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:04.941843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 195/391] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:04.947995 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7ec16-2e15-4b7b-ac34-a83899b9f87e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:05.085198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:05.100071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7ec16-2e15-4b7b-ac34-a83899b9f87e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:05.145445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3a926-8ae2-4a4c-ad3c-961f59246415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:05.146387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3a926-8ae2-4a4c-ad3c-961f59246415 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:05.146675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3a926-8ae2-4a4c-ad3c-961f59246415 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:05.146955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3a926-8ae2-4a4c-ad3c-961f59246415 None admin] PATH_INFO: `/v3/groups/b864a58f705e4f61809d17bb821e9685` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:05.148334 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3a926-8ae2-4a4c-ad3c-961f59246415 None admin] RBAC: Authorizing `identity:get_group(group_id=b864a58f705e4f61809d17bb821e9685)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:05.149847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3a926-8ae2-4a4c-ad3c-961f59246415 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:05.152597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 197/392] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 7 21:48:04 2022] GET /identity/v3/groups/b864a58f705e4f61809d17bb821e9685 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:05.158194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da608ce-f18e-4b6c-8aba-d7d9b3609449 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:05.183167 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:05.277107 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da608ce-f18e-4b6c-8aba-d7d9b3609449 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:05.318906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a6a68-fa95-4b7f-a9f6-cf07b119a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:05.319787 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a6a68-fa95-4b7f-a9f6-cf07b119a516 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:05.320076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a6a68-fa95-4b7f-a9f6-cf07b119a516 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:05.320352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a6a68-fa95-4b7f-a9f6-cf07b119a516 None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:05.322295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a6a68-fa95-4b7f-a9f6-cf07b119a516 None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:05.323818 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a6a68-fa95-4b7f-a9f6-cf07b119a516 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:05.325535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 196/393] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:48:05 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:05.331341 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3a926-8ae2-4a4c-ad3c-961f59246415 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:05.459508 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3a926-8ae2-4a4c-ad3c-961f59246415 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:05.496428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2aae9-97f7-492e-bb2b-e14b6c2ae042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:05.497315 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2aae9-97f7-492e-bb2b-e14b6c2ae042 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:05.497598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2aae9-97f7-492e-bb2b-e14b6c2ae042 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:05.497875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2aae9-97f7-492e-bb2b-e14b6c2ae042 None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c/groups/b864a58f705e4f61809d17bb821e9685/roles/73d4eafa268f4cc3aca4863c73b794ae` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:05.500150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2aae9-97f7-492e-bb2b-e14b6c2ae042 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb30985c7f9f457095a0e5e03ed6954c, group_id=b864a58f705e4f61809d17bb821e9685, role_id=73d4eafa268f4cc3aca4863c73b794ae)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:05.501589 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2aae9-97f7-492e-bb2b-e14b6c2ae042 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:05.516187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 198/394] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jun 7 21:48:05 2022] PUT /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c/groups/b864a58f705e4f61809d17bb821e9685/roles/73d4eafa268f4cc3aca4863c73b794ae => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:48:05.534057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee8337-ce4c-4cac-bf16-78be9c2e8395 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:05.534374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee8337-ce4c-4cac-bf16-78be9c2e8395 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:05.534680 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee8337-ce4c-4cac-bf16-78be9c2e8395 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:05.536122 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 197/395] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:05.542176 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5eea1-3422-439a-9300-18ace7c1a03b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:05.542500 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5eea1-3422-439a-9300-18ace7c1a03b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:05.542809 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5eea1-3422-439a-9300-18ace7c1a03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:05.566724 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1ad5eea1-3422-439a-9300-18ace7c1a03b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:05.568019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1ad5eea1-3422-439a-9300-18ace7c1a03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:05.569097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14d668-1503-4fe3-8624-7de096603210 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:05.569392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14d668-1503-4fe3-8624-7de096603210 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:05.569675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14d668-1503-4fe3-8624-7de096603210 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:05.573095 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 198/396] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:05.579503 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dcc23-c334-48a3-80e8-307030f6b3b0 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:05.580155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dcc23-c334-48a3-80e8-307030f6b3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:05.580646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dcc23-c334-48a3-80e8-307030f6b3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:05.586862 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:05.608468 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d25dcc23-c334-48a3-80e8-307030f6b3b0 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:05.609666 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d25dcc23-c334-48a3-80e8-307030f6b3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:05.692614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 199/397] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:05.722504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5eea1-3422-439a-9300-18ace7c1a03b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:05.741309 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 199/398] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:05.779467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dcc23-c334-48a3-80e8-307030f6b3b0 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:05.807939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:05.847661 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5eea1-3422-439a-9300-18ace7c1a03b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:05.882952 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5731b-1477-4423-a186-703fb76f5b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:05.883758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5731b-1477-4423-a186-703fb76f5b92 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:05.884040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5731b-1477-4423-a186-703fb76f5b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:05.884309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5731b-1477-4423-a186-703fb76f5b92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:05.895017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dcc23-c334-48a3-80e8-307030f6b3b0 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:05.896482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5731b-1477-4423-a186-703fb76f5b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:05.904178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-77f5731b-1477-4423-a186-703fb76f5b92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:48:05.904178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:05.904178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:05.904178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:05.904178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:05.904178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:05.904178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:05.904178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:05.904178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:05.904178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:05.904178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:05.904178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:05.904178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:05.904178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:05.904178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:05.904178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:05.905272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:05.905272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:05.905272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:05.905272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:05.905272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:05.905272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:05.905272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:05.905272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:05.905272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:05.905272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:05.905272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:05.905272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:05.905272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:05.905272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:05.905272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:05.905272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:05.906155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:05.906155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:05.906155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:05.906155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:05.906155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:05.906155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:05.906155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:05.906155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:05.906155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:05.906155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:05.906155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:48:05.906155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:05.908712 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 200/399] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:05.914523 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5731b-1477-4423-a186-703fb76f5b92 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:05.931634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:05.939881 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3eceb-a938-47b8-86c9-25fe25f9076a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:05.941041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3eceb-a938-47b8-86c9-25fe25f9076a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:05.941468 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3eceb-a938-47b8-86c9-25fe25f9076a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:05.941977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3eceb-a938-47b8-86c9-25fe25f9076a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:05.957090 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3eceb-a938-47b8-86c9-25fe25f9076a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:05.975076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-bbc3eceb-a938-47b8-86c9-25fe25f9076a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:48:05.975076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:05.975076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:05.975076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:05.975076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:05.975076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:05.975076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:05.975076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:05.975076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:05.975076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:05.975076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:05.975076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:05.975076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:05.975076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:05.975076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:05.975076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:05.976197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:05.976197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:05.976197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:05.976197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:05.976197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:05.976197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:05.976197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:05.976197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:05.976197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:05.976197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:05.976197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:05.976197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:05.976197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:05.976197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:05.976197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:05.976197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:05.977003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:05.977003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:05.977003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:05.977003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:05.977003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:05.977003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:05.977003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:05.977003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:05.977003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:05.977003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:05.977003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:48:05.977003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:05.979918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 200/400] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:48:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:05.996693 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3eceb-a938-47b8-86c9-25fe25f9076a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:06.039853 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5731b-1477-4423-a186-703fb76f5b92 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:06.079697 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3685945-003e-4bc9-b7ba-48580469c96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:06.080907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3685945-003e-4bc9-b7ba-48580469c96d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:06.081277 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3685945-003e-4bc9-b7ba-48580469c96d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:06.081604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3685945-003e-4bc9-b7ba-48580469c96d None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:06.082618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3685945-003e-4bc9-b7ba-48580469c96d None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:06.082997 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3685945-003e-4bc9-b7ba-48580469c96d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:06.084874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3685945-003e-4bc9-b7ba-48580469c96d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:06.095114 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 201/401] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:48:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:06.100849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3685945-003e-4bc9-b7ba-48580469c96d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:06.138363 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:06.172636 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3eceb-a938-47b8-86c9-25fe25f9076a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:06.175926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:06.209242 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3685945-003e-4bc9-b7ba-48580469c96d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:06.246359 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71153005-85ee-4e47-a6cd-fc169de06e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:06.247374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153005-85ee-4e47-a6cd-fc169de06e54 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:06.247756 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153005-85ee-4e47-a6cd-fc169de06e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:06.248125 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153005-85ee-4e47-a6cd-fc169de06e54 None admin] PATH_INFO: `/v3/groups/b864a58f705e4f61809d17bb821e9685` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:06.249401 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71153005-85ee-4e47-a6cd-fc169de06e54 None admin] RBAC: Authorizing `identity:get_group(group_id=b864a58f705e4f61809d17bb821e9685)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:06.250959 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71153005-85ee-4e47-a6cd-fc169de06e54 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:06.252769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 202/402] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 7 21:48:06 2022] GET /identity/v3/groups/b864a58f705e4f61809d17bb821e9685 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:06.258382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71153005-85ee-4e47-a6cd-fc169de06e54 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:06.265033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2868409-116f-46a6-8fdf-0ecbfb29fc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:06.265710 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2868409-116f-46a6-8fdf-0ecbfb29fc9d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:06.266017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2868409-116f-46a6-8fdf-0ecbfb29fc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:06.266296 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2868409-116f-46a6-8fdf-0ecbfb29fc9d None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:06.267172 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2868409-116f-46a6-8fdf-0ecbfb29fc9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:06.267487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2868409-116f-46a6-8fdf-0ecbfb29fc9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:06.269070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2868409-116f-46a6-8fdf-0ecbfb29fc9d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:06.287009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 201/403] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:06.307074 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2868409-116f-46a6-8fdf-0ecbfb29fc9d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:06.375719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71153005-85ee-4e47-a6cd-fc169de06e54 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:06.412673 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0f346-9796-459c-89d6-e1f9a5ba660b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:06.413567 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0f346-9796-459c-89d6-e1f9a5ba660b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:06.413834 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0f346-9796-459c-89d6-e1f9a5ba660b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:06.414140 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0f346-9796-459c-89d6-e1f9a5ba660b None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:06.415323 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0f346-9796-459c-89d6-e1f9a5ba660b None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:06.417373 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0f346-9796-459c-89d6-e1f9a5ba660b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:06.419364 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 203/404] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:48:06 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:06.420630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad465adf-265c-4939-9f74-1484494f66a3 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:06.420913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad465adf-265c-4939-9f74-1484494f66a3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:06.421179 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad465adf-265c-4939-9f74-1484494f66a3 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:06.427675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 204/405] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:06.428420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad465adf-265c-4939-9f74-1484494f66a3 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:06.440743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:06.461409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2868409-116f-46a6-8fdf-0ecbfb29fc9d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:06.498043 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d4738-98dc-4768-a158-1e69fd51b328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:06.498918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d4738-98dc-4768-a158-1e69fd51b328 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:06.499205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d4738-98dc-4768-a158-1e69fd51b328 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:06.499481 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d4738-98dc-4768-a158-1e69fd51b328 None admin] PATH_INFO: `/v3/groups/b864a58f705e4f61809d17bb821e9685` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:06.500660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d4738-98dc-4768-a158-1e69fd51b328 None admin] RBAC: Authorizing `identity:get_group(group_id=b864a58f705e4f61809d17bb821e9685)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:06.502152 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d4738-98dc-4768-a158-1e69fd51b328 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:06.504069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 202/406] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 7 21:48:06 2022] GET /identity/v3/groups/b864a58f705e4f61809d17bb821e9685 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:06.505216 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff5bd-3d28-4579-b7c1-35e3f1d93941 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:06.505498 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff5bd-3d28-4579-b7c1-35e3f1d93941 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:06.505778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ff5bd-3d28-4579-b7c1-35e3f1d93941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:06.519319 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:06.526198 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-806ff5bd-3d28-4579-b7c1-35e3f1d93941 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:06.527414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-806ff5bd-3d28-4579-b7c1-35e3f1d93941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:06.545291 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad465adf-265c-4939-9f74-1484494f66a3 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:06.581315 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e66bc-5011-42c1-bcc6-b15ceed686e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:06.582641 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e66bc-5011-42c1-bcc6-b15ceed686e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:06.583095 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e66bc-5011-42c1-bcc6-b15ceed686e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:06.583536 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e66bc-5011-42c1-bcc6-b15ceed686e0 None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b/groups/b864a58f705e4f61809d17bb821e9685/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:06.586075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e66bc-5011-42c1-bcc6-b15ceed686e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd67400813c49aabd0b08d7febb138b, group_id=b864a58f705e4f61809d17bb821e9685, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:06.587914 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e66bc-5011-42c1-bcc6-b15ceed686e0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:06.598550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 203/407] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:06.599468 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ff5bd-3d28-4579-b7c1-35e3f1d93941 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:06.605603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 205/408] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jun 7 21:48:06 2022] PUT /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b/groups/b864a58f705e4f61809d17bb821e9685/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:48:06.643408 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e66bc-5011-42c1-bcc6-b15ceed686e0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:06.786428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:06.788383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ff5bd-3d28-4579-b7c1-35e3f1d93941 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:06.838982 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e66bc-5011-42c1-bcc6-b15ceed686e0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:06.858768 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4acd5-fa2a-415b-8521-282c4c0af118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:06.860890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4acd5-fa2a-415b-8521-282c4c0af118 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:06.860890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4acd5-fa2a-415b-8521-282c4c0af118 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:06.860890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4acd5-fa2a-415b-8521-282c4c0af118 None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:06.862258 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4acd5-fa2a-415b-8521-282c4c0af118 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:06.864023 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4acd5-fa2a-415b-8521-282c4c0af118 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:06.868224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 204/409] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:48:06 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:06.873435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4acd5-fa2a-415b-8521-282c4c0af118 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:06.884068 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:06.893586 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc121dd-68cc-41b3-a4bd-f54f4231fd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:06.894422 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc121dd-68cc-41b3-a4bd-f54f4231fd51 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:06.894704 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc121dd-68cc-41b3-a4bd-f54f4231fd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:06.895007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc121dd-68cc-41b3-a4bd-f54f4231fd51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:06.907009 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc121dd-68cc-41b3-a4bd-f54f4231fd51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:06.915051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-1dc121dd-68cc-41b3-a4bd-f54f4231fd51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:06.915051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:06.915051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:06.915051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:06.915051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:06.915051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:06.915051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:06.915051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:06.915051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:06.915051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:06.915051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:06.915051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:06.915051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:06.915051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:06.915051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:06.915051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:06.916019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:06.916019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:06.916019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:06.916019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:06.916019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:06.916019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:06.916019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:06.916019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:06.916019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:06.916019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:06.916019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:06.916019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:06.916019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:06.916019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:06.916019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:06.916019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:06.917403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:06.917403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:06.917403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:06.917403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:06.917403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:06.917403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:06.917403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:06.917403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:06.917403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:06.917403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:06.917403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:06.917403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:06.921310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 206/410] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:48:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:06.924096 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc121dd-68cc-41b3-a4bd-f54f4231fd51 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:07.008941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4acd5-fa2a-415b-8521-282c4c0af118 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:07.075357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc121dd-68cc-41b3-a4bd-f54f4231fd51 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:07.078901 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1723a4c-4a1d-48fc-972d-1078419fe83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:07.079985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1723a4c-4a1d-48fc-972d-1078419fe83a None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:07.080271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1723a4c-4a1d-48fc-972d-1078419fe83a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:07.080595 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1723a4c-4a1d-48fc-972d-1078419fe83a None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b/groups/b864a58f705e4f61809d17bb821e9685/roles/73d4eafa268f4cc3aca4863c73b794ae` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:07.083856 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1723a4c-4a1d-48fc-972d-1078419fe83a None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd67400813c49aabd0b08d7febb138b, group_id=b864a58f705e4f61809d17bb821e9685, role_id=73d4eafa268f4cc3aca4863c73b794ae)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:07.087254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1723a4c-4a1d-48fc-972d-1078419fe83a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:07.108889 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 205/411] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jun 7 21:48:06 2022] PUT /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b/groups/b864a58f705e4f61809d17bb821e9685/roles/73d4eafa268f4cc3aca4863c73b794ae => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:48:07.130161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:07.140405 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c688dfc-945d-467e-8d1f-09b9c2414b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:07.141088 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c688dfc-945d-467e-8d1f-09b9c2414b44 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:07.141369 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c688dfc-945d-467e-8d1f-09b9c2414b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:07.141647 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c688dfc-945d-467e-8d1f-09b9c2414b44 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:07.142482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c688dfc-945d-467e-8d1f-09b9c2414b44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:07.142794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c688dfc-945d-467e-8d1f-09b9c2414b44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:07.144176 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c688dfc-945d-467e-8d1f-09b9c2414b44 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:07.158141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 207/412] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:07.159871 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1723a4c-4a1d-48fc-972d-1078419fe83a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:07.237138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:07.280790 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1723a4c-4a1d-48fc-972d-1078419fe83a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:07.322485 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d0bda-b54f-4cb4-97cc-f4413f44a214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:07.323375 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d0bda-b54f-4cb4-97cc-f4413f44a214 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:07.323653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d0bda-b54f-4cb4-97cc-f4413f44a214 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:07.323921 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d0bda-b54f-4cb4-97cc-f4413f44a214 None admin] PATH_INFO: `/v3/groups/957d7a22e3154d79bde6e479d896768b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:07.326941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d0bda-b54f-4cb4-97cc-f4413f44a214 None admin] RBAC: Authorizing `identity:get_group(group_id=957d7a22e3154d79bde6e479d896768b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:07.328392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d0bda-b54f-4cb4-97cc-f4413f44a214 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:07.330188 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 206/413] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 7 21:48:07 2022] GET /identity/v3/groups/957d7a22e3154d79bde6e479d896768b => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:07.336164 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c688dfc-945d-467e-8d1f-09b9c2414b44 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:07.471205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c688dfc-945d-467e-8d1f-09b9c2414b44 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:07.507726 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d52fa5-af6e-4227-8893-4e6b8d96d270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:07.508597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d52fa5-af6e-4227-8893-4e6b8d96d270 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:07.508872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d52fa5-af6e-4227-8893-4e6b8d96d270 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:07.509143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d52fa5-af6e-4227-8893-4e6b8d96d270 None admin] PATH_INFO: `/v3/projects/d15d054b930a4d03bfa50272128a53b7` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:07.510440 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d52fa5-af6e-4227-8893-4e6b8d96d270 None admin] RBAC: Authorizing `identity:get_project(project_id=d15d054b930a4d03bfa50272128a53b7)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:07.511887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d52fa5-af6e-4227-8893-4e6b8d96d270 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:07.513868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 208/414] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:48:07 2022] GET /identity/v3/projects/d15d054b930a4d03bfa50272128a53b7 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:07.519557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d0bda-b54f-4cb4-97cc-f4413f44a214 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:07.685095 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d0bda-b54f-4cb4-97cc-f4413f44a214 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:07.726642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:07.736865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe41dc9-4388-47ad-8c04-cc854b2b9b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:07.737752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe41dc9-4388-47ad-8c04-cc854b2b9b5b None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:07.738054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe41dc9-4388-47ad-8c04-cc854b2b9b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:07.738325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe41dc9-4388-47ad-8c04-cc854b2b9b5b None admin] PATH_INFO: `/v3/projects/d15d054b930a4d03bfa50272128a53b7/groups/957d7a22e3154d79bde6e479d896768b/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:07.740286 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe41dc9-4388-47ad-8c04-cc854b2b9b5b None admin] RBAC: Authorizing `identity:create_grant(project_id=d15d054b930a4d03bfa50272128a53b7, group_id=957d7a22e3154d79bde6e479d896768b, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:07.741727 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe41dc9-4388-47ad-8c04-cc854b2b9b5b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:07.768602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 207/415] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jun 7 21:48:07 2022] PUT /identity/v3/projects/d15d054b930a4d03bfa50272128a53b7/groups/957d7a22e3154d79bde6e479d896768b/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:48:08.147741 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfbf0c-5161-4ad4-856f-99d2019049b3 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:08.148258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfbf0c-5161-4ad4-856f-99d2019049b3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:08.148363 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfbf0c-5161-4ad4-856f-99d2019049b3 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:08.149818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 209/416] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:08.157329 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e3320-ab52-4a0a-9447-8020c540621b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:08.157329 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e3320-ab52-4a0a-9447-8020c540621b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:08.157329 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e3320-ab52-4a0a-9447-8020c540621b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:08.174925 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ac6e3320-ab52-4a0a-9447-8020c540621b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:08.176431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ac6e3320-ab52-4a0a-9447-8020c540621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:08.248922 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 208/417] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:08.272774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfbf0c-5161-4ad4-856f-99d2019049b3 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:08.344141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:08.405892 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a9f4f-9d57-4c96-a5c5-89084bcbb897 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:08.406189 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a9f4f-9d57-4c96-a5c5-89084bcbb897 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:08.406401 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a9f4f-9d57-4c96-a5c5-89084bcbb897 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:08.407998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 209/418] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:08.412775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57879ff3-7d13-4464-8d0e-5bddcb1b8dcd None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:08.413163 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57879ff3-7d13-4464-8d0e-5bddcb1b8dcd None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:08.413438 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57879ff3-7d13-4464-8d0e-5bddcb1b8dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:08.420615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfbf0c-5161-4ad4-856f-99d2019049b3 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:08.439026 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-57879ff3-7d13-4464-8d0e-5bddcb1b8dcd None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:08.440196 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-57879ff3-7d13-4464-8d0e-5bddcb1b8dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:08.491414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf66aa-3d6d-4f52-a13a-ac3978cd46eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:08.492210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf66aa-3d6d-4f52-a13a-ac3978cd46eb None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:08.492485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf66aa-3d6d-4f52-a13a-ac3978cd46eb None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:08.492755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf66aa-3d6d-4f52-a13a-ac3978cd46eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:08.515221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf66aa-3d6d-4f52-a13a-ac3978cd46eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:08.524361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-d4bf66aa-3d6d-4f52-a13a-ac3978cd46eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:48:08.524361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:08.524361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:08.524361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:08.524361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:08.524361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:08.524361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:08.524361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:08.524361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:08.524361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:08.524361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:08.524361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:08.524361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:08.524361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:08.524361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:08.524361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:08.525252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:08.525252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:08.525252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:08.525252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:08.525252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:08.525252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:08.525252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:08.525252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:08.525252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:08.525252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:08.525252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:08.525252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:08.525252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:08.525252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:08.525252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:08.525252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:08.526198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:08.526198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:08.526198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:08.526198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:08.526198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:08.526198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:08.526198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:08.526198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:08.526198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:08.526198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:08.526198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:48:08.526198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:08.526198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 210/419] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:08.538866 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf66aa-3d6d-4f52-a13a-ac3978cd46eb None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:08.558524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 210/420] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:48:08.593239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57879ff3-7d13-4464-8d0e-5bddcb1b8dcd None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:08.652946 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:08.706796 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57879ff3-7d13-4464-8d0e-5bddcb1b8dcd None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:08.716675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf66aa-3d6d-4f52-a13a-ac3978cd46eb None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:08.743146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0520d-4fe3-4019-b42e-011369e861f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:08.744354 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0520d-4fe3-4019-b42e-011369e861f5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:08.744825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0520d-4fe3-4019-b42e-011369e861f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:08.745273 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0520d-4fe3-4019-b42e-011369e861f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:08.756070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0520d-4fe3-4019-b42e-011369e861f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:08.765208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-cfb0520d-4fe3-4019-b42e-011369e861f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:48:08.765208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:08.765208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:08.765208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:08.765208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:08.765208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:08.765208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:08.765208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:08.765208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:08.765208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:08.765208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:08.765208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:08.765208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:08.765208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:08.765208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:08.765208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:08.766156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:08.766156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:08.766156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:08.766156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:08.766156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:08.766156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:08.766156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:08.766156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:08.766156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:08.766156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:08.766156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:08.766156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:08.766156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:08.766156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:08.766156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:08.766156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:08.766948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:08.766948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:08.766948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:08.766948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:08.766948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:08.766948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:08.766948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:08.766948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:08.766948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:08.766948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:08.766948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:48:08.766948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:08.767606 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:08.769963 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 211/421] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:48:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:08.783564 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0520d-4fe3-4019-b42e-011369e861f5 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:08.788783 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96af556-7c26-4fab-8f61-db426ab6af0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:08.789257 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96af556-7c26-4fab-8f61-db426ab6af0d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:08.789642 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96af556-7c26-4fab-8f61-db426ab6af0d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:08.790071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96af556-7c26-4fab-8f61-db426ab6af0d None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:08.790950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96af556-7c26-4fab-8f61-db426ab6af0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:08.791385 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96af556-7c26-4fab-8f61-db426ab6af0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:08.792902 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96af556-7c26-4fab-8f61-db426ab6af0d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:08.802571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 211/422] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:48:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:08.815338 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96af556-7c26-4fab-8f61-db426ab6af0d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:08.955834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0520d-4fe3-4019-b42e-011369e861f5 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:08.970360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:08.993637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efdeb0-2aeb-4d63-b011-faea14838d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:08.995336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efdeb0-2aeb-4d63-b011-faea14838d93 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:08.995805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efdeb0-2aeb-4d63-b011-faea14838d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:08.996297 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efdeb0-2aeb-4d63-b011-faea14838d93 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:08.997294 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efdeb0-2aeb-4d63-b011-faea14838d93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:08.997792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efdeb0-2aeb-4d63-b011-faea14838d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:08.999396 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efdeb0-2aeb-4d63-b011-faea14838d93 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:09.008963 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 212/423] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:09.017054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efdeb0-2aeb-4d63-b011-faea14838d93 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:09.064072 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96af556-7c26-4fab-8f61-db426ab6af0d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:09.137961 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454afcd-4c3d-4738-89e2-5df06d5960f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:09.138957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454afcd-4c3d-4738-89e2-5df06d5960f7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:09.140878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454afcd-4c3d-4738-89e2-5df06d5960f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:09.141339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454afcd-4c3d-4738-89e2-5df06d5960f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:09.157279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efdeb0-2aeb-4d63-b011-faea14838d93 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:09.197809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a07b20-ea05-4b3a-9438-1ff9085bef9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:09.199335 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a07b20-ea05-4b3a-9438-1ff9085bef9f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:09.199819 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a07b20-ea05-4b3a-9438-1ff9085bef9f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:09.200311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a07b20-ea05-4b3a-9438-1ff9085bef9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:09.236668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:09.250957 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:09.266417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454afcd-4c3d-4738-89e2-5df06d5960f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:09.267984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454afcd-4c3d-4738-89e2-5df06d5960f7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:09.277289 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a07b20-ea05-4b3a-9438-1ff9085bef9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:09.279113 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a07b20-ea05-4b3a-9438-1ff9085bef9f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:09.390404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 212/424] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:09.392144 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b7511-a0ae-4dd7-ab1d-8dcfc3d5f9ff None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:09.392563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b7511-a0ae-4dd7-ab1d-8dcfc3d5f9ff None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:09.392963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b7511-a0ae-4dd7-ab1d-8dcfc3d5f9ff None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:09.394757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 213/425] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:09.395271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 213/426] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:09.396163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b7511-a0ae-4dd7-ab1d-8dcfc3d5f9ff None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:09.401648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714ac06-38b7-414a-a0e4-6995bf31f3fd None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:09.401648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714ac06-38b7-414a-a0e4-6995bf31f3fd None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:09.401648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714ac06-38b7-414a-a0e4-6995bf31f3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:09.420054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8714ac06-38b7-414a-a0e4-6995bf31f3fd None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:09.421339 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8714ac06-38b7-414a-a0e4-6995bf31f3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:09.486192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:09.496861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 214/427] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:48:09.497822 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714ac06-38b7-414a-a0e4-6995bf31f3fd None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:09.501107 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:09.511372 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b7511-a0ae-4dd7-ab1d-8dcfc3d5f9ff None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:09.548469 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523db95-6cff-451e-b24b-e9d8e3573df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:09.549686 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523db95-6cff-451e-b24b-e9d8e3573df5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:09.550253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523db95-6cff-451e-b24b-e9d8e3573df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:09.550775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523db95-6cff-451e-b24b-e9d8e3573df5 None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:09.552312 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523db95-6cff-451e-b24b-e9d8e3573df5 None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:09.554115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523db95-6cff-451e-b24b-e9d8e3573df5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:09.556389 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 214/428] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:48:09 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:09.557970 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523db95-6cff-451e-b24b-e9d8e3573df5 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:09.609794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714ac06-38b7-414a-a0e4-6995bf31f3fd None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:09.646541 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21396449-e647-49ba-9176-2b85012eec78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:09.647403 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21396449-e647-49ba-9176-2b85012eec78 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:09.647687 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21396449-e647-49ba-9176-2b85012eec78 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:09.647966 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21396449-e647-49ba-9176-2b85012eec78 None admin] PATH_INFO: `/v3/projects/eb30985c7f9f457095a0e5e03ed6954c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:09.649263 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21396449-e647-49ba-9176-2b85012eec78 None admin] RBAC: Authorizing `identity:get_project(project_id=eb30985c7f9f457095a0e5e03ed6954c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:09.651396 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21396449-e647-49ba-9176-2b85012eec78 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:09.653097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 215/429] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:48:09 2022] GET /identity/v3/projects/eb30985c7f9f457095a0e5e03ed6954c => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:09.658417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21396449-e647-49ba-9176-2b85012eec78 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:09.670525 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523db95-6cff-451e-b24b-e9d8e3573df5 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:09.708784 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed07cb4-4c7a-4ceb-9fb5-8bc45c1a5931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:09.710117 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed07cb4-4c7a-4ceb-9fb5-8bc45c1a5931 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:09.710629 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed07cb4-4c7a-4ceb-9fb5-8bc45c1a5931 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:09.711095 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed07cb4-4c7a-4ceb-9fb5-8bc45c1a5931 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:09.723624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed07cb4-4c7a-4ceb-9fb5-8bc45c1a5931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:09.732878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-7ed07cb4-4c7a-4ceb-9fb5-8bc45c1a5931 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:48:09.732878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:09.732878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:09.732878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:09.732878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:09.732878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:09.732878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:09.732878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:09.732878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:09.732878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:09.732878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:09.732878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:09.732878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:09.732878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:09.732878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:09.732878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:09.733887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:09.733887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:09.733887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:09.733887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:09.733887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:09.733887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:09.733887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:09.733887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:09.733887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:09.733887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:09.733887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:09.733887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:09.733887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:09.733887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:09.733887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:09.733887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:09.734722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:09.734722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:09.734722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:09.734722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:09.734722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:09.734722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:09.734722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:09.734722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:09.734722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:09.734722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:09.734722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 21:48:09.734722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:09.736196 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:09.738765 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 215/430] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:09.740103 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed07cb4-4c7a-4ceb-9fb5-8bc45c1a5931 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:09.754539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:09.775614 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21396449-e647-49ba-9176-2b85012eec78 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:09.812785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4e9f8-b5fb-4bca-a4b8-89608492f84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:09.813917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4e9f8-b5fb-4bca-a4b8-89608492f84e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:09.814384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4e9f8-b5fb-4bca-a4b8-89608492f84e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:09.814800 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4e9f8-b5fb-4bca-a4b8-89608492f84e None admin] PATH_INFO: `/v3/groups/b864a58f705e4f61809d17bb821e9685` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:09.816325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4e9f8-b5fb-4bca-a4b8-89608492f84e None admin] RBAC: Authorizing `identity:get_group(group_id=b864a58f705e4f61809d17bb821e9685)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:09.817902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4e9f8-b5fb-4bca-a4b8-89608492f84e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:09.824735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 216/431] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 7 21:48:09 2022] GET /identity/v3/groups/b864a58f705e4f61809d17bb821e9685 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:09.825823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4e9f8-b5fb-4bca-a4b8-89608492f84e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:09.856475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed07cb4-4c7a-4ceb-9fb5-8bc45c1a5931 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:09.893015 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedb7aa-82d1-4d7b-817f-8f06f92cbf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:09.894128 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedb7aa-82d1-4d7b-817f-8f06f92cbf19 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:09.894465 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedb7aa-82d1-4d7b-817f-8f06f92cbf19 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:09.894828 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedb7aa-82d1-4d7b-817f-8f06f92cbf19 None admin] PATH_INFO: `/v3/groups/b864a58f705e4f61809d17bb821e9685` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:09.896182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedb7aa-82d1-4d7b-817f-8f06f92cbf19 None admin] RBAC: Authorizing `identity:get_group(group_id=b864a58f705e4f61809d17bb821e9685)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:09.897685 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedb7aa-82d1-4d7b-817f-8f06f92cbf19 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:09.899560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 216/432] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 7 21:48:09 2022] GET /identity/v3/groups/b864a58f705e4f61809d17bb821e9685 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:09.901224 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedb7aa-82d1-4d7b-817f-8f06f92cbf19 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:09.937361 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4e9f8-b5fb-4bca-a4b8-89608492f84e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:09.977439 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157b0d7-441e-4583-b6be-bc685663628b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:09.978548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157b0d7-441e-4583-b6be-bc685663628b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:09.979056 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157b0d7-441e-4583-b6be-bc685663628b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:09.979557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157b0d7-441e-4583-b6be-bc685663628b None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:09.980504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157b0d7-441e-4583-b6be-bc685663628b None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:09.981008 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157b0d7-441e-4583-b6be-bc685663628b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:09.982615 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157b0d7-441e-4583-b6be-bc685663628b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:09.985129 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:09.993545 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 217/433] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:48:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:09.995570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157b0d7-441e-4583-b6be-bc685663628b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:09.998755 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:10.012217 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedb7aa-82d1-4d7b-817f-8f06f92cbf19 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:10.048872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bc5ec-c2fe-40b4-8088-b32564708d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:10.050025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bc5ec-c2fe-40b4-8088-b32564708d45 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:10.050320 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bc5ec-c2fe-40b4-8088-b32564708d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:10.050605 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bc5ec-c2fe-40b4-8088-b32564708d45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:10.051782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bc5ec-c2fe-40b4-8088-b32564708d45 None admin] RBAC: Adding query filter params (group.id=b864a58f705e4f61809d17bb821e9685, role.id=01ccb434cf384bc79bf82f49b697f1ce, scope.project.id=eb30985c7f9f457095a0e5e03ed6954c) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:10.052206 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bc5ec-c2fe-40b4-8088-b32564708d45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:10.053918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bc5ec-c2fe-40b4-8088-b32564708d45 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:10.061731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 217/434] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 7 21:48:09 2022] GET /identity/v3/role_assignments?group.id=b864a58f705e4f61809d17bb821e9685&scope.project.id=eb30985c7f9f457095a0e5e03ed6954c&role.id=01ccb434cf384bc79bf82f49b697f1ce => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:10.063974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bc5ec-c2fe-40b4-8088-b32564708d45 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:10.131355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157b0d7-441e-4583-b6be-bc685663628b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:10.173968 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba09a20-0546-4e0e-aa38-85ca6c60bc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:10.174662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba09a20-0546-4e0e-aa38-85ca6c60bc04 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:10.174949 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba09a20-0546-4e0e-aa38-85ca6c60bc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:10.175224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba09a20-0546-4e0e-aa38-85ca6c60bc04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:10.176067 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba09a20-0546-4e0e-aa38-85ca6c60bc04 None admin] RBAC: Adding query filter params (group.id=b864a58f705e4f61809d17bb821e9685, role.id=73d4eafa268f4cc3aca4863c73b794ae, scope.project.id=eb30985c7f9f457095a0e5e03ed6954c) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:10.176482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba09a20-0546-4e0e-aa38-85ca6c60bc04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:10.178465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba09a20-0546-4e0e-aa38-85ca6c60bc04 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:10.190393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 218/435] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 7 21:48:09 2022] GET /identity/v3/role_assignments?group.id=b864a58f705e4f61809d17bb821e9685&scope.project.id=eb30985c7f9f457095a0e5e03ed6954c&role.id=73d4eafa268f4cc3aca4863c73b794ae => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:10.191945 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd5d4-9c17-404d-aba7-5d4a31792324 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:10.192235 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd5d4-9c17-404d-aba7-5d4a31792324 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:10.192509 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd5d4-9c17-404d-aba7-5d4a31792324 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:10.195239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 219/436] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:10.207996 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bc5ec-c2fe-40b4-8088-b32564708d45 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:10.211726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0e36b-d731-4a4a-8b42-92ca9f8afc11 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:10.212677 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0e36b-d731-4a4a-8b42-92ca9f8afc11 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:10.213221 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0e36b-d731-4a4a-8b42-92ca9f8afc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:10.243933 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-97e0e36b-d731-4a4a-8b42-92ca9f8afc11 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:10.247295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-97e0e36b-d731-4a4a-8b42-92ca9f8afc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:10.305096 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ed33f-8180-426a-97d4-3d2cb5a59380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:10.305749 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ed33f-8180-426a-97d4-3d2cb5a59380 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:10.305986 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ed33f-8180-426a-97d4-3d2cb5a59380 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:10.306267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ed33f-8180-426a-97d4-3d2cb5a59380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:10.319141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:10.359642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:10.373024 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 220/437] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:10.413208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0e36b-d731-4a4a-8b42-92ca9f8afc11 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:10.414647 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ed33f-8180-426a-97d4-3d2cb5a59380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:10.416441 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ed33f-8180-426a-97d4-3d2cb5a59380 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:10.540123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 218/438] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:10.542631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913d287-0d5c-43d6-a932-ce37802dc9f1 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:10.542919 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913d287-0d5c-43d6-a932-ce37802dc9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:10.543194 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913d287-0d5c-43d6-a932-ce37802dc9f1 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:10.543748 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0e36b-d731-4a4a-8b42-92ca9f8afc11 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:10.544634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 219/439] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:10.546241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913d287-0d5c-43d6-a932-ce37802dc9f1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:10.586130 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999373d-b411-438c-b9d6-e2bb8c9dacc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:10.587099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999373d-b411-438c-b9d6-e2bb8c9dacc4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:10.587370 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999373d-b411-438c-b9d6-e2bb8c9dacc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:10.587641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999373d-b411-438c-b9d6-e2bb8c9dacc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:10.601421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999373d-b411-438c-b9d6-e2bb8c9dacc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:10.602284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:10.610369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c999373d-b411-438c-b9d6-e2bb8c9dacc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:48:10.610369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:10.610369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:10.610369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:10.610369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:10.610369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:10.610369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:10.610369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:10.610369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:10.610369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:10.610369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:10.610369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:10.610369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:10.610369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:10.610369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:10.610369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:10.611270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:10.611270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:10.611270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:10.611270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:10.611270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:10.611270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:10.611270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:10.611270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:10.611270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:10.611270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:10.611270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:10.611270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:10.611270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:10.611270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:10.611270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:10.611270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:10.612057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:10.612057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:10.612057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:10.612057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:10.612057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:10.612057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:10.612057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:10.612057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:10.612057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:10.612057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:10.612057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:48:10.612057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:10.612057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 221/440] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:48:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:10.613826 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1591fb-f208-4323-93b9-ca519022ef50 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:10.614138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1591fb-f208-4323-93b9-ca519022ef50 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:10.614418 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1591fb-f208-4323-93b9-ca519022ef50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:10.633533 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0b1591fb-f208-4323-93b9-ca519022ef50 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:10.634854 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0b1591fb-f208-4323-93b9-ca519022ef50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:10.680768 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913d287-0d5c-43d6-a932-ce37802dc9f1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:10.693500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:10.716735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 222/441] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:10.717578 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1591fb-f208-4323-93b9-ca519022ef50 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:10.724656 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27de433-4bea-4eeb-9184-b8f87688f4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:10.725769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27de433-4bea-4eeb-9184-b8f87688f4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:10.726080 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27de433-4bea-4eeb-9184-b8f87688f4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:10.726351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27de433-4bea-4eeb-9184-b8f87688f4a2 None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:10.727514 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27de433-4bea-4eeb-9184-b8f87688f4a2 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:10.728985 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27de433-4bea-4eeb-9184-b8f87688f4a2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:10.733965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 220/442] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:48:10 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:10.736344 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27de433-4bea-4eeb-9184-b8f87688f4a2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:10.828290 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1591fb-f208-4323-93b9-ca519022ef50 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:10.845490 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27de433-4bea-4eeb-9184-b8f87688f4a2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:10.855516 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:10.862314 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081e77d-7c07-4595-838d-e69cebf19dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:10.862980 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081e77d-7c07-4595-838d-e69cebf19dfa None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:10.863264 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081e77d-7c07-4595-838d-e69cebf19dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:10.863537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081e77d-7c07-4595-838d-e69cebf19dfa None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:10.864278 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081e77d-7c07-4595-838d-e69cebf19dfa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:10.864580 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081e77d-7c07-4595-838d-e69cebf19dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:10.865968 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081e77d-7c07-4595-838d-e69cebf19dfa None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:10.874342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 223/443] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:10.875115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081e77d-7c07-4595-838d-e69cebf19dfa None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:10.884416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd896af-eb23-4ac3-a752-e16750e4e9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:10.885308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd896af-eb23-4ac3-a752-e16750e4e9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:10.885584 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd896af-eb23-4ac3-a752-e16750e4e9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:10.885859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd896af-eb23-4ac3-a752-e16750e4e9d1 None admin] PATH_INFO: `/v3/groups/b864a58f705e4f61809d17bb821e9685` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:10.887083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd896af-eb23-4ac3-a752-e16750e4e9d1 None admin] RBAC: Authorizing `identity:get_group(group_id=b864a58f705e4f61809d17bb821e9685)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:10.888503 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd896af-eb23-4ac3-a752-e16750e4e9d1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:10.895014 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 221/444] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 7 21:48:10 2022] GET /identity/v3/groups/b864a58f705e4f61809d17bb821e9685 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:10.895014 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd896af-eb23-4ac3-a752-e16750e4e9d1 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:10.926277 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:10.976397 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081e77d-7c07-4595-838d-e69cebf19dfa None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:10.987771 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd896af-eb23-4ac3-a752-e16750e4e9d1 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:11.008899 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35670c4f-a90a-4c0d-b5c2-4530b95621ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:11.010251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35670c4f-a90a-4c0d-b5c2-4530b95621ac None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:11.010499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35670c4f-a90a-4c0d-b5c2-4530b95621ac None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:11.010772 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35670c4f-a90a-4c0d-b5c2-4530b95621ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:11.019796 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a1cad-3bbb-4918-97f2-7209b2d19d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:11.020417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a1cad-3bbb-4918-97f2-7209b2d19d4c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:11.020660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35670c4f-a90a-4c0d-b5c2-4530b95621ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:11.020759 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a1cad-3bbb-4918-97f2-7209b2d19d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:11.020952 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a1cad-3bbb-4918-97f2-7209b2d19d4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:11.028266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-35670c4f-a90a-4c0d-b5c2-4530b95621ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:11.028266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:11.028266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:11.028266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:11.028266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:11.028266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:11.028266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:11.028266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:11.028266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:11.028266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:11.028266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:11.028266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:11.028266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:11.028266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:11.028266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:11.028266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:11.029242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:11.029242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:11.029242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:11.029242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:11.029242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:11.029242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:11.029242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:11.029242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:11.029242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:11.029242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:11.029242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:11.029242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:11.029242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:11.029242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:11.029242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:11.029242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:11.030115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:11.030115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:11.030115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:11.030115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:11.030115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:11.030115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:11.030115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:11.030115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:11.030115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:11.030115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:11.030115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:11.030115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:11.030115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 224/445] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:48:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:11.031035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35670c4f-a90a-4c0d-b5c2-4530b95621ac None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:11.066688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:11.091369 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a1cad-3bbb-4918-97f2-7209b2d19d4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:11.092863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a1cad-3bbb-4918-97f2-7209b2d19d4c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:11.129053 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35670c4f-a90a-4c0d-b5c2-4530b95621ac None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:11.138072 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:11.162224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505ebaf-fa8f-4eac-b615-4dfc8aa77f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:11.162864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505ebaf-fa8f-4eac-b615-4dfc8aa77f9b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:11.163148 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505ebaf-fa8f-4eac-b615-4dfc8aa77f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:11.163421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505ebaf-fa8f-4eac-b615-4dfc8aa77f9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:11.164242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505ebaf-fa8f-4eac-b615-4dfc8aa77f9b None admin] RBAC: Adding query filter params (group.id=b864a58f705e4f61809d17bb821e9685, role.id=01ccb434cf384bc79bf82f49b697f1ce, scope.project.id=0dd67400813c49aabd0b08d7febb138b) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:11.164549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505ebaf-fa8f-4eac-b615-4dfc8aa77f9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:11.166040 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505ebaf-fa8f-4eac-b615-4dfc8aa77f9b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:11.172336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 225/446] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 7 21:48:11 2022] GET /identity/v3/role_assignments?group.id=b864a58f705e4f61809d17bb821e9685&scope.project.id=0dd67400813c49aabd0b08d7febb138b&role.id=01ccb434cf384bc79bf82f49b697f1ce => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:11.173412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505ebaf-fa8f-4eac-b615-4dfc8aa77f9b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:11.206264 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 222/447] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:11.211678 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a1cad-3bbb-4918-97f2-7209b2d19d4c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:11.288492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505ebaf-fa8f-4eac-b615-4dfc8aa77f9b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:11.297909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:11.324237 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a1cad-3bbb-4918-97f2-7209b2d19d4c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:11.327023 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff89f1-ad54-4a76-a544-27ef4f486dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:11.327716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff89f1-ad54-4a76-a544-27ef4f486dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:11.327998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff89f1-ad54-4a76-a544-27ef4f486dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:11.328275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff89f1-ad54-4a76-a544-27ef4f486dd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:11.329036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff89f1-ad54-4a76-a544-27ef4f486dd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:11.329345 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff89f1-ad54-4a76-a544-27ef4f486dd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:11.330803 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff89f1-ad54-4a76-a544-27ef4f486dd8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:11.344493 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 226/448] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:11.345616 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff89f1-ad54-4a76-a544-27ef4f486dd8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:11.374569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bce45b-5b9b-4f77-a6e7-68a44df917f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:11.375444 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bce45b-5b9b-4f77-a6e7-68a44df917f3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:11.375726 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bce45b-5b9b-4f77-a6e7-68a44df917f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:11.376001 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bce45b-5b9b-4f77-a6e7-68a44df917f3 None admin] PATH_INFO: `/v3/projects/0dd67400813c49aabd0b08d7febb138b` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:11.377211 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bce45b-5b9b-4f77-a6e7-68a44df917f3 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd67400813c49aabd0b08d7febb138b)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:11.379531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bce45b-5b9b-4f77-a6e7-68a44df917f3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:11.380759 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 223/449] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:48:11 2022] GET /identity/v3/projects/0dd67400813c49aabd0b08d7febb138b => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:11.387720 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bce45b-5b9b-4f77-a6e7-68a44df917f3 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:11.391039 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:11.480808 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff89f1-ad54-4a76-a544-27ef4f486dd8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:11.508071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bce45b-5b9b-4f77-a6e7-68a44df917f3 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:11.518107 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445259e-bd0d-4b21-9762-a34a211a3eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:11.518993 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445259e-bd0d-4b21-9762-a34a211a3eef None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:11.519429 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445259e-bd0d-4b21-9762-a34a211a3eef None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:11.519710 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445259e-bd0d-4b21-9762-a34a211a3eef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:11.548468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ce817-8eb8-4075-b190-068afdc0c72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:11.549316 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ce817-8eb8-4075-b190-068afdc0c72b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:11.549595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ce817-8eb8-4075-b190-068afdc0c72b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:11.551606 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ce817-8eb8-4075-b190-068afdc0c72b None admin] PATH_INFO: `/v3/groups/b864a58f705e4f61809d17bb821e9685` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:11.551606 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ce817-8eb8-4075-b190-068afdc0c72b None admin] RBAC: Authorizing `identity:get_group(group_id=b864a58f705e4f61809d17bb821e9685)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:11.552463 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ce817-8eb8-4075-b190-068afdc0c72b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:11.559390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 224/450] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 7 21:48:11 2022] GET /identity/v3/groups/b864a58f705e4f61809d17bb821e9685 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:11.561406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ce817-8eb8-4075-b190-068afdc0c72b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:11.576822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:11.600098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445259e-bd0d-4b21-9762-a34a211a3eef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:11.602232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445259e-bd0d-4b21-9762-a34a211a3eef None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:11.635411 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:11.663439 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ce817-8eb8-4075-b190-068afdc0c72b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:11.697389 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7a02c-9c23-451e-8c0e-6661f3530a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:11.698055 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7a02c-9c23-451e-8c0e-6661f3530a47 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:11.698332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7a02c-9c23-451e-8c0e-6661f3530a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:11.698609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7a02c-9c23-451e-8c0e-6661f3530a47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:11.699425 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7a02c-9c23-451e-8c0e-6661f3530a47 None admin] RBAC: Adding query filter params (group.id=b864a58f705e4f61809d17bb821e9685, role.id=73d4eafa268f4cc3aca4863c73b794ae, scope.project.id=0dd67400813c49aabd0b08d7febb138b) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:11.699732 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7a02c-9c23-451e-8c0e-6661f3530a47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:11.700264 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 227/451] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:11.701143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7a02c-9c23-451e-8c0e-6661f3530a47 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:11.705651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445259e-bd0d-4b21-9762-a34a211a3eef None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:11.708996 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 225/452] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 7 21:48:11 2022] GET /identity/v3/role_assignments?group.id=b864a58f705e4f61809d17bb821e9685&scope.project.id=0dd67400813c49aabd0b08d7febb138b&role.id=73d4eafa268f4cc3aca4863c73b794ae => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:11.813372 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445259e-bd0d-4b21-9762-a34a211a3eef None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:11.851775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758b693-da1b-44d5-a623-e6a278a028e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:11.852648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758b693-da1b-44d5-a623-e6a278a028e3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:11.852924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758b693-da1b-44d5-a623-e6a278a028e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:11.853195 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758b693-da1b-44d5-a623-e6a278a028e3 None admin] PATH_INFO: `/v3/projects/d15d054b930a4d03bfa50272128a53b7` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:11.855010 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758b693-da1b-44d5-a623-e6a278a028e3 None admin] RBAC: Authorizing `identity:get_project(project_id=d15d054b930a4d03bfa50272128a53b7)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:11.856465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758b693-da1b-44d5-a623-e6a278a028e3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:11.858220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 228/453] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:48:11 2022] GET /identity/v3/projects/d15d054b930a4d03bfa50272128a53b7 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:11.863662 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7a02c-9c23-451e-8c0e-6661f3530a47 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:11.944133 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:11.967848 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7a02c-9c23-451e-8c0e-6661f3530a47 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:12.001299 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d576a-fa39-4e4d-b50d-c7ed08bfcad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:12.002177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d576a-fa39-4e4d-b50d-c7ed08bfcad5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:12.002460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d576a-fa39-4e4d-b50d-c7ed08bfcad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:12.002734 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d576a-fa39-4e4d-b50d-c7ed08bfcad5 None admin] PATH_INFO: `/v3/groups/957d7a22e3154d79bde6e479d896768b` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:12.003910 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d576a-fa39-4e4d-b50d-c7ed08bfcad5 None admin] RBAC: Authorizing `identity:get_group(group_id=957d7a22e3154d79bde6e479d896768b)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:12.005346 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d576a-fa39-4e4d-b50d-c7ed08bfcad5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:12.007149 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 226/454] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 7 21:48:11 2022] GET /identity/v3/groups/957d7a22e3154d79bde6e479d896768b => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:12.013058 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758b693-da1b-44d5-a623-e6a278a028e3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:12.016500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:12.118205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758b693-da1b-44d5-a623-e6a278a028e3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:12.149625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ace909-9e2f-468b-82c9-38ac9ea9f24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:12.150792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ace909-9e2f-468b-82c9-38ac9ea9f24a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:12.151080 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ace909-9e2f-468b-82c9-38ac9ea9f24a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:12.151352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ace909-9e2f-468b-82c9-38ac9ea9f24a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:12.152170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ace909-9e2f-468b-82c9-38ac9ea9f24a None admin] RBAC: Adding query filter params (group.id=957d7a22e3154d79bde6e479d896768b, role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=d15d054b930a4d03bfa50272128a53b7) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:12.152477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ace909-9e2f-468b-82c9-38ac9ea9f24a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:12.153898 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ace909-9e2f-468b-82c9-38ac9ea9f24a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:12.159491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 229/455] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 7 21:48:12 2022] GET /identity/v3/role_assignments?group.id=957d7a22e3154d79bde6e479d896768b&scope.project.id=d15d054b930a4d03bfa50272128a53b7&role.id=8f58ef9d28494d97a68de20b84355450 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:14.742445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d428d-e56f-4b1b-8758-bab7a71037dc None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:14.743316 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d428d-e56f-4b1b-8758-bab7a71037dc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:14.743781 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d428d-e56f-4b1b-8758-bab7a71037dc None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:14.745621 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 227/456] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:14.751467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2da35-373a-47bb-8489-865c9de4dcd9 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:14.751931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2da35-373a-47bb-8489-865c9de4dcd9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:14.752007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2da35-373a-47bb-8489-865c9de4dcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:14.773971 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d5d2da35-373a-47bb-8489-865c9de4dcd9 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:14.775170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d5d2da35-373a-47bb-8489-865c9de4dcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:14.857424 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:14.865715 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 230/457] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:14.911390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d428d-e56f-4b1b-8758-bab7a71037dc None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:15.006353 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452041a-b078-4c6c-8cb1-9d32e87e3c12 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:15.006987 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452041a-b078-4c6c-8cb1-9d32e87e3c12 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:15.007327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452041a-b078-4c6c-8cb1-9d32e87e3c12 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:15.009170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 231/458] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:15.014199 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa76cee-dbdf-4849-81d9-48d50f947f10 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:15.014733 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa76cee-dbdf-4849-81d9-48d50f947f10 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:15.015222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa76cee-dbdf-4849-81d9-48d50f947f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:15.040040 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-6fa76cee-dbdf-4849-81d9-48d50f947f10 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:15.042780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6fa76cee-dbdf-4849-81d9-48d50f947f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:15.063017 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d428d-e56f-4b1b-8758-bab7a71037dc None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:15.142599 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5be6d-6cd3-4c75-b7f1-c87403b0959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:15.143398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5be6d-6cd3-4c75-b7f1-c87403b0959d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:15.143678 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5be6d-6cd3-4c75-b7f1-c87403b0959d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:15.143949 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5be6d-6cd3-4c75-b7f1-c87403b0959d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:15.159051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5be6d-6cd3-4c75-b7f1-c87403b0959d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:15.160710 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5be6d-6cd3-4c75-b7f1-c87403b0959d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:15.168653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:15.196118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e0c5be6d-6cd3-4c75-b7f1-c87403b0959d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:15.196118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:15.196118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:15.196118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:15.196118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:15.196118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:15.196118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:15.196118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:15.196118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:15.196118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:15.196118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:15.196118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:15.196118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:15.196118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:15.196118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:15.197073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:15.197073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:15.197073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:15.197073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:15.197073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:15.197073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:15.197073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:15.197073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:15.197073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:15.197073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:15.197073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:15.197073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:15.197073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:15.197073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:15.197073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:15.197073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:15.197073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:15.197976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:15.197976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:15.197976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:15.197976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:15.197976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 228/459] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:15.203187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5be6d-6cd3-4c75-b7f1-c87403b0959d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:15.211575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 232/460] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:48:15.251415 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa76cee-dbdf-4849-81d9-48d50f947f10 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:15.472576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa76cee-dbdf-4849-81d9-48d50f947f10 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:15.479397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5be6d-6cd3-4c75-b7f1-c87403b0959d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:15.505367 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:15.515435 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f512522-6c04-4035-8d7e-b66d18ae2e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:15.516089 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f512522-6c04-4035-8d7e-b66d18ae2e36 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:15.516366 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f512522-6c04-4035-8d7e-b66d18ae2e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:15.516636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f512522-6c04-4035-8d7e-b66d18ae2e36 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:15.517256 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bedff-1446-4f04-9f84-8b82f9bc0dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:15.517371 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f512522-6c04-4035-8d7e-b66d18ae2e36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:15.517639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f512522-6c04-4035-8d7e-b66d18ae2e36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:15.518606 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bedff-1446-4f04-9f84-8b82f9bc0dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:15.519031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f512522-6c04-4035-8d7e-b66d18ae2e36 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:15.519234 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bedff-1446-4f04-9f84-8b82f9bc0dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:15.519673 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bedff-1446-4f04-9f84-8b82f9bc0dc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:15.532049 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 229/461] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:15.532049 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804df7b-c5e9-4aac-8d7e-d4789d154a1d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:15.532049 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804df7b-c5e9-4aac-8d7e-d4789d154a1d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:15.532049 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804df7b-c5e9-4aac-8d7e-d4789d154a1d None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:15.534578 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bedff-1446-4f04-9f84-8b82f9bc0dc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:15.538966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 230/462] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:15.538966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5feff-2b1d-4c61-a7c7-297bb64f1586 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:15.538966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5feff-2b1d-4c61-a7c7-297bb64f1586 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:15.538966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5feff-2b1d-4c61-a7c7-297bb64f1586 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:15.538966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 231/463] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:15.538966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5feff-2b1d-4c61-a7c7-297bb64f1586 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:15.540679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bedff-1446-4f04-9f84-8b82f9bc0dc1 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:15.561958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-003bedff-1446-4f04-9f84-8b82f9bc0dc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:15.561958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:15.561958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:15.561958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:15.561958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:15.561958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:15.561958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:15.561958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:15.561958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:15.561958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:15.561958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:15.561958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:15.561958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:15.561958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:15.561958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:15.562941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:15.562941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:15.562941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:15.562941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:15.562941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:15.562941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:15.562941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:15.562941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:15.562941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:15.562941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:15.562941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:15.562941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:15.562941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:15.562941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:15.562941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:15.562941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:15.562941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:15.563970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:15.563970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:15.563970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:15.563970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:15.565452 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 233/464] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:15.566817 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddb651-cb72-48f0-8f45-8f60e47fa3ad None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:15.567107 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddb651-cb72-48f0-8f45-8f60e47fa3ad None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:15.567386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddb651-cb72-48f0-8f45-8f60e47fa3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:15.583536 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-08ddb651-cb72-48f0-8f45-8f60e47fa3ad None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:15.584706 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-08ddb651-cb72-48f0-8f45-8f60e47fa3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:15.606739 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:15.652908 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5feff-2b1d-4c61-a7c7-297bb64f1586 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:15.655650 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 234/465] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:15.659217 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf93f6f-8e8c-412a-b9fe-cda18e9c84a8 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:15.659725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf93f6f-8e8c-412a-b9fe-cda18e9c84a8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:15.660681 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf93f6f-8e8c-412a-b9fe-cda18e9c84a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:15.681346 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7cf93f6f-8e8c-412a-b9fe-cda18e9c84a8 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:15.683082 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7cf93f6f-8e8c-412a-b9fe-cda18e9c84a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:15.689357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e4336-5469-4097-adc3-7a2d237fced7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:15.690062 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e4336-5469-4097-adc3-7a2d237fced7 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:15.690346 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e4336-5469-4097-adc3-7a2d237fced7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:15.690623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e4336-5469-4097-adc3-7a2d237fced7 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:15.691431 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e4336-5469-4097-adc3-7a2d237fced7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:15.692977 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e4336-5469-4097-adc3-7a2d237fced7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:15.718092 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 232/466] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:48:15 2022] POST /identity/v3/users => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:48:15.718983 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e4336-5469-4097-adc3-7a2d237fced7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:15.765431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 235/467] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:15.767100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf93f6f-8e8c-412a-b9fe-cda18e9c84a8 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:15.811077 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:15.840866 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e4336-5469-4097-adc3-7a2d237fced7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:15.859968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:15.892190 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6bd84-22ac-49c1-a6f3-e21ab6b446ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:15.892875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6bd84-22ac-49c1-a6f3-e21ab6b446ed None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:15.893154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6bd84-22ac-49c1-a6f3-e21ab6b446ed None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:15.893424 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6bd84-22ac-49c1-a6f3-e21ab6b446ed None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:15.894189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6bd84-22ac-49c1-a6f3-e21ab6b446ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:15.894502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6bd84-22ac-49c1-a6f3-e21ab6b446ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:15.895019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf93f6f-8e8c-412a-b9fe-cda18e9c84a8 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:15.895882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6bd84-22ac-49c1-a6f3-e21ab6b446ed None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:15.911923 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 233/468] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:15.913021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6bd84-22ac-49c1-a6f3-e21ab6b446ed None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:15.939570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8795628-9d68-416e-a9b0-0adce32a625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:15.940894 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8795628-9d68-416e-a9b0-0adce32a625a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:15.941388 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8795628-9d68-416e-a9b0-0adce32a625a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:15.941876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8795628-9d68-416e-a9b0-0adce32a625a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:15.954693 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8795628-9d68-416e-a9b0-0adce32a625a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:15.956640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8795628-9d68-416e-a9b0-0adce32a625a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:15.981544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-a8795628-9d68-416e-a9b0-0adce32a625a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:15.981544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:15.981544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:15.981544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:15.981544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:15.981544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:15.981544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:15.981544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:15.981544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:15.981544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:15.981544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:15.981544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:15.981544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:15.981544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:15.981544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:15.982483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:15.982483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:15.982483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:15.982483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:15.982483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:15.982483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:15.982483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:15.982483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:15.982483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:15.982483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:15.982483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:15.982483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:15.982483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:15.982483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:15.982483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:15.982483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:15.982483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:15.983344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:15.983344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:15.983344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:15.983344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:15.990257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 236/469] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:15.991362 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8795628-9d68-416e-a9b0-0adce32a625a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:16.038945 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6bd84-22ac-49c1-a6f3-e21ab6b446ed None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:16.080977 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5379178-10aa-4f53-901a-334171ff91fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:16.081918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5379178-10aa-4f53-901a-334171ff91fb None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:16.082270 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5379178-10aa-4f53-901a-334171ff91fb None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:16.082568 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5379178-10aa-4f53-901a-334171ff91fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:16.096701 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5379178-10aa-4f53-901a-334171ff91fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:16.098265 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5379178-10aa-4f53-901a-334171ff91fb None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:16.118556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-f5379178-10aa-4f53-901a-334171ff91fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:16.118556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:16.118556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:16.118556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:16.118556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:16.118556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:16.118556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:16.118556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:16.118556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:16.118556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:16.118556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:16.118556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:16.118556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:16.118556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:16.118556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:16.119563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:16.119563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:16.119563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:16.119563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:16.119563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:16.119563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:16.119563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:16.119563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:16.119563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:16.119563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:16.119563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:16.119563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:16.119563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:16.119563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:16.119563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:16.119563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:16.119563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:16.120394 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:16.120394 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:16.120394 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:16.120394 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:16.120394 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 234/470] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:16.121127 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5379178-10aa-4f53-901a-334171ff91fb None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:16.149361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:16.216573 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:16.227753 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8795628-9d68-416e-a9b0-0adce32a625a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:16.253361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5379178-10aa-4f53-901a-334171ff91fb None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:16.272350 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8a8a8-4dba-4238-b13d-6051f02a22df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:16.273015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8a8a8-4dba-4238-b13d-6051f02a22df None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:16.273298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8a8a8-4dba-4238-b13d-6051f02a22df None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:16.273565 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8a8a8-4dba-4238-b13d-6051f02a22df None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:16.274338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8a8a8-4dba-4238-b13d-6051f02a22df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:16.277096 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8a8a8-4dba-4238-b13d-6051f02a22df None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:16.289463 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75d822-fbdd-49d1-9082-13e5c762a113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:16.290307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75d822-fbdd-49d1-9082-13e5c762a113 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:16.290857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75d822-fbdd-49d1-9082-13e5c762a113 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:16.291747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75d822-fbdd-49d1-9082-13e5c762a113 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:16.292754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75d822-fbdd-49d1-9082-13e5c762a113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:16.293128 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75d822-fbdd-49d1-9082-13e5c762a113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:16.294534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75d822-fbdd-49d1-9082-13e5c762a113 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:16.303814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 237/471] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:48:15 2022] POST /identity/v3/users => generated 248 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:48:16.304994 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8a8a8-4dba-4238-b13d-6051f02a22df None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:16.317216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 235/472] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:16.323211 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75d822-fbdd-49d1-9082-13e5c762a113 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:16.429124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:16.449304 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75d822-fbdd-49d1-9082-13e5c762a113 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:16.496790 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8a8a8-4dba-4238-b13d-6051f02a22df None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:16.500174 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89ecff-24b8-4127-9392-f2f995ddfcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:16.501165 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89ecff-24b8-4127-9392-f2f995ddfcda None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:16.501652 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89ecff-24b8-4127-9392-f2f995ddfcda None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:16.502145 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89ecff-24b8-4127-9392-f2f995ddfcda None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:16.503051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89ecff-24b8-4127-9392-f2f995ddfcda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:16.504801 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89ecff-24b8-4127-9392-f2f995ddfcda None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:16.529971 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 236/473] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:48:16 2022] POST /identity/v3/users => generated 249 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 21:48:16.529971 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c75cc-c2c7-428b-aaff-a947f79538a6 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:16.529971 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c75cc-c2c7-428b-aaff-a947f79538a6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:16.530263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c75cc-c2c7-428b-aaff-a947f79538a6 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:16.535875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 237/474] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:16.537698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708979b-44e1-4367-a8cb-67c926478e09 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:16.538073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708979b-44e1-4367-a8cb-67c926478e09 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:16.538355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708979b-44e1-4367-a8cb-67c926478e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:16.539679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5164a-7889-4bc3-8efd-907652447d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:16.540360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5164a-7889-4bc3-8efd-907652447d26 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:16.540634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5164a-7889-4bc3-8efd-907652447d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:16.540973 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5164a-7889-4bc3-8efd-907652447d26 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:16.541716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5164a-7889-4bc3-8efd-907652447d26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:16.542044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5164a-7889-4bc3-8efd-907652447d26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:16.543462 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5164a-7889-4bc3-8efd-907652447d26 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:16.557491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 238/475] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:16.557806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1708979b-44e1-4367-a8cb-67c926478e09 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:16.559216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1708979b-44e1-4367-a8cb-67c926478e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:16.562777 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5164a-7889-4bc3-8efd-907652447d26 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:16.572500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:16.651371 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 238/476] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:16.678129 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708979b-44e1-4367-a8cb-67c926478e09 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:16.723905 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5164a-7889-4bc3-8efd-907652447d26 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:16.771453 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:16.774866 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802feb6-08b9-4fea-bdf7-bee701657214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:16.776643 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802feb6-08b9-4fea-bdf7-bee701657214 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:16.776749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802feb6-08b9-4fea-bdf7-bee701657214 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:16.777811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802feb6-08b9-4fea-bdf7-bee701657214 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:16.777811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802feb6-08b9-4fea-bdf7-bee701657214 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:16.779499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802feb6-08b9-4fea-bdf7-bee701657214 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:16.804440 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 239/477] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:48:16 2022] POST /identity/v3/users => generated 248 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:48:16.813124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708979b-44e1-4367-a8cb-67c926478e09 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:16.858969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b5c62-f498-466e-99c8-f4ef254c9fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:16.859751 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b5c62-f498-466e-99c8-f4ef254c9fc8 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:16.859988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b5c62-f498-466e-99c8-f4ef254c9fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:16.860311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b5c62-f498-466e-99c8-f4ef254c9fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:16.861077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b5c62-f498-466e-99c8-f4ef254c9fc8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:16.862513 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b5c62-f498-466e-99c8-f4ef254c9fc8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:16.870368 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.sql.core [None req-ee9b5c62-f498-466e-99c8-f4ef254c9fc8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 07 21:48:16.870368 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 07 21:48:16.870368 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [parameters: {'id': '77aae5890d7c4027a15ae371f6e3f701', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 07 21:48:16.870368 dv-cinder-835525-4-smb devstack@keystone.service[80404]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80404) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 07 21:48:16.889309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-ee9b5c62-f498-466e-99c8-f4ef254c9fc8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 07 21:48:16.889309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:16.889309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 21:48:16.889309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 21:48:16.889309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 21:48:16.889309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 21:48:16.889309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 21:48:16.889309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 21:48:16.889309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 21:48:16.889309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application conn.query(q) Jun 07 21:48:16.889309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 21:48:16.889309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 21:48:16.889309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 21:48:16.889309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result.read() Jun 07 21:48:16.889309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return ref.to_dict() Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 21:48:16.890276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application next(self.gen) Jun 07 21:48:16.891187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 07 21:48:16.891187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application yield resource Jun 07 21:48:16.891187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 21:48:16.891187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application next(self.gen) Jun 07 21:48:16.891187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 07 21:48:16.891187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.session.rollback() Jun 07 21:48:16.891187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 07 21:48:16.891187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.force_reraise() Jun 07 21:48:16.891187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 07 21:48:16.891187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise self.value Jun 07 21:48:16.891187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 07 21:48:16.891187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 07 21:48:16.891187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 07 21:48:16.891187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application session.commit() Jun 07 21:48:16.891187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 07 21:48:16.891187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 07 21:48:16.891187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 07 21:48:16.892040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._prepare_impl() Jun 07 21:48:16.892040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 07 21:48:16.892040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.session.flush() Jun 07 21:48:16.892040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 07 21:48:16.892040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._flush(objects) Jun 07 21:48:16.892040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 07 21:48:16.892040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 07 21:48:16.892040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 07 21:48:16.892040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application compat.raise_( Jun 07 21:48:16.892040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 21:48:16.892040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception Jun 07 21:48:16.892040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 07 21:48:16.892040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application flush_context.execute() Jun 07 21:48:16.892040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 07 21:48:16.892040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rec.execute(self) Jun 07 21:48:16.892040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 07 21:48:16.892040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 07 21:48:16.892904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 07 21:48:16.892904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 07 21:48:16.892904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 07 21:48:16.892904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 07 21:48:16.892904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 07 21:48:16.892904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 07 21:48:16.892904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 07 21:48:16.892904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 07 21:48:16.892904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 07 21:48:16.892904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 07 21:48:16.892904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 07 21:48:16.892904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 07 21:48:16.892904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 07 21:48:16.892904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 07 21:48:16.892904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 21:48:16.892904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception Jun 07 21:48:16.893714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 21:48:16.893714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 21:48:16.893714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 21:48:16.893714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 21:48:16.893714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 21:48:16.893714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 21:48:16.893714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 21:48:16.893714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application conn.query(q) Jun 07 21:48:16.893714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 21:48:16.893714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 21:48:16.893714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 21:48:16.893714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result.read() Jun 07 21:48:16.893714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 21:48:16.893714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 21:48:16.893714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 21:48:16.893714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 21:48:16.894552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 21:48:16.894552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 21:48:16.894552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 21:48:16.894552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 21:48:16.894552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 07 21:48:16.894552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 07 21:48:16.894552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [parameters: {'id': '77aae5890d7c4027a15ae371f6e3f701', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 07 21:48:16.894552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 07 21:48:16.894552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:16.894552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:48:16.894552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:16.894552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:16.894552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:16.894552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:16.894552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:16.894552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:16.895585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:16.895585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:16.895585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:16.895585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:16.895585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:16.895585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:16.895585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 07 21:48:16.895585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 07 21:48:16.895585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:16.895585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:16.895585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 07 21:48:16.895585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 07 21:48:16.895585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 07 21:48:16.895585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 07 21:48:16.895585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 07 21:48:16.895585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:16.896433 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 239/478] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jun 7 21:48:16 2022] POST /identity/v3/roles => generated 144 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:16.899404 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802feb6-08b9-4fea-bdf7-bee701657214 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:16.971575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:17.016963 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802feb6-08b9-4fea-bdf7-bee701657214 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:17.054031 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede363ce-d250-41ff-bca9-d048da22a30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:17.054940 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede363ce-d250-41ff-bca9-d048da22a30d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:17.055222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede363ce-d250-41ff-bca9-d048da22a30d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:17.055496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede363ce-d250-41ff-bca9-d048da22a30d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:17.066726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede363ce-d250-41ff-bca9-d048da22a30d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:17.075004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-ede363ce-d250-41ff-bca9-d048da22a30d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:48:17.075004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:17.075004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:17.075004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:17.075004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:17.075004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:17.075004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:17.075004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:17.075004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:17.075004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:17.075004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:17.075004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:17.075004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:17.075004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:17.075004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:17.075004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:17.076988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:17.076988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:17.076988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:17.076988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:17.076988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:17.076988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:17.076988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:17.076988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:17.076988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:17.076988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:17.076988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:17.076988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:17.076988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:17.076988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:17.076988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:17.076988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:17.078954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:17.078954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:17.078954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:17.078954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:17.078954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:17.078954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:17.078954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:17.078954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:17.078954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:17.078954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:17.078954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 21:48:17.078954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:17.081963 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 240/479] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:48:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:17.082753 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b5c62-f498-466e-99c8-f4ef254c9fc8 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:17.195090 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b5c62-f498-466e-99c8-f4ef254c9fc8 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:17.238743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea7d46-88d3-4589-b6c6-67d7023bf333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:17.239754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea7d46-88d3-4589-b6c6-67d7023bf333 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:17.240230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea7d46-88d3-4589-b6c6-67d7023bf333 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:17.240717 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea7d46-88d3-4589-b6c6-67d7023bf333 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:17.241656 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea7d46-88d3-4589-b6c6-67d7023bf333 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:17.242268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea7d46-88d3-4589-b6c6-67d7023bf333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:17.243828 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea7d46-88d3-4589-b6c6-67d7023bf333 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:17.246135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:17.258044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 240/480] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:18.578091 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e2f1f-df36-401e-80e4-eeb09da6aa16 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:18.578627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e2f1f-df36-401e-80e4-eeb09da6aa16 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:18.578627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e2f1f-df36-401e-80e4-eeb09da6aa16 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:18.580283 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 241/481] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:18.585147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737d32e-4993-417f-931e-181920e5ebd9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:18.585541 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737d32e-4993-417f-931e-181920e5ebd9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:18.585703 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737d32e-4993-417f-931e-181920e5ebd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:18.606949 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-5737d32e-4993-417f-931e-181920e5ebd9 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:18.608161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5737d32e-4993-417f-931e-181920e5ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:18.692871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 241/482] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:18.740041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e2f1f-df36-401e-80e4-eeb09da6aa16 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:18.885732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e2f1f-df36-401e-80e4-eeb09da6aa16 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:18.921134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:18.933165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184468d-668c-4920-9d3b-fbdd900a017f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:18.933983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184468d-668c-4920-9d3b-fbdd900a017f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:18.934265 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184468d-668c-4920-9d3b-fbdd900a017f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:18.934537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184468d-668c-4920-9d3b-fbdd900a017f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:18.952882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184468d-668c-4920-9d3b-fbdd900a017f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:18.960516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-e184468d-668c-4920-9d3b-fbdd900a017f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:18.960516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:18.960516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:18.960516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:18.960516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:18.960516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:18.960516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:18.960516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:18.960516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:18.960516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:18.960516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:18.960516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:18.960516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:18.960516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:18.960516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:18.960516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:18.961405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:18.961405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:18.961405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:18.961405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:18.961405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:18.961405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:18.961405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:18.961405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:18.961405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:18.961405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:18.961405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:18.961405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:18.961405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:18.961405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:18.961405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:18.961405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:18.962239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:18.962239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:18.962239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:18.962239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:18.962239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:18.962239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:18.962239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:18.962239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:18.962239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:18.962239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:18.962239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:18.962239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:18.962239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 242/483] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:18.968245 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737d32e-4993-417f-931e-181920e5ebd9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:19.162974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737d32e-4993-417f-931e-181920e5ebd9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:19.210176 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:19.228651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96534aa2-8175-4f48-9481-533044b38d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:19.229705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96534aa2-8175-4f48-9481-533044b38d1b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:19.230218 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96534aa2-8175-4f48-9481-533044b38d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:19.230716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96534aa2-8175-4f48-9481-533044b38d1b None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:19.231684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96534aa2-8175-4f48-9481-533044b38d1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:19.232200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96534aa2-8175-4f48-9481-533044b38d1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:19.233768 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96534aa2-8175-4f48-9481-533044b38d1b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:19.245352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 242/484] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:19.250810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184468d-668c-4920-9d3b-fbdd900a017f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:19.269955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9b049-c3a2-494a-91ec-3a136dc1f7df None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:19.270627 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9b049-c3a2-494a-91ec-3a136dc1f7df None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:19.271139 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9b049-c3a2-494a-91ec-3a136dc1f7df None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:19.272824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 243/485] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:48:19.279189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f79c2-c792-4b99-beee-bd45f687910e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:19.279708 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f79c2-c792-4b99-beee-bd45f687910e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:19.280184 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f79c2-c792-4b99-beee-bd45f687910e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:19.307456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-521f79c2-c792-4b99-beee-bd45f687910e None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:19.308632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-521f79c2-c792-4b99-beee-bd45f687910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:19.422449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184468d-668c-4920-9d3b-fbdd900a017f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:19.443816 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 244/486] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:48:19.469416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f79c2-c792-4b99-beee-bd45f687910e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:19.485856 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8dfe59-c662-4f6e-916b-2ef11378e81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:19.487059 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dfe59-c662-4f6e-916b-2ef11378e81b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:19.487345 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dfe59-c662-4f6e-916b-2ef11378e81b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:19.487623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dfe59-c662-4f6e-916b-2ef11378e81b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:19.510086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8dfe59-c662-4f6e-916b-2ef11378e81b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:19.511566 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8dfe59-c662-4f6e-916b-2ef11378e81b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:19.546586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-7a8dfe59-c662-4f6e-916b-2ef11378e81b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:19.546586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:19.546586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:19.546586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:19.546586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:19.546586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:19.546586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:19.546586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:19.546586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:19.546586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:19.546586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:19.546586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:19.546586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:19.546586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:19.546586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:19.547499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:19.547499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:19.547499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:19.547499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:19.547499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:19.547499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:19.547499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:19.547499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:19.547499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:19.547499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:19.547499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:19.547499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:19.547499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:19.547499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:19.547499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:19.547499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:19.547499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:19.548338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:19.548338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:19.548338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:19.548338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:19.548338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 243/487] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:19.549211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278294b-c670-4fec-8b04-921871b784ad None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:19.549500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278294b-c670-4fec-8b04-921871b784ad None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:19.549770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278294b-c670-4fec-8b04-921871b784ad None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:19.555402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 244/488] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:19.555402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278294b-c670-4fec-8b04-921871b784ad None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:19.598844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:19.613332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f79c2-c792-4b99-beee-bd45f687910e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:19.634669 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:19.655348 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d036b-4d9c-44be-a9fc-3e36f299c3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:19.656421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d036b-4d9c-44be-a9fc-3e36f299c3db None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:19.656892 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d036b-4d9c-44be-a9fc-3e36f299c3db None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:19.657244 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d036b-4d9c-44be-a9fc-3e36f299c3db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:19.668221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d036b-4d9c-44be-a9fc-3e36f299c3db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:19.673028 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278294b-c670-4fec-8b04-921871b784ad None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:19.676448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-874d036b-4d9c-44be-a9fc-3e36f299c3db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:19.676448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:19.676448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:19.676448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:19.676448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:19.676448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:19.676448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:19.676448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:19.676448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:19.676448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:19.676448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:19.676448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:19.676448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:19.676448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:19.676448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:19.676448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:19.677353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:19.677353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:19.677353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:19.677353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:19.677353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:19.677353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:19.677353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:19.677353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:19.677353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:19.677353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:19.677353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:19.677353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:19.677353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:19.677353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:19.677353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:19.677353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:19.683137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:19.683137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:19.683137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:19.683137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:19.683137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:19.683137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:19.683137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:19.683137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:19.683137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:19.683137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:19.683137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:19.683137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:19.683137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 245/489] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:19.683137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf37f2e-5eac-4d80-81a5-e219b723accc None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:19.683854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf37f2e-5eac-4d80-81a5-e219b723accc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:19.683854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf37f2e-5eac-4d80-81a5-e219b723accc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:19.698898 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-abf37f2e-5eac-4d80-81a5-e219b723accc None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:19.700083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-abf37f2e-5eac-4d80-81a5-e219b723accc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:19.714604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c8693-a96b-4e03-85b5-3b94e97013c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:19.715266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c8693-a96b-4e03-85b5-3b94e97013c2 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:19.715547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c8693-a96b-4e03-85b5-3b94e97013c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:19.715821 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c8693-a96b-4e03-85b5-3b94e97013c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:19.716531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c8693-a96b-4e03-85b5-3b94e97013c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:19.716836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c8693-a96b-4e03-85b5-3b94e97013c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:19.718244 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c8693-a96b-4e03-85b5-3b94e97013c2 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:19.735013 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 245/490] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:19.735013 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a464d-dbde-4c22-9928-08c19deb3e03 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:19.735013 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a464d-dbde-4c22-9928-08c19deb3e03 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:19.735013 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a464d-dbde-4c22-9928-08c19deb3e03 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:19.735013 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 246/491] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:19.735013 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a464d-dbde-4c22-9928-08c19deb3e03 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:19.777819 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 246/492] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:19.778701 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf37f2e-5eac-4d80-81a5-e219b723accc None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:19.839827 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:19.849110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a464d-dbde-4c22-9928-08c19deb3e03 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:19.883427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85745c4-1c7d-41d2-a0b4-314178815910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:19.884094 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85745c4-1c7d-41d2-a0b4-314178815910 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:19.884377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85745c4-1c7d-41d2-a0b4-314178815910 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:19.885173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85745c4-1c7d-41d2-a0b4-314178815910 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:19.886011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85745c4-1c7d-41d2-a0b4-314178815910 None admin] RBAC: Adding query filter params (name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:19.886331 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85745c4-1c7d-41d2-a0b4-314178815910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:19.887706 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85745c4-1c7d-41d2-a0b4-314178815910 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:19.890177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf37f2e-5eac-4d80-81a5-e219b723accc None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:19.901333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 247/493] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:19.901333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e36ba-a31b-43de-af5a-ac037ea58ab6 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:19.901333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e36ba-a31b-43de-af5a-ac037ea58ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:19.901333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e36ba-a31b-43de-af5a-ac037ea58ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:19.905596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:19.918607 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-573e36ba-a31b-43de-af5a-ac037ea58ab6 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:19.919827 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-573e36ba-a31b-43de-af5a-ac037ea58ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:19.939023 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accecdd-8c95-4611-ba41-e2a99d96c0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:19.939818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accecdd-8c95-4611-ba41-e2a99d96c0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:19.940095 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accecdd-8c95-4611-ba41-e2a99d96c0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:19.940363 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accecdd-8c95-4611-ba41-e2a99d96c0a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:19.948238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accecdd-8c95-4611-ba41-e2a99d96c0a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:19.949664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accecdd-8c95-4611-ba41-e2a99d96c0a7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:19.966021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-1accecdd-8c95-4611-ba41-e2a99d96c0a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:48:19.966021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:19.966021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:19.966021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:19.966021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:19.966021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:19.966021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:19.966021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:19.966021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:19.966021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:19.966021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:19.966021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:19.966021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:19.966021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:19.966021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:19.966021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:19.966939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:19.967889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:19.967889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:19.967889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:19.967889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:19.967889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:19.967889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:19.967889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:19.967889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:19.967889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:48:19.967889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:19.967889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 247/494] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 7 21:48:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:19.968458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accecdd-8c95-4611-ba41-e2a99d96c0a7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:20.005635 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 248/495] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:20.005635 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e36ba-a31b-43de-af5a-ac037ea58ab6 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:20.080798 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accecdd-8c95-4611-ba41-e2a99d96c0a7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:20.096346 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:20.114359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e36ba-a31b-43de-af5a-ac037ea58ab6 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:20.118031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07569928-2f87-4a48-98c4-5f95b5095f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:20.119343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07569928-2f87-4a48-98c4-5f95b5095f5c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:20.119651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07569928-2f87-4a48-98c4-5f95b5095f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:20.119923 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07569928-2f87-4a48-98c4-5f95b5095f5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:20.130274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07569928-2f87-4a48-98c4-5f95b5095f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:20.138531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-07569928-2f87-4a48-98c4-5f95b5095f5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:20.138531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:20.138531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:20.138531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:20.138531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:20.138531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:20.138531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:20.138531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:20.138531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:20.138531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:20.138531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:20.138531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:20.138531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:20.138531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:20.138531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:20.138531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:20.139419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:20.139419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:20.139419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:20.139419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:20.139419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:20.139419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:20.139419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:20.139419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:20.139419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:20.139419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:20.139419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:20.139419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:20.139419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:20.139419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:20.139419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:20.139419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:20.140195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:20.140195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:20.140195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:20.140195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:20.140195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:20.140195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:20.140195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:20.140195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:20.140195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:20.140195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:20.140195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:20.140195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:20.140195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 248/496] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:20.140853 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07569928-2f87-4a48-98c4-5f95b5095f5c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:20.155302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53455bd-77d0-488e-a666-d43d5f80812d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:20.156096 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53455bd-77d0-488e-a666-d43d5f80812d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:20.156378 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53455bd-77d0-488e-a666-d43d5f80812d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:20.156655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53455bd-77d0-488e-a666-d43d5f80812d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:20.167228 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53455bd-77d0-488e-a666-d43d5f80812d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:20.168683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53455bd-77d0-488e-a666-d43d5f80812d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:20.177432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:20.188651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c53455bd-77d0-488e-a666-d43d5f80812d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:20.188651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:20.188651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:20.188651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:20.188651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:20.188651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:20.188651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:20.188651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:20.188651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:20.188651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:20.188651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:20.188651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:20.188651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:20.188651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:20.188651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:20.189518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:20.189518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:20.189518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:20.189518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:20.189518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:20.189518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:20.189518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:20.189518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:20.189518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:20.189518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:20.189518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:20.189518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:20.189518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:20.189518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:20.189518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:20.189518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:20.189518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:20.195642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:20.195642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:20.195642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:20.195642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:20.195642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 249/497] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:20.195642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53455bd-77d0-488e-a666-d43d5f80812d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:20.258844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07569928-2f87-4a48-98c4-5f95b5095f5c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:20.291502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ea0d4-ce6b-412c-9944-ab11942245d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:20.292168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ea0d4-ce6b-412c-9944-ab11942245d8 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:20.292451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ea0d4-ce6b-412c-9944-ab11942245d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:20.292725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ea0d4-ce6b-412c-9944-ab11942245d8 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:20.293560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ea0d4-ce6b-412c-9944-ab11942245d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:20.293872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ea0d4-ce6b-412c-9944-ab11942245d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:20.295331 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ea0d4-ce6b-412c-9944-ab11942245d8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:20.296191 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53455bd-77d0-488e-a666-d43d5f80812d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:20.329458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f57b4-88f8-481c-96e5-cd016f3997d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:20.330259 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f57b4-88f8-481c-96e5-cd016f3997d1 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:20.330537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f57b4-88f8-481c-96e5-cd016f3997d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:20.330802 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f57b4-88f8-481c-96e5-cd016f3997d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:20.332068 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 249/498] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 7 21:48:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:20.332882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ea0d4-ce6b-412c-9944-ab11942245d8 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:20.337757 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:20.342043 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f57b4-88f8-481c-96e5-cd016f3997d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:20.350208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-cc3f57b4-88f8-481c-96e5-cd016f3997d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:20.350208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:20.350208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:20.350208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:20.350208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:20.350208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:20.350208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:20.350208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:20.350208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:20.350208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:20.350208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:20.350208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:20.350208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:20.350208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:20.350208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:20.350208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:20.351126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:20.351126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:20.351126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:20.351126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:20.351126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:20.351126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:20.351126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:20.351126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:20.351126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:20.351126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:20.351126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:20.351126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:20.351126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:20.351126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:20.351126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:20.351126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:20.351911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:20.351911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:20.351911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:20.351911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:20.351911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:20.351911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:20.351911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:20.351911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:20.351911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:20.351911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:20.351911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:20.351911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:20.351911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 250/499] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:20.352559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f57b4-88f8-481c-96e5-cd016f3997d1 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:20.425671 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:20.440775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ea0d4-ce6b-412c-9944-ab11942245d8 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:20.451543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f57b4-88f8-481c-96e5-cd016f3997d1 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:20.475433 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7b1be-39fe-46c9-874f-ac5c44a95b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:20.476084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7b1be-39fe-46c9-874f-ac5c44a95b3d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:20.476361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7b1be-39fe-46c9-874f-ac5c44a95b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:20.476634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7b1be-39fe-46c9-874f-ac5c44a95b3d None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:20.477372 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7b1be-39fe-46c9-874f-ac5c44a95b3d None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:20.477672 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7b1be-39fe-46c9-874f-ac5c44a95b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:20.479071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7b1be-39fe-46c9-874f-ac5c44a95b3d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:20.484972 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbeaba0-3a2a-4781-94a6-a22316bad6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:20.485617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeaba0-3a2a-4781-94a6-a22316bad6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:20.485900 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeaba0-3a2a-4781-94a6-a22316bad6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:20.486206 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeaba0-3a2a-4781-94a6-a22316bad6c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:20.486800 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 250/500] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:20.486950 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbeaba0-3a2a-4781-94a6-a22316bad6c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:20.487222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbeaba0-3a2a-4781-94a6-a22316bad6c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:20.487978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a0d35-ced6-4dcf-9805-31eee8e67f4b None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:20.488262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a0d35-ced6-4dcf-9805-31eee8e67f4b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:20.488534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a0d35-ced6-4dcf-9805-31eee8e67f4b None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:20.488623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbeaba0-3a2a-4781-94a6-a22316bad6c2 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:20.489959 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 251/501] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:20.490448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a0d35-ced6-4dcf-9805-31eee8e67f4b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:20.503650 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 251/502] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:20.504758 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbeaba0-3a2a-4781-94a6-a22316bad6c2 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:20.562118 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:20.593226 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a0d35-ced6-4dcf-9805-31eee8e67f4b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:20.604455 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbeaba0-3a2a-4781-94a6-a22316bad6c2 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:20.625596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8040a-a41e-4428-bd31-74c786f57269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:20.626259 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8040a-a41e-4428-bd31-74c786f57269 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:20.626540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8040a-a41e-4428-bd31-74c786f57269 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:20.626813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8040a-a41e-4428-bd31-74c786f57269 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:20.637064 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018bcce-a583-4170-b71b-a2a9ff7ffba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:20.637708 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018bcce-a583-4170-b71b-a2a9ff7ffba8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:20.638012 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018bcce-a583-4170-b71b-a2a9ff7ffba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:20.638284 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018bcce-a583-4170-b71b-a2a9ff7ffba8 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:20.639019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018bcce-a583-4170-b71b-a2a9ff7ffba8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:20.639315 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018bcce-a583-4170-b71b-a2a9ff7ffba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:20.640662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018bcce-a583-4170-b71b-a2a9ff7ffba8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:20.644595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:20.648869 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 252/503] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:20.649385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018bcce-a583-4170-b71b-a2a9ff7ffba8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:20.697646 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8040a-a41e-4428-bd31-74c786f57269 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:20.699113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8040a-a41e-4428-bd31-74c786f57269 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:20.746800 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018bcce-a583-4170-b71b-a2a9ff7ffba8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:20.765753 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:20.780265 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b150676-cd75-474a-a855-9b770bc1660b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:20.781042 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b150676-cd75-474a-a855-9b770bc1660b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:20.781322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b150676-cd75-474a-a855-9b770bc1660b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:20.781597 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b150676-cd75-474a-a855-9b770bc1660b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:20.792504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b150676-cd75-474a-a855-9b770bc1660b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:20.793949 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b150676-cd75-474a-a855-9b770bc1660b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:20.796686 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 252/504] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:20.797950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a8fa8-3f54-41c8-a14d-73e17b5a3ce1 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:20.798244 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a8fa8-3f54-41c8-a14d-73e17b5a3ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:20.798517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a8fa8-3f54-41c8-a14d-73e17b5a3ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:20.812205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-4b150676-cd75-474a-a855-9b770bc1660b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:20.812205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:20.812205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:20.812205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:20.812205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:20.812205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:20.812205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:20.812205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:20.812205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:20.812205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:20.812205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:20.812205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:20.812205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:20.812205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:20.812205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:20.813205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:20.813205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:20.813205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:20.813205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:20.813205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:20.813205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:20.813205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:20.813205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:20.813205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:20.813205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:20.813205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:20.813205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:20.813205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:20.813205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:20.813205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:20.813205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:20.813205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:20.818869 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:20.818869 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:20.818869 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:20.818869 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:20.818869 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 253/505] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:20.818869 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b150676-cd75-474a-a855-9b770bc1660b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:20.819259 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-228a8fa8-3f54-41c8-a14d-73e17b5a3ce1 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:20.819887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-228a8fa8-3f54-41c8-a14d-73e17b5a3ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:20.862702 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:20.886189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 253/506] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:20.887116 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a8fa8-3f54-41c8-a14d-73e17b5a3ce1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:20.918255 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b150676-cd75-474a-a855-9b770bc1660b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:20.950525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e6a45-8029-48ab-88ec-8d82bde714eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:20.951309 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e6a45-8029-48ab-88ec-8d82bde714eb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:20.951585 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e6a45-8029-48ab-88ec-8d82bde714eb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:20.951852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e6a45-8029-48ab-88ec-8d82bde714eb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:20.959869 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e6a45-8029-48ab-88ec-8d82bde714eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:20.961303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e6a45-8029-48ab-88ec-8d82bde714eb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:20.977494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-804e6a45-8029-48ab-88ec-8d82bde714eb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 07 21:48:20.977494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:20.977494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:20.977494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:20.977494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:20.977494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:20.977494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:20.977494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:20.977494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:20.977494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:20.977494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:20.977494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:20.977494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:20.977494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:20.977494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:20.977494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:20.979151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:20.980251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:20.980251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:20.980251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:20.980251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:20.980251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:20.980251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:20.980251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:20.980251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:20.980251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 07 21:48:20.980251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:20.980251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 254/507] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:20.980251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e6a45-8029-48ab-88ec-8d82bde714eb None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:20.984685 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a8fa8-3f54-41c8-a14d-73e17b5a3ce1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:21.010252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:21.017676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f5725-2ece-4bd2-b97c-f75940d6c553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:21.018489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f5725-2ece-4bd2-b97c-f75940d6c553 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:21.018770 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f5725-2ece-4bd2-b97c-f75940d6c553 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:21.019041 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f5725-2ece-4bd2-b97c-f75940d6c553 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:21.029327 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f5725-2ece-4bd2-b97c-f75940d6c553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:21.030825 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f5725-2ece-4bd2-b97c-f75940d6c553 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:21.048406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-ca1f5725-2ece-4bd2-b97c-f75940d6c553 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:21.048406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:21.048406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:21.048406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:21.048406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:21.048406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:21.048406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:21.048406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:21.048406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:21.048406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:21.048406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:21.048406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:21.048406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:21.048406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:21.048406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:21.049413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:21.049413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:21.049413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:21.049413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:21.049413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:21.049413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:21.049413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:21.049413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:21.049413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:21.049413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:21.049413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:21.049413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:21.049413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:21.049413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:21.049413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:21.049413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:21.049413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:21.050475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:21.050475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:21.050475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:21.050475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:21.050475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 254/508] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:21.050475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f5725-2ece-4bd2-b97c-f75940d6c553 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:21.079380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:21.081762 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e6a45-8029-48ab-88ec-8d82bde714eb None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:21.114383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e31a7-2d1d-433c-8f0d-7bab5bf483be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:21.115168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e31a7-2d1d-433c-8f0d-7bab5bf483be None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:21.115452 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e31a7-2d1d-433c-8f0d-7bab5bf483be None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:21.115720 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e31a7-2d1d-433c-8f0d-7bab5bf483be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:21.126517 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e31a7-2d1d-433c-8f0d-7bab5bf483be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:21.127958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e31a7-2d1d-433c-8f0d-7bab5bf483be None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:21.144437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-6c5e31a7-2d1d-433c-8f0d-7bab5bf483be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:21.144437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:21.144437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:21.144437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:21.144437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:21.144437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:21.144437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:21.144437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:21.144437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:21.144437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:21.144437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:21.144437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:21.144437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:21.144437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:21.144437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:21.145420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:21.145420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:21.145420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:21.145420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:21.145420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:21.145420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:21.145420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:21.145420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:21.145420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:21.145420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:21.145420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:21.145420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:21.145420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:21.145420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:21.145420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:21.145420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:21.145420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:21.146393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:21.146393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:21.146393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:21.146393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:21.146393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 255/509] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:21.146652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e31a7-2d1d-433c-8f0d-7bab5bf483be None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:21.150615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f5725-2ece-4bd2-b97c-f75940d6c553 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:21.183144 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ae7ef-7fc0-4e32-9f43-a563622e3276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:21.183801 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ae7ef-7fc0-4e32-9f43-a563622e3276 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:21.184085 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ae7ef-7fc0-4e32-9f43-a563622e3276 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:21.184363 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ae7ef-7fc0-4e32-9f43-a563622e3276 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:21.185084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ae7ef-7fc0-4e32-9f43-a563622e3276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:21.185393 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ae7ef-7fc0-4e32-9f43-a563622e3276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:21.186807 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ae7ef-7fc0-4e32-9f43-a563622e3276 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:21.198767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 255/510] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:21.199554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ae7ef-7fc0-4e32-9f43-a563622e3276 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:21.232075 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:21.248757 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e31a7-2d1d-433c-8f0d-7bab5bf483be None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:21.281805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cea7e-9617-43af-9506-862f18c0c292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:21.282688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cea7e-9617-43af-9506-862f18c0c292 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:21.282970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cea7e-9617-43af-9506-862f18c0c292 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:21.283243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cea7e-9617-43af-9506-862f18c0c292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:21.286466 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:21.293581 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cea7e-9617-43af-9506-862f18c0c292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:21.295054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cea7e-9617-43af-9506-862f18c0c292 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:21.296218 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ae7ef-7fc0-4e32-9f43-a563622e3276 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:21.311766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-ed5cea7e-9617-43af-9506-862f18c0c292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:21.311766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:21.311766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:21.311766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:21.311766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:21.311766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:21.311766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:21.311766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:21.311766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:21.311766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:21.311766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:21.311766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:21.311766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:21.311766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:21.311766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:21.312766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:21.312766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:21.312766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:21.312766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:21.312766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:21.312766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:21.312766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:21.312766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:21.312766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:21.312766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:21.312766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:21.312766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:21.312766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:21.312766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:21.312766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:21.312766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:21.312766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:21.313807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:21.313807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:21.313807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:21.313807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:21.313807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 256/511] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:21.313807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cea7e-9617-43af-9506-862f18c0c292 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:21.332548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60be18b-6cf1-4053-b801-ece27c33cfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:21.333142 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60be18b-6cf1-4053-b801-ece27c33cfca None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:21.333425 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60be18b-6cf1-4053-b801-ece27c33cfca None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:21.333695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60be18b-6cf1-4053-b801-ece27c33cfca None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:21.334546 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60be18b-6cf1-4053-b801-ece27c33cfca None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:21.334854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60be18b-6cf1-4053-b801-ece27c33cfca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:21.336266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60be18b-6cf1-4053-b801-ece27c33cfca None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:21.355198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 256/512] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jun 7 21:48:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:21.356011 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60be18b-6cf1-4053-b801-ece27c33cfca None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:21.416360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cea7e-9617-43af-9506-862f18c0c292 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:21.448419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dffc07-388b-4e31-bce7-723984fbe6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:21.449059 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dffc07-388b-4e31-bce7-723984fbe6fc None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:21.449342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dffc07-388b-4e31-bce7-723984fbe6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:21.449611 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dffc07-388b-4e31-bce7-723984fbe6fc None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:21.450341 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dffc07-388b-4e31-bce7-723984fbe6fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:21.450646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dffc07-388b-4e31-bce7-723984fbe6fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:21.450863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60be18b-6cf1-4053-b801-ece27c33cfca None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:21.452011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dffc07-388b-4e31-bce7-723984fbe6fc None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:21.454245 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:21.464789 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 257/513] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:21.465574 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dffc07-388b-4e31-bce7-723984fbe6fc None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:21.485980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99004a4-9b0b-420c-b8ff-50d4742d2473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:21.486632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99004a4-9b0b-420c-b8ff-50d4742d2473 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:21.486909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99004a4-9b0b-420c-b8ff-50d4742d2473 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:21.487181 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99004a4-9b0b-420c-b8ff-50d4742d2473 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:21.487892 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99004a4-9b0b-420c-b8ff-50d4742d2473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:21.488194 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99004a4-9b0b-420c-b8ff-50d4742d2473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:21.489554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99004a4-9b0b-420c-b8ff-50d4742d2473 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:21.500465 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 257/514] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:21.501483 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99004a4-9b0b-420c-b8ff-50d4742d2473 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:21.513641 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:21.563567 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dffc07-388b-4e31-bce7-723984fbe6fc None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:21.596732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45885e93-16c3-4d6d-9168-ed0958612bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:21.597459 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885e93-16c3-4d6d-9168-ed0958612bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:21.597741 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885e93-16c3-4d6d-9168-ed0958612bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:21.598065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885e93-16c3-4d6d-9168-ed0958612bd2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:21.601125 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99004a4-9b0b-420c-b8ff-50d4742d2473 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:21.605332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45885e93-16c3-4d6d-9168-ed0958612bd2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:21.606809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45885e93-16c3-4d6d-9168-ed0958612bd2 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:21.622369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-45885e93-16c3-4d6d-9168-ed0958612bd2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 21:48:21.622369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:21.622369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:21.622369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:21.622369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:21.622369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:21.622369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:21.622369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:21.622369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:21.622369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:21.622369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:21.622369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:21.622369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:21.622369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:21.622369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:21.622369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:21.623426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:21.624512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:21.624512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:21.624512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:21.624512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:21.624512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:21.624512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:21.624512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:21.624512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:21.624512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 21:48:21.624512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:21.624512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 258/515] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:21.624512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45885e93-16c3-4d6d-9168-ed0958612bd2 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:21.637495 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2243b00-d5e0-4f99-9892-d604e1cfddf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:21.638244 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2243b00-d5e0-4f99-9892-d604e1cfddf3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:21.638604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2243b00-d5e0-4f99-9892-d604e1cfddf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:21.638946 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2243b00-d5e0-4f99-9892-d604e1cfddf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:21.639734 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2243b00-d5e0-4f99-9892-d604e1cfddf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:21.640110 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2243b00-d5e0-4f99-9892-d604e1cfddf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:21.641557 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2243b00-d5e0-4f99-9892-d604e1cfddf3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:21.653066 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 258/516] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:21.653840 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2243b00-d5e0-4f99-9892-d604e1cfddf3 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:21.680101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:21.717672 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:21.723875 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45885e93-16c3-4d6d-9168-ed0958612bd2 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:21.751456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2243b00-d5e0-4f99-9892-d604e1cfddf3 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:21.758506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5ad29-5a9d-42d4-a3be-348790335b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:21.759135 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5ad29-5a9d-42d4-a3be-348790335b78 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:21.759433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5ad29-5a9d-42d4-a3be-348790335b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:21.759733 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5ad29-5a9d-42d4-a3be-348790335b78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:21.784292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c6ac0-a51e-43ec-8bf6-2e87067770c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:21.785065 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c6ac0-a51e-43ec-8bf6-2e87067770c8 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:21.785340 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c6ac0-a51e-43ec-8bf6-2e87067770c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:21.785608 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c6ac0-a51e-43ec-8bf6-2e87067770c8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:21.793309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c6ac0-a51e-43ec-8bf6-2e87067770c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:21.794759 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c6ac0-a51e-43ec-8bf6-2e87067770c8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:21.808195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-409c6ac0-a51e-43ec-8bf6-2e87067770c8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 21:48:21.808195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:21.808195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:21.808195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:21.808195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:21.808195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:21.808195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:21.808195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:21.808195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:21.808195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:21.808195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:21.808195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:21.808195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:21.808195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:21.808195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:21.808195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:21.809230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:21.810387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:21.810387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:21.810387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:21.810387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:21.810387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:21.810387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:21.810387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:21.810387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:21.810387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 21:48:21.810387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:21.810387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 259/517] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:21.810387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c6ac0-a51e-43ec-8bf6-2e87067770c8 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:21.828408 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5ad29-5a9d-42d4-a3be-348790335b78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:21.830092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5ad29-5a9d-42d4-a3be-348790335b78 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:21.882759 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:21.905198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c6ac0-a51e-43ec-8bf6-2e87067770c8 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:21.927992 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 259/518] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:21.928819 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5ad29-5a9d-42d4-a3be-348790335b78 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:21.933223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:21.939140 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f35f3-f62a-4613-9780-55cbe7fa0cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:21.939924 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f35f3-f62a-4613-9780-55cbe7fa0cbf None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:21.940209 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f35f3-f62a-4613-9780-55cbe7fa0cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:21.940483 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f35f3-f62a-4613-9780-55cbe7fa0cbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:21.947849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f35f3-f62a-4613-9780-55cbe7fa0cbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:21.949292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f35f3-f62a-4613-9780-55cbe7fa0cbf None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:21.964123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-fa6f35f3-f62a-4613-9780-55cbe7fa0cbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:21.964123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:21.964123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:21.964123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:21.964123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:21.964123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:21.964123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:21.964123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:21.964123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:21.964123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:21.964123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:21.964123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:21.964123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:21.964123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:21.964123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:21.965098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:21.965098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:21.965098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:21.965098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:21.965098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:21.965098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:21.965098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:21.965098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:21.965098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:21.965098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:21.965098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:21.965098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:21.965098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:21.965098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:21.965098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:21.965098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:21.965098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:21.965979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:21.965979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:21.965979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:21.965979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:21.965979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:21.965979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:21.965979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:21.965979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:21.965979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 260/519] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:21.966527 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f35f3-f62a-4613-9780-55cbe7fa0cbf None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:22.025847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5ad29-5a9d-42d4-a3be-348790335b78 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:22.057421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b53732-bbf9-478a-b844-3a832d455bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:22.058108 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b53732-bbf9-478a-b844-3a832d455bfd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:22.058387 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b53732-bbf9-478a-b844-3a832d455bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:22.058661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b53732-bbf9-478a-b844-3a832d455bfd None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:22.059474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b53732-bbf9-478a-b844-3a832d455bfd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:22.059775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b53732-bbf9-478a-b844-3a832d455bfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:22.061183 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b53732-bbf9-478a-b844-3a832d455bfd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:22.065088 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f35f3-f62a-4613-9780-55cbe7fa0cbf None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:22.096910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 260/520] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Jun 7 21:48:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:22.097642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b53732-bbf9-478a-b844-3a832d455bfd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:22.100354 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659eee7-3b49-4d13-8334-c5196d4dc747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:22.101910 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659eee7-3b49-4d13-8334-c5196d4dc747 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:22.102229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659eee7-3b49-4d13-8334-c5196d4dc747 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:22.102512 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659eee7-3b49-4d13-8334-c5196d4dc747 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:22.103249 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659eee7-3b49-4d13-8334-c5196d4dc747 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:22.104684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659eee7-3b49-4d13-8334-c5196d4dc747 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:22.112254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:22.124597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 261/521] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:48:21 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:48:22.125390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659eee7-3b49-4d13-8334-c5196d4dc747 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:22.175454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:22.228785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b53732-bbf9-478a-b844-3a832d455bfd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:22.236025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659eee7-3b49-4d13-8334-c5196d4dc747 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:22.267644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52496678-85d6-410f-8834-5887ead961de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:22.268316 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52496678-85d6-410f-8834-5887ead961de None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:22.268600 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52496678-85d6-410f-8834-5887ead961de None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:22.268876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52496678-85d6-410f-8834-5887ead961de None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:22.269855 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52496678-85d6-410f-8834-5887ead961de None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:22.270223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52496678-85d6-410f-8834-5887ead961de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:22.270924 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed09473-95be-4026-8fec-a339603cf963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:22.271688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52496678-85d6-410f-8834-5887ead961de None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:22.271855 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed09473-95be-4026-8fec-a339603cf963 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:22.272200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed09473-95be-4026-8fec-a339603cf963 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:22.272539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed09473-95be-4026-8fec-a339603cf963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:22.285685 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed09473-95be-4026-8fec-a339603cf963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:22.287368 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed09473-95be-4026-8fec-a339603cf963 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:22.297838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 261/522] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jun 7 21:48:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:22.297838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52496678-85d6-410f-8834-5887ead961de None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:22.311013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-8ed09473-95be-4026-8fec-a339603cf963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:22.311013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:22.311013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:22.311013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:22.311013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:22.311013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:22.311013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:22.311013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:22.311013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:22.311013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:22.311013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:22.311013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:22.311013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:22.311013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:22.311013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:22.312094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:22.312094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:22.312094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:22.312094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:22.312094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:22.312094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:22.312094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:22.312094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:22.312094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:22.312094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:22.312094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:22.312094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:22.312094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:22.312094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:22.312094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:22.312094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:22.312094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:22.313131 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:22.313131 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:22.313131 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:22.313131 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:22.318604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 262/523] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:22.318604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed09473-95be-4026-8fec-a339603cf963 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:22.392014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:22.420899 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:22.423836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52496678-85d6-410f-8834-5887ead961de None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:22.427700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed09473-95be-4026-8fec-a339603cf963 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:22.459841 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8a75b-0db2-4f76-ac30-4df98e7069c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:22.460500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8a75b-0db2-4f76-ac30-4df98e7069c2 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:22.460783 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8a75b-0db2-4f76-ac30-4df98e7069c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:22.461058 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8a75b-0db2-4f76-ac30-4df98e7069c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:22.461837 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8a75b-0db2-4f76-ac30-4df98e7069c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:22.462185 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8a75b-0db2-4f76-ac30-4df98e7069c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:22.463717 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7e907-952d-4387-8fd1-6024121197d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:22.464185 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8a75b-0db2-4f76-ac30-4df98e7069c2 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:22.464412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7e907-952d-4387-8fd1-6024121197d1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:22.464749 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7e907-952d-4387-8fd1-6024121197d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:22.465031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7e907-952d-4387-8fd1-6024121197d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:22.484153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 262/524] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:22.484973 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8a75b-0db2-4f76-ac30-4df98e7069c2 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:22.544551 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7e907-952d-4387-8fd1-6024121197d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:22.546160 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7e907-952d-4387-8fd1-6024121197d1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:22.582452 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8a75b-0db2-4f76-ac30-4df98e7069c2 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:22.613598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:22.620175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af0d5d-6dde-4469-bcc3-28bd89b9e239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:22.620827 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af0d5d-6dde-4469-bcc3-28bd89b9e239 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:22.621110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af0d5d-6dde-4469-bcc3-28bd89b9e239 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:22.621382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af0d5d-6dde-4469-bcc3-28bd89b9e239 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:22.644746 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:22.656416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 263/525] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:22.656416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7e907-952d-4387-8fd1-6024121197d1 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:22.693197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af0d5d-6dde-4469-bcc3-28bd89b9e239 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:22.694600 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af0d5d-6dde-4469-bcc3-28bd89b9e239 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:22.763278 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7e907-952d-4387-8fd1-6024121197d1 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:22.796032 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccf716-5eea-4f0d-9664-90266dc326ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:22.796678 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccf716-5eea-4f0d-9664-90266dc326ab None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:22.796955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccf716-5eea-4f0d-9664-90266dc326ab None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:22.797233 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccf716-5eea-4f0d-9664-90266dc326ab None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:22.797974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccf716-5eea-4f0d-9664-90266dc326ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:22.798268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccf716-5eea-4f0d-9664-90266dc326ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:22.799631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccf716-5eea-4f0d-9664-90266dc326ab None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:22.808238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 263/526] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:22.808238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af0d5d-6dde-4469-bcc3-28bd89b9e239 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:22.814163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 264/527] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:22.814951 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccf716-5eea-4f0d-9664-90266dc326ab None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:22.843376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:22.871956 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:22.916804 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af0d5d-6dde-4469-bcc3-28bd89b9e239 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:22.917170 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccf716-5eea-4f0d-9664-90266dc326ab None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:22.951630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7f497-b012-4d01-96a5-ba787b52399b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:22.951916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7b489-b9a9-4649-aa91-2f0a477c87a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:22.952338 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7f497-b012-4d01-96a5-ba787b52399b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:22.952538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7b489-b9a9-4649-aa91-2f0a477c87a5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:22.952633 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7f497-b012-4d01-96a5-ba787b52399b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:22.952826 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7b489-b9a9-4649-aa91-2f0a477c87a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:22.952922 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7f497-b012-4d01-96a5-ba787b52399b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:22.953101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7b489-b9a9-4649-aa91-2f0a477c87a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:22.953952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7b489-b9a9-4649-aa91-2f0a477c87a5 None admin] RBAC: Adding query filter params (role.id=382652f08fc24ce39f91164181237006, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=1d5760a3f9f946978b1251d3e2aaa943) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:22.954269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7b489-b9a9-4649-aa91-2f0a477c87a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:22.955712 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7b489-b9a9-4649-aa91-2f0a477c87a5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:22.961750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 264/528] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:48:22 2022] GET /identity/v3/role_assignments?user.id=1d5760a3f9f946978b1251d3e2aaa943&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=382652f08fc24ce39f91164181237006 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:22.962666 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7b489-b9a9-4649-aa91-2f0a477c87a5 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:22.972507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7f497-b012-4d01-96a5-ba787b52399b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:22.974043 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7f497-b012-4d01-96a5-ba787b52399b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:23.001532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-38b7f497-b012-4d01-96a5-ba787b52399b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:23.001532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:23.001532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:23.001532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:23.001532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:23.001532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:23.001532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:23.001532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:23.001532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:23.001532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:23.001532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:23.001532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:23.001532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:23.001532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:23.001532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:23.002719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:23.002719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:23.002719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:23.002719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:23.002719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:23.002719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:23.002719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:23.002719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:23.002719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:23.002719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:23.002719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:23.002719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:23.002719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:23.002719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:23.002719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:23.002719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:23.002719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:23.003553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:23.003553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:23.003553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:23.003553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:23.003553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 265/529] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:23.004173 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7f497-b012-4d01-96a5-ba787b52399b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:23.097588 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:23.109190 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7b489-b9a9-4649-aa91-2f0a477c87a5 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:23.148244 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7f497-b012-4d01-96a5-ba787b52399b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:23.158014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43b0da-c906-435f-b54a-afafded11f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:23.159131 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43b0da-c906-435f-b54a-afafded11f13 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:23.160072 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:23.161125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43b0da-c906-435f-b54a-afafded11f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:23.161998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43b0da-c906-435f-b54a-afafded11f13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:23.182284 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43b0da-c906-435f-b54a-afafded11f13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:23.184955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43b0da-c906-435f-b54a-afafded11f13 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:23.191295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a7ae8-ae62-471b-944f-301c54f8186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:23.192092 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a7ae8-ae62-471b-944f-301c54f8186e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:23.192371 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a7ae8-ae62-471b-944f-301c54f8186e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:23.192644 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a7ae8-ae62-471b-944f-301c54f8186e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:23.199942 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a7ae8-ae62-471b-944f-301c54f8186e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:23.201384 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a7ae8-ae62-471b-944f-301c54f8186e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:23.207526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-fd43b0da-c906-435f-b54a-afafded11f13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:23.207526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:23.207526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:23.207526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:23.207526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:23.207526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:23.207526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:23.207526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:23.207526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:23.207526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:23.207526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:23.207526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:23.207526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:23.207526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:23.207526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:23.208342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:23.208342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:23.208342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:23.208342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:23.208342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:23.208342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:23.208342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:23.208342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:23.208342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:23.208342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:23.208342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:23.208342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:23.208342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:23.208342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:23.208342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:23.208342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:23.208342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:23.209187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:23.209187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:23.209187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:23.209187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:23.216329 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 265/530] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:23.216329 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43b0da-c906-435f-b54a-afafded11f13 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:23.221639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-5b1a7ae8-ae62-471b-944f-301c54f8186e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:23.221639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:23.221639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:23.221639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:23.221639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:23.221639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:23.221639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:23.221639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:23.221639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:23.221639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:23.221639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:23.221639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:23.221639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:23.221639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:23.221639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:23.222482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:23.222482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:23.222482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:23.222482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:23.222482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:23.222482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:23.222482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:23.222482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:23.222482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:23.222482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:23.222482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:23.222482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:23.222482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:23.222482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:23.222482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:23.222482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:23.222482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:23.223339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:23.223339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:23.223339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:23.223339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:23.223339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:23.223339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:23.223339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:23.223339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:23.223339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 266/531] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:23.223812 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a7ae8-ae62-471b-944f-301c54f8186e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:23.343799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a7ae8-ae62-471b-944f-301c54f8186e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:23.371295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43b0da-c906-435f-b54a-afafded11f13 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:23.389921 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bda5e-8198-435e-8dc8-99c8f4dc8c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:23.390908 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bda5e-8198-435e-8dc8-99c8f4dc8c18 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:23.391387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bda5e-8198-435e-8dc8-99c8f4dc8c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:23.391858 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bda5e-8198-435e-8dc8-99c8f4dc8c18 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:23.392894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bda5e-8198-435e-8dc8-99c8f4dc8c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:23.393448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bda5e-8198-435e-8dc8-99c8f4dc8c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:23.395060 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bda5e-8198-435e-8dc8-99c8f4dc8c18 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:23.412144 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 267/532] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:23.412144 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bda5e-8198-435e-8dc8-99c8f4dc8c18 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:23.419932 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556b37d-7623-4a64-a35a-ea4c4912c81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:23.420886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556b37d-7623-4a64-a35a-ea4c4912c81f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:23.421462 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556b37d-7623-4a64-a35a-ea4c4912c81f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:23.422012 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556b37d-7623-4a64-a35a-ea4c4912c81f None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:23.422933 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556b37d-7623-4a64-a35a-ea4c4912c81f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:23.423500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556b37d-7623-4a64-a35a-ea4c4912c81f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:23.425313 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556b37d-7623-4a64-a35a-ea4c4912c81f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:23.439674 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 266/533] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:23.440891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556b37d-7623-4a64-a35a-ea4c4912c81f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:23.448121 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:23.454878 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:23.541094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bda5e-8198-435e-8dc8-99c8f4dc8c18 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:23.555285 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556b37d-7623-4a64-a35a-ea4c4912c81f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:23.591018 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20a4e4-ed91-41ca-8652-38fa3dffef65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:23.592016 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20a4e4-ed91-41ca-8652-38fa3dffef65 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:23.592680 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20a4e4-ed91-41ca-8652-38fa3dffef65 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:23.593739 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20a4e4-ed91-41ca-8652-38fa3dffef65 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:23.595538 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20a4e4-ed91-41ca-8652-38fa3dffef65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:23.596050 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20a4e4-ed91-41ca-8652-38fa3dffef65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:23.597703 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20a4e4-ed91-41ca-8652-38fa3dffef65 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:23.599464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce0686-d605-44a1-a177-bb4859cc7759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:23.600636 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce0686-d605-44a1-a177-bb4859cc7759 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:23.600914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce0686-d605-44a1-a177-bb4859cc7759 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:23.601181 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce0686-d605-44a1-a177-bb4859cc7759 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:23.608536 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce0686-d605-44a1-a177-bb4859cc7759 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:23.610442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce0686-d605-44a1-a177-bb4859cc7759 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:23.617566 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 268/534] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:23.618825 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20a4e4-ed91-41ca-8652-38fa3dffef65 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:23.627410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-f4ce0686-d605-44a1-a177-bb4859cc7759 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:23.627410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:23.627410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:23.627410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:23.627410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:23.627410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:23.627410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:23.627410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:23.627410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:23.627410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:23.627410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:23.627410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:23.627410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:23.627410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:23.627410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:23.628591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:23.628591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:23.628591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:23.628591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:23.628591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:23.628591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:23.628591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:23.628591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:23.628591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:23.628591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:23.628591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:23.628591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:23.628591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:23.628591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:23.628591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:23.628591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:23.628591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:23.629441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:23.629441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:23.629441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:23.629441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:23.629441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:23.629441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:23.629441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:23.629441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:23.633685 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 267/535] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:23.635114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce0686-d605-44a1-a177-bb4859cc7759 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:23.721678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:23.725185 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:23.741105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20a4e4-ed91-41ca-8652-38fa3dffef65 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:23.763461 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce0686-d605-44a1-a177-bb4859cc7759 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:23.786202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c713d2-f92d-4343-bccc-10cf712b189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:23.787028 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c713d2-f92d-4343-bccc-10cf712b189e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:23.787305 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c713d2-f92d-4343-bccc-10cf712b189e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:23.787574 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c713d2-f92d-4343-bccc-10cf712b189e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:23.797317 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c713d2-f92d-4343-bccc-10cf712b189e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:23.799199 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c713d2-f92d-4343-bccc-10cf712b189e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:23.802237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855ea94-faaf-48ec-bce4-bcf4eb460de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:23.803152 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855ea94-faaf-48ec-bce4-bcf4eb460de2 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:23.803652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855ea94-faaf-48ec-bce4-bcf4eb460de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:23.804120 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855ea94-faaf-48ec-bce4-bcf4eb460de2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:23.805199 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855ea94-faaf-48ec-bce4-bcf4eb460de2 None admin] RBAC: Adding query filter params (role.id=382652f08fc24ce39f91164181237006, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=1a3c022963e74e989a703938ff057757) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:23.805704 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855ea94-faaf-48ec-bce4-bcf4eb460de2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:23.807937 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855ea94-faaf-48ec-bce4-bcf4eb460de2 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:23.814490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 268/536] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:48:23 2022] GET /identity/v3/role_assignments?user.id=1a3c022963e74e989a703938ff057757&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=382652f08fc24ce39f91164181237006 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:23.815241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-01c713d2-f92d-4343-bccc-10cf712b189e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:23.815241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:23.815241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:23.815241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:23.815241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:23.815241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:23.815241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:23.815241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:23.815241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:23.815241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:23.815241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:23.815241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:23.815241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:23.815241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:23.815241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:23.816075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:23.816075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:23.816075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:23.816075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:23.816075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:23.816075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:23.816075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:23.816075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:23.816075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:23.816075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:23.816075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:23.816075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:23.816075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:23.816075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:23.816075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:23.816075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:23.816075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:23.816926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:23.816926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:23.816926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:23.816926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:23.816926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:23.816926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:23.816926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:23.816926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:23.818297 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855ea94-faaf-48ec-bce4-bcf4eb460de2 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:23.821129 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 269/537] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:23.822662 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c713d2-f92d-4343-bccc-10cf712b189e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:23.958681 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c713d2-f92d-4343-bccc-10cf712b189e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:24.001637 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70512c-d2d5-4f08-8e9a-dbab3ba0c9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:24.002338 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70512c-d2d5-4f08-8e9a-dbab3ba0c9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:24.002617 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70512c-d2d5-4f08-8e9a-dbab3ba0c9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:24.002888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70512c-d2d5-4f08-8e9a-dbab3ba0c9a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:24.003683 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70512c-d2d5-4f08-8e9a-dbab3ba0c9a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:24.003987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70512c-d2d5-4f08-8e9a-dbab3ba0c9a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:24.005455 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70512c-d2d5-4f08-8e9a-dbab3ba0c9a7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:24.025755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 270/538] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:24.027054 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70512c-d2d5-4f08-8e9a-dbab3ba0c9a7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:24.039619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:24.048916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855ea94-faaf-48ec-bce4-bcf4eb460de2 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:24.123674 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:24.142641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364263f-5c01-475b-9ab3-5688ed579e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:24.143662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364263f-5c01-475b-9ab3-5688ed579e7b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:24.144165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364263f-5c01-475b-9ab3-5688ed579e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:24.144638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364263f-5c01-475b-9ab3-5688ed579e7b None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:24.145649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364263f-5c01-475b-9ab3-5688ed579e7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:24.146198 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364263f-5c01-475b-9ab3-5688ed579e7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:24.147851 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364263f-5c01-475b-9ab3-5688ed579e7b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:24.149606 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70512c-d2d5-4f08-8e9a-dbab3ba0c9a7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:24.174678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 269/539] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:24.192220 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c1a61-c720-4659-8919-930efc58412e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:24.192872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c1a61-c720-4659-8919-930efc58412e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:24.193151 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c1a61-c720-4659-8919-930efc58412e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:24.193420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c1a61-c720-4659-8919-930efc58412e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:24.194615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c1a61-c720-4659-8919-930efc58412e None admin] RBAC: Adding query filter params (role.id=382652f08fc24ce39f91164181237006, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=aab50bc9064e444184afb1b4c585ce39) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:24.194926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c1a61-c720-4659-8919-930efc58412e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:24.195925 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364263f-5c01-475b-9ab3-5688ed579e7b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:24.196361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c1a61-c720-4659-8919-930efc58412e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:24.210369 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 271/540] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:48:24 2022] GET /identity/v3/role_assignments?user.id=aab50bc9064e444184afb1b4c585ce39&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=382652f08fc24ce39f91164181237006 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:24.385514 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364263f-5c01-475b-9ab3-5688ed579e7b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:24.435638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e403651-c0ff-4a9f-b659-efeff3030105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:24.436325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e403651-c0ff-4a9f-b659-efeff3030105 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:24.436580 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e403651-c0ff-4a9f-b659-efeff3030105 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:24.436858 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e403651-c0ff-4a9f-b659-efeff3030105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:24.437697 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e403651-c0ff-4a9f-b659-efeff3030105 None admin] RBAC: Adding query filter params (role.id=382652f08fc24ce39f91164181237006, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=5688ba6551834757b7eeef45a15f16e9) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:24.438085 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e403651-c0ff-4a9f-b659-efeff3030105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:24.438188 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaeb3c-a721-4a4a-b903-46e1bc64f5bd None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:24.438402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaeb3c-a721-4a4a-b903-46e1bc64f5bd None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:24.438673 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaeb3c-a721-4a4a-b903-46e1bc64f5bd None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:24.439539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e403651-c0ff-4a9f-b659-efeff3030105 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:24.441688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 272/541] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:48:24.446108 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 270/542] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:48:24 2022] GET /identity/v3/role_assignments?user.id=5688ba6551834757b7eeef45a15f16e9&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=382652f08fc24ce39f91164181237006 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:24.447182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbe858-7d2f-41b3-b653-61eb64bb7bf0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:24.447470 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbe858-7d2f-41b3-b653-61eb64bb7bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:24.447745 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbe858-7d2f-41b3-b653-61eb64bb7bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:24.487362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e1bbe858-7d2f-41b3-b653-61eb64bb7bf0 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:24.488610 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e1bbe858-7d2f-41b3-b653-61eb64bb7bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:24.603976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 273/543] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:48:24.652894 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e403651-c0ff-4a9f-b659-efeff3030105 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:24.715646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:24.773543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e403651-c0ff-4a9f-b659-efeff3030105 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:24.823609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a849eb-e114-4403-bc34-feb8765a69f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:24.824815 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a849eb-e114-4403-bc34-feb8765a69f8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:24.825289 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a849eb-e114-4403-bc34-feb8765a69f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:24.825821 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a849eb-e114-4403-bc34-feb8765a69f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:24.840769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a849eb-e114-4403-bc34-feb8765a69f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:24.848939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-97a849eb-e114-4403-bc34-feb8765a69f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:24.848939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:24.848939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:24.848939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:24.848939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:24.848939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:24.848939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:24.848939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:24.848939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:24.848939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:24.848939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:24.848939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:24.848939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:24.848939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:24.848939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:24.848939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:24.850110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:24.850110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:24.850110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:24.850110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:24.850110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:24.850110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:24.850110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:24.850110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:24.850110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:24.850110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:24.850110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:24.850110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:24.850110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:24.850110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:24.850110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:24.850110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:24.850924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:24.850924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:24.850924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:24.850924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:24.850924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:24.850924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:24.850924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:24.850924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:24.850924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:24.850924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:24.850924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:24.850924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:24.853355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 271/544] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:24.859344 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbe858-7d2f-41b3-b653-61eb64bb7bf0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:24.861544 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:24.999225 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbe858-7d2f-41b3-b653-61eb64bb7bf0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:25.033883 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a661c-c820-4ef6-a3a5-6ed2a7a13728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:25.034581 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a661c-c820-4ef6-a3a5-6ed2a7a13728 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:25.034865 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a661c-c820-4ef6-a3a5-6ed2a7a13728 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:25.035144 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a661c-c820-4ef6-a3a5-6ed2a7a13728 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:25.035896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a661c-c820-4ef6-a3a5-6ed2a7a13728 None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:25.036204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a661c-c820-4ef6-a3a5-6ed2a7a13728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:25.037600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a661c-c820-4ef6-a3a5-6ed2a7a13728 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:25.046082 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 274/545] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:25.051331 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a849eb-e114-4403-bc34-feb8765a69f8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:25.195571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a849eb-e114-4403-bc34-feb8765a69f8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:25.212830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:25.240829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67603387-543e-4d04-89fc-d9b1f6f2265b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:25.241646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67603387-543e-4d04-89fc-d9b1f6f2265b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:25.241938 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67603387-543e-4d04-89fc-d9b1f6f2265b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:25.242212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67603387-543e-4d04-89fc-d9b1f6f2265b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:25.255852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67603387-543e-4d04-89fc-d9b1f6f2265b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:25.257240 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67603387-543e-4d04-89fc-d9b1f6f2265b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:25.285151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-67603387-543e-4d04-89fc-d9b1f6f2265b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:25.285151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:25.285151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:25.285151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:25.285151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:25.285151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:25.285151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:25.285151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:25.285151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:25.285151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:25.285151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:25.285151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:25.285151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:25.285151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:25.285151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:25.286092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:25.286092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:25.286092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:25.286092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:25.286092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:25.286092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:25.286092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:25.286092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:25.286092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:25.286092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:25.286092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:25.286092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:25.286092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:25.286092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:25.286092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:25.286092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:25.286092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:25.286929 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:25.286929 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:25.286929 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:25.286929 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:25.286929 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 272/546] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:25.292724 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a661c-c820-4ef6-a3a5-6ed2a7a13728 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:25.392244 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:25.442465 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a661c-c820-4ef6-a3a5-6ed2a7a13728 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:25.493769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c76b44-caab-40b5-9980-20526fb4841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:25.494451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c76b44-caab-40b5-9980-20526fb4841c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:25.494736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c76b44-caab-40b5-9980-20526fb4841c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:25.495017 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c76b44-caab-40b5-9980-20526fb4841c None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:25.495740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c76b44-caab-40b5-9980-20526fb4841c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:25.496045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c76b44-caab-40b5-9980-20526fb4841c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:25.497403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c76b44-caab-40b5-9980-20526fb4841c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:25.513722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 275/547] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:25.519097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67603387-543e-4d04-89fc-d9b1f6f2265b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:25.593147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2da110-de8d-4c74-8d8b-8c2d009195d1 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:25.593346 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2da110-de8d-4c74-8d8b-8c2d009195d1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:25.593725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2da110-de8d-4c74-8d8b-8c2d009195d1 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:25.595464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 276/548] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:48:25.600854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c91c84-50b5-424d-98be-75fd6f0a1f18 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:25.601251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c91c84-50b5-424d-98be-75fd6f0a1f18 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:25.601621 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c91c84-50b5-424d-98be-75fd6f0a1f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:25.638955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-20c91c84-50b5-424d-98be-75fd6f0a1f18 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:25.640239 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-20c91c84-50b5-424d-98be-75fd6f0a1f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:25.670533 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67603387-543e-4d04-89fc-d9b1f6f2265b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:25.709546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde43777-450e-4ddc-a876-f25923615f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:25.710612 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde43777-450e-4ddc-a876-f25923615f2e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:25.711033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde43777-450e-4ddc-a876-f25923615f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:25.711441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde43777-450e-4ddc-a876-f25923615f2e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:25.720284 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde43777-450e-4ddc-a876-f25923615f2e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:25.721877 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde43777-450e-4ddc-a876-f25923615f2e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:25.736812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-fde43777-450e-4ddc-a876-f25923615f2e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 21:48:25.736812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:25.736812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:25.736812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:25.736812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:25.736812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:25.736812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:25.736812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:25.736812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:25.736812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:25.736812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:25.736812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:25.736812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:25.736812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:25.736812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:25.736812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:25.738433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:25.739546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:25.739546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:25.739546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:25.739546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:25.739546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:25.739546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:25.739546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:25.739546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:25.739546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 21:48:25.739546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:25.746021 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 273/549] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:48:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:25.748309 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde43777-450e-4ddc-a876-f25923615f2e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:25.778926 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:25.819297 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 277/550] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:48:25.855952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde43777-450e-4ddc-a876-f25923615f2e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:25.859889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c91c84-50b5-424d-98be-75fd6f0a1f18 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:25.892351 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a90aa-4c56-49ef-a8fe-e7c6a79db84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:25.893415 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a90aa-4c56-49ef-a8fe-e7c6a79db84c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:25.893902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a90aa-4c56-49ef-a8fe-e7c6a79db84c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:25.894413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a90aa-4c56-49ef-a8fe-e7c6a79db84c None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:25.895428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a90aa-4c56-49ef-a8fe-e7c6a79db84c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:25.895956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a90aa-4c56-49ef-a8fe-e7c6a79db84c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:25.897600 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a90aa-4c56-49ef-a8fe-e7c6a79db84c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:25.922322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 274/551] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jun 7 21:48:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:25.924030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a90aa-4c56-49ef-a8fe-e7c6a79db84c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:25.970644 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:26.023272 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:26.039368 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a90aa-4c56-49ef-a8fe-e7c6a79db84c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:26.048377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c91c84-50b5-424d-98be-75fd6f0a1f18 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:26.077224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfee07-3cf7-4f52-9ef0-675360a4f516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:26.078302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfee07-3cf7-4f52-9ef0-675360a4f516 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:26.078781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfee07-3cf7-4f52-9ef0-675360a4f516 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:26.079271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfee07-3cf7-4f52-9ef0-675360a4f516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:26.146898 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31414a-927f-4fbd-b1fc-b24009ecb183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:26.147738 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31414a-927f-4fbd-b1fc-b24009ecb183 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:26.148019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31414a-927f-4fbd-b1fc-b24009ecb183 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:26.148286 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31414a-927f-4fbd-b1fc-b24009ecb183 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:26.151761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfee07-3cf7-4f52-9ef0-675360a4f516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:26.153451 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfee07-3cf7-4f52-9ef0-675360a4f516 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:26.178853 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31414a-927f-4fbd-b1fc-b24009ecb183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:26.192618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-fc31414a-927f-4fbd-b1fc-b24009ecb183 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:26.192618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:26.192618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:26.192618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:26.192618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:26.192618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:26.192618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:26.192618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:26.192618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:26.192618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:26.192618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:26.192618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:26.192618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:26.192618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:26.192618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:26.192618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:26.193743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:26.193743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:26.193743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:26.193743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:26.193743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:26.193743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:26.193743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:26.193743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:26.193743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:26.193743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:26.193743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:26.193743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:26.193743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:26.193743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:26.193743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:26.193743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:26.194965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:26.194965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:26.194965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:26.194965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:26.194965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:26.194965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:26.194965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:26.194965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:26.194965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:26.194965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:26.194965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:26.194965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:26.194965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 278/552] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:26.200715 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31414a-927f-4fbd-b1fc-b24009ecb183 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:26.258336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:26.270992 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 275/553] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 21:48:26.273339 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfee07-3cf7-4f52-9ef0-675360a4f516 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:26.377812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfee07-3cf7-4f52-9ef0-675360a4f516 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:26.413400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff163fe-adca-4f60-95c9-58770a20c043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:26.414393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff163fe-adca-4f60-95c9-58770a20c043 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:26.414749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff163fe-adca-4f60-95c9-58770a20c043 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:26.415114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff163fe-adca-4f60-95c9-58770a20c043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:26.425876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff163fe-adca-4f60-95c9-58770a20c043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:26.427480 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff163fe-adca-4f60-95c9-58770a20c043 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:26.445864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-dff163fe-adca-4f60-95c9-58770a20c043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:26.445864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:26.445864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:26.445864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:26.445864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:26.445864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:26.445864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:26.445864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:26.445864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:26.445864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:26.445864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:26.445864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:26.445864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:26.445864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:26.445864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:26.447546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:26.447546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:26.447546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:26.447546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:26.447546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:26.447546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:26.447546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:26.447546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:26.447546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:26.447546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:26.447546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:26.447546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:26.447546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:26.447546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:26.447546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:26.447546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:26.447546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:26.448417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:26.448417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:26.448417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:26.448417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:26.452649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 276/554] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:26.453828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff163fe-adca-4f60-95c9-58770a20c043 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:26.502470 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:26.514352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31414a-927f-4fbd-b1fc-b24009ecb183 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:26.532575 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:26.555192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb89e38-c818-4c6b-80b5-ae454b0c35ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:26.556835 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb89e38-c818-4c6b-80b5-ae454b0c35ba None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:26.557312 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb89e38-c818-4c6b-80b5-ae454b0c35ba None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:26.557777 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb89e38-c818-4c6b-80b5-ae454b0c35ba None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:26.558891 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb89e38-c818-4c6b-80b5-ae454b0c35ba None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:26.559464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb89e38-c818-4c6b-80b5-ae454b0c35ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:26.561197 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb89e38-c818-4c6b-80b5-ae454b0c35ba None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:26.564952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff163fe-adca-4f60-95c9-58770a20c043 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:26.570531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 279/555] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:26.576185 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb89e38-c818-4c6b-80b5-ae454b0c35ba None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:26.602272 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b29b0f-cbd3-4f2b-b2d3-0b045a242a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:26.603180 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b29b0f-cbd3-4f2b-b2d3-0b045a242a32 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:26.603467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b29b0f-cbd3-4f2b-b2d3-0b045a242a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:26.603743 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b29b0f-cbd3-4f2b-b2d3-0b045a242a32 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:26.604603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b29b0f-cbd3-4f2b-b2d3-0b045a242a32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:26.604914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b29b0f-cbd3-4f2b-b2d3-0b045a242a32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:26.606317 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b29b0f-cbd3-4f2b-b2d3-0b045a242a32 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:26.623856 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 277/556] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:26.625186 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b29b0f-cbd3-4f2b-b2d3-0b045a242a32 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:26.690019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb89e38-c818-4c6b-80b5-ae454b0c35ba None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:26.730034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:26.733555 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b29b0f-cbd3-4f2b-b2d3-0b045a242a32 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:26.766669 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112db6e8-214d-4552-b8b1-3b8695d447a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:26.767478 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112db6e8-214d-4552-b8b1-3b8695d447a3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:26.767765 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112db6e8-214d-4552-b8b1-3b8695d447a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:26.767970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4306b-7d5e-4023-8710-59e9d5ec919b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:26.768063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112db6e8-214d-4552-b8b1-3b8695d447a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:26.768910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4306b-7d5e-4023-8710-59e9d5ec919b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:26.769188 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4306b-7d5e-4023-8710-59e9d5ec919b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:26.769453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4306b-7d5e-4023-8710-59e9d5ec919b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:26.777089 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4306b-7d5e-4023-8710-59e9d5ec919b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:26.778590 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4306b-7d5e-4023-8710-59e9d5ec919b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:26.790346 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112db6e8-214d-4552-b8b1-3b8695d447a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:26.792392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112db6e8-214d-4552-b8b1-3b8695d447a3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:26.793996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-edb4306b-7d5e-4023-8710-59e9d5ec919b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:26.793996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:26.793996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:26.793996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:26.793996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:26.793996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:26.793996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:26.793996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:26.793996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:26.793996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:26.793996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:26.793996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:26.793996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:26.793996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:26.793996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:26.795281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:26.795281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:26.795281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:26.795281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:26.795281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:26.795281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:26.795281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:26.795281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:26.795281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:26.795281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:26.795281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:26.795281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:26.795281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:26.795281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:26.795281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:26.795281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:26.795281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:26.796142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:26.796142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:26.796142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:26.796142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:26.796142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:26.796142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:26.796142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:26.796142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:26.799809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 278/557] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:26.801156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bddaf-4a40-4fb0-8b4e-4089f80318a5 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:26.801444 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bddaf-4a40-4fb0-8b4e-4089f80318a5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:26.801719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bddaf-4a40-4fb0-8b4e-4089f80318a5 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:26.803772 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 279/558] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:26.804578 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bddaf-4a40-4fb0-8b4e-4089f80318a5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:26.810332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-112db6e8-214d-4552-b8b1-3b8695d447a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:26.810332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:26.810332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:26.810332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:26.810332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:26.810332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:26.810332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:26.810332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:26.810332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:26.810332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:26.810332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:26.810332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:26.810332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:26.810332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:26.810332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:26.811351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:26.811351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:26.811351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:26.811351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:26.811351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:26.811351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:26.811351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:26.811351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:26.811351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:26.811351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:26.811351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:26.811351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:26.811351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:26.811351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:26.811351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:26.811351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:26.811351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:26.812509 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:26.812509 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:26.812509 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:26.812509 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:26.813980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 280/559] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:26.815326 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3808f-ed08-4c9b-9076-25c1af38ce61 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:26.815731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3808f-ed08-4c9b-9076-25c1af38ce61 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:26.816112 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3808f-ed08-4c9b-9076-25c1af38ce61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:26.835117 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-44e3808f-ed08-4c9b-9076-25c1af38ce61 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:26.836582 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-44e3808f-ed08-4c9b-9076-25c1af38ce61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:26.862559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:26.908723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bddaf-4a40-4fb0-8b4e-4089f80318a5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:26.922215 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 281/560] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:26.923543 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3808f-ed08-4c9b-9076-25c1af38ce61 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:26.943963 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ed4e8-81eb-40a4-a719-1e1cfb1324bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:26.944643 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ed4e8-81eb-40a4-a719-1e1cfb1324bc None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:26.944920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ed4e8-81eb-40a4-a719-1e1cfb1324bc None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:26.945188 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ed4e8-81eb-40a4-a719-1e1cfb1324bc None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:26.946016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ed4e8-81eb-40a4-a719-1e1cfb1324bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:26.946326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ed4e8-81eb-40a4-a719-1e1cfb1324bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:26.948363 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ed4e8-81eb-40a4-a719-1e1cfb1324bc None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:26.965252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 280/561] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:26.967619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ed4e8-81eb-40a4-a719-1e1cfb1324bc None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:26.989076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:27.058908 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3808f-ed08-4c9b-9076-25c1af38ce61 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:27.071106 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ed4e8-81eb-40a4-a719-1e1cfb1324bc None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:27.094105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441031d-60ed-47ec-8752-aa48022be582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:27.094851 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441031d-60ed-47ec-8752-aa48022be582 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:27.095201 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441031d-60ed-47ec-8752-aa48022be582 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:27.095543 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441031d-60ed-47ec-8752-aa48022be582 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:27.096334 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441031d-60ed-47ec-8752-aa48022be582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:27.096793 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441031d-60ed-47ec-8752-aa48022be582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:27.098166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441031d-60ed-47ec-8752-aa48022be582 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:27.106106 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79609bf0-2d53-4684-8b1d-771a2cbdf4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:27.106895 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79609bf0-2d53-4684-8b1d-771a2cbdf4bc None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:27.107171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79609bf0-2d53-4684-8b1d-771a2cbdf4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:27.107443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79609bf0-2d53-4684-8b1d-771a2cbdf4bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:27.113975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 282/562] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:27.113975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441031d-60ed-47ec-8752-aa48022be582 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:27.119876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79609bf0-2d53-4684-8b1d-771a2cbdf4bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:27.127716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-79609bf0-2d53-4684-8b1d-771a2cbdf4bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:27.127716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:27.127716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:27.127716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:27.127716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:27.127716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:27.127716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:27.127716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:27.127716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:27.127716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:27.127716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:27.127716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:27.127716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:27.127716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:27.127716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:27.127716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:27.128699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:27.128699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:27.128699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:27.128699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:27.128699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:27.128699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:27.128699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:27.128699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:27.128699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:27.128699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:27.128699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:27.128699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:27.128699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:27.128699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:27.128699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:27.128699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:27.129519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:27.129519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:27.129519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:27.129519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:27.129519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:27.129519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:27.129519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:27.129519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:27.129519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:27.129519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:27.129519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:27.129519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:27.132055 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 281/563] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:27.133507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dee94-7e93-487f-9bcf-d4d049681d86 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:27.133952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dee94-7e93-487f-9bcf-d4d049681d86 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:27.134391 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dee94-7e93-487f-9bcf-d4d049681d86 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:27.136022 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 282/564] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:27.137267 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dee94-7e93-487f-9bcf-d4d049681d86 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:27.140521 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:27.220321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:27.229624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441031d-60ed-47ec-8752-aa48022be582 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:27.244849 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dee94-7e93-487f-9bcf-d4d049681d86 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:27.267781 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436b717-f55a-42a9-a68a-0d20f72cc90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:27.268673 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436b717-f55a-42a9-a68a-0d20f72cc90e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:27.269099 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436b717-f55a-42a9-a68a-0d20f72cc90e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:27.269537 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436b717-f55a-42a9-a68a-0d20f72cc90e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:27.270404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436b717-f55a-42a9-a68a-0d20f72cc90e None admin] RBAC: Adding query filter params (role.id=382652f08fc24ce39f91164181237006, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=a4b69c708fbc470aae3e3954e21a1e88) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:27.270719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436b717-f55a-42a9-a68a-0d20f72cc90e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:27.272144 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436b717-f55a-42a9-a68a-0d20f72cc90e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:27.289956 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 283/565] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:48:27 2022] GET /identity/v3/role_assignments?user.id=a4b69c708fbc470aae3e3954e21a1e88&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=382652f08fc24ce39f91164181237006 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:27.290192 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec9ea3-4602-4545-b879-55f6328d12e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:27.290304 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436b717-f55a-42a9-a68a-0d20f72cc90e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:27.290405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec9ea3-4602-4545-b879-55f6328d12e0 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:27.290405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec9ea3-4602-4545-b879-55f6328d12e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:27.290405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec9ea3-4602-4545-b879-55f6328d12e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:27.300099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec9ea3-4602-4545-b879-55f6328d12e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:27.301608 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec9ea3-4602-4545-b879-55f6328d12e0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:27.317071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-98ec9ea3-4602-4545-b879-55f6328d12e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:48:27.317071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:27.317071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:27.317071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:27.317071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:27.317071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:27.317071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:27.317071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:27.317071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:27.317071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:27.317071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:27.317071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:27.317071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:27.317071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:27.317071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:27.317071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:27.318175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:27.319117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:27.319117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:27.319117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:27.319117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:27.319117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:27.319117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:27.319117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:27.319117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:27.319117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:48:27.319117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:27.319117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 283/566] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 7 21:48:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:27.319714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70cf74-7bea-41bc-9e5e-1e5809ad6975 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:27.320519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70cf74-7bea-41bc-9e5e-1e5809ad6975 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:27.320519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70cf74-7bea-41bc-9e5e-1e5809ad6975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:27.339698 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4a70cf74-7bea-41bc-9e5e-1e5809ad6975 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:27.340916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4a70cf74-7bea-41bc-9e5e-1e5809ad6975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:27.391776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:27.415100 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436b717-f55a-42a9-a68a-0d20f72cc90e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:27.424259 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 284/567] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:27.425504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaa1f2-440c-483f-aa74-d5f3614b22d7 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:27.425802 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaa1f2-440c-483f-aa74-d5f3614b22d7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:27.426116 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaa1f2-440c-483f-aa74-d5f3614b22d7 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:27.432327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 285/568] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:27.432327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaa1f2-440c-483f-aa74-d5f3614b22d7 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:27.469205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe43a66-a992-4d2c-b472-b038eeed38b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:27.469884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe43a66-a992-4d2c-b472-b038eeed38b9 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:27.470202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe43a66-a992-4d2c-b472-b038eeed38b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:27.470526 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe43a66-a992-4d2c-b472-b038eeed38b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:27.471220 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe43a66-a992-4d2c-b472-b038eeed38b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:27.471522 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe43a66-a992-4d2c-b472-b038eeed38b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:27.472937 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe43a66-a992-4d2c-b472-b038eeed38b9 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:27.481754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 284/569] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:27.483019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c02768-0235-4394-b44a-64965cbd40ae None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:27.483306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c02768-0235-4394-b44a-64965cbd40ae None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:27.483579 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c02768-0235-4394-b44a-64965cbd40ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:27.500400 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-07c02768-0235-4394-b44a-64965cbd40ae None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:27.501568 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-07c02768-0235-4394-b44a-64965cbd40ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:27.513243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:27.549298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaa1f2-440c-483f-aa74-d5f3614b22d7 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:27.573285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 285/570] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:27.574185 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c02768-0235-4394-b44a-64965cbd40ae None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:27.588938 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99248b-901b-4dc0-8776-c27e555b2fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:27.590023 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99248b-901b-4dc0-8776-c27e555b2fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:27.590551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99248b-901b-4dc0-8776-c27e555b2fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:27.591053 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99248b-901b-4dc0-8776-c27e555b2fc4 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:27.592160 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99248b-901b-4dc0-8776-c27e555b2fc4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:27.592681 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99248b-901b-4dc0-8776-c27e555b2fc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:27.594515 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99248b-901b-4dc0-8776-c27e555b2fc4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:27.614462 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 286/571] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 7 21:48:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:27.615680 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99248b-901b-4dc0-8776-c27e555b2fc4 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:27.666909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:27.695338 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c02768-0235-4394-b44a-64965cbd40ae None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:27.720668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99248b-901b-4dc0-8776-c27e555b2fc4 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:27.733100 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5510f0-5259-4a92-b45f-c2b6c488f1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:27.734145 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5510f0-5259-4a92-b45f-c2b6c488f1fe None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:27.734602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5510f0-5259-4a92-b45f-c2b6c488f1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:27.735052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5510f0-5259-4a92-b45f-c2b6c488f1fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:27.746470 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5510f0-5259-4a92-b45f-c2b6c488f1fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:27.747985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:27.755105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-bf5510f0-5259-4a92-b45f-c2b6c488f1fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:27.755105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:27.755105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:27.755105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:27.755105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:27.755105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:27.755105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:27.755105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:27.755105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:27.755105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:27.755105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:27.755105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:27.755105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:27.755105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:27.755105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:27.755105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:27.756193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:27.756193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:27.756193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:27.756193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:27.756193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:27.756193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:27.756193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:27.756193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:27.756193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:27.756193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:27.756193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:27.756193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:27.756193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:27.756193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:27.756193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:27.756193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:27.757219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:27.757219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:27.757219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:27.757219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:27.757219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:27.757219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:27.757219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:27.757219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:27.757219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:27.757219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:27.757219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:27.757219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:27.759779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 286/572] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:27.760728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5510f0-5259-4a92-b45f-c2b6c488f1fe None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:27.765232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc01ae0-388c-4848-b64a-a035bafea5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:27.766102 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc01ae0-388c-4848-b64a-a035bafea5ee None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:27.766416 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc01ae0-388c-4848-b64a-a035bafea5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:27.766692 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc01ae0-388c-4848-b64a-a035bafea5ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:27.782437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc01ae0-388c-4848-b64a-a035bafea5ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:27.782916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc01ae0-388c-4848-b64a-a035bafea5ee None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:27.803634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-fbc01ae0-388c-4848-b64a-a035bafea5ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:27.803634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:27.803634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:27.803634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:27.803634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:27.803634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:27.803634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:27.803634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:27.803634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:27.803634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:27.803634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:27.803634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:27.803634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:27.803634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:27.803634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:27.804618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:27.804618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:27.804618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:27.804618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:27.804618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:27.804618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:27.804618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:27.804618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:27.804618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:27.804618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:27.804618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:27.804618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:27.804618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:27.804618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:27.804618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:27.804618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:27.804618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:27.805622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:27.805622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:27.805622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:27.805622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:27.805622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 287/573] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:27.805985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc01ae0-388c-4848-b64a-a035bafea5ee None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:27.871905 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5510f0-5259-4a92-b45f-c2b6c488f1fe None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:27.910850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035ecfd-ef32-416b-8bfc-768659bf4809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:27.911646 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ecfd-ef32-416b-8bfc-768659bf4809 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:27.911905 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc01ae0-388c-4848-b64a-a035bafea5ee None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:27.912031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ecfd-ef32-416b-8bfc-768659bf4809 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:27.912187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ecfd-ef32-416b-8bfc-768659bf4809 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:27.914995 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:27.925414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035ecfd-ef32-416b-8bfc-768659bf4809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:27.933992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-b035ecfd-ef32-416b-8bfc-768659bf4809 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:27.933992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:27.933992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:27.933992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:27.933992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:27.933992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:27.933992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:27.933992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:27.933992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:27.933992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:27.933992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:27.933992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:27.933992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:27.933992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:27.933992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:27.933992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:27.934932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:27.934932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:27.934932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:27.934932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:27.934932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:27.934932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:27.934932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:27.934932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:27.934932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:27.934932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:27.934932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:27.934932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:27.934932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:27.934932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:27.934932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:27.934932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:27.935785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:27.935785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:27.935785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:27.935785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:27.935785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:27.935785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:27.935785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:27.935785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:27.935785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:27.935785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:27.935785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:27.935785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:27.935785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 287/574] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:27.936509 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035ecfd-ef32-416b-8bfc-768659bf4809 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:27.951805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52935169-e4fc-4995-8d20-4a468276b00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:27.952607 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52935169-e4fc-4995-8d20-4a468276b00c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:27.952894 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52935169-e4fc-4995-8d20-4a468276b00c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:27.953236 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52935169-e4fc-4995-8d20-4a468276b00c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:27.964229 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52935169-e4fc-4995-8d20-4a468276b00c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:27.965680 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52935169-e4fc-4995-8d20-4a468276b00c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:27.985786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-52935169-e4fc-4995-8d20-4a468276b00c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:27.985786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:27.985786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:27.985786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:27.985786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:27.985786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:27.985786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:27.985786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:27.985786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:27.985786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:27.985786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:27.985786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:27.985786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:27.985786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:27.985786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:27.986723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:27.986723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:27.986723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:27.986723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:27.986723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:27.986723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:27.986723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:27.986723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:27.986723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:27.986723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:27.986723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:27.986723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:27.986723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:27.986723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:27.986723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:27.986723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:27.986723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:27.987583 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:27.987583 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:27.987583 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:27.987583 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:27.987583 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 288/575] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:27.987870 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52935169-e4fc-4995-8d20-4a468276b00c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:28.019404 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:28.049589 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035ecfd-ef32-416b-8bfc-768659bf4809 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:28.085831 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb414a4b-d7fd-4dc3-b2f7-40ddb803a8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:28.086709 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb414a4b-d7fd-4dc3-b2f7-40ddb803a8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:28.086996 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb414a4b-d7fd-4dc3-b2f7-40ddb803a8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:28.087274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb414a4b-d7fd-4dc3-b2f7-40ddb803a8c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:28.088559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb414a4b-d7fd-4dc3-b2f7-40ddb803a8c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:28.088867 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb414a4b-d7fd-4dc3-b2f7-40ddb803a8c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:28.090281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb414a4b-d7fd-4dc3-b2f7-40ddb803a8c2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:28.095761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52935169-e4fc-4995-8d20-4a468276b00c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:28.099049 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 288/576] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:28.099700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb414a4b-d7fd-4dc3-b2f7-40ddb803a8c2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:28.138897 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fdd55-24df-422a-b638-ccee7e9b99e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:28.139555 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fdd55-24df-422a-b638-ccee7e9b99e9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:28.139836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fdd55-24df-422a-b638-ccee7e9b99e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:28.140112 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fdd55-24df-422a-b638-ccee7e9b99e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:28.140821 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fdd55-24df-422a-b638-ccee7e9b99e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:28.141128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fdd55-24df-422a-b638-ccee7e9b99e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:28.142897 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fdd55-24df-422a-b638-ccee7e9b99e9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:28.160856 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 289/577] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:28.160856 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fdd55-24df-422a-b638-ccee7e9b99e9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:28.163119 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:28.209516 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb414a4b-d7fd-4dc3-b2f7-40ddb803a8c2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:28.246568 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ee392-494c-4aaf-b33f-aaaff535d46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:28.247258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ee392-494c-4aaf-b33f-aaaff535d46c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:28.247536 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ee392-494c-4aaf-b33f-aaaff535d46c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:28.247802 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ee392-494c-4aaf-b33f-aaaff535d46c None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:28.248527 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ee392-494c-4aaf-b33f-aaaff535d46c None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:28.248829 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ee392-494c-4aaf-b33f-aaaff535d46c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:28.250316 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ee392-494c-4aaf-b33f-aaaff535d46c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:28.252222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:28.259980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 289/578] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:28.260782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ee392-494c-4aaf-b33f-aaaff535d46c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:28.264843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fdd55-24df-422a-b638-ccee7e9b99e9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:28.301247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78d7cb-4b1d-47aa-8616-c4e5480e5e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:28.301902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78d7cb-4b1d-47aa-8616-c4e5480e5e2a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:28.302213 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78d7cb-4b1d-47aa-8616-c4e5480e5e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:28.302487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78d7cb-4b1d-47aa-8616-c4e5480e5e2a None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:28.303227 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78d7cb-4b1d-47aa-8616-c4e5480e5e2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:28.303533 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78d7cb-4b1d-47aa-8616-c4e5480e5e2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:28.304939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78d7cb-4b1d-47aa-8616-c4e5480e5e2a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:28.318138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 290/579] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:28.323477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78d7cb-4b1d-47aa-8616-c4e5480e5e2a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:28.367038 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ee392-494c-4aaf-b33f-aaaff535d46c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:28.392356 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:28.413839 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c165f64-3cc0-4e22-ab6a-8f9c63f5bf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:28.414884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c165f64-3cc0-4e22-ab6a-8f9c63f5bf0a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:28.415342 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c165f64-3cc0-4e22-ab6a-8f9c63f5bf0a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:28.415797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c165f64-3cc0-4e22-ab6a-8f9c63f5bf0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:28.426551 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c165f64-3cc0-4e22-ab6a-8f9c63f5bf0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:28.427986 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c165f64-3cc0-4e22-ab6a-8f9c63f5bf0a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:28.440254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78d7cb-4b1d-47aa-8616-c4e5480e5e2a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:28.445235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-9c165f64-3cc0-4e22-ab6a-8f9c63f5bf0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:28.445235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:28.445235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:28.445235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:28.445235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:28.445235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:28.445235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:28.445235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:28.445235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:28.445235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:28.445235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:28.445235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:28.445235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:28.445235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:28.445235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:28.446357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:28.446357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:28.446357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:28.446357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:28.446357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:28.446357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:28.446357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:28.446357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:28.446357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:28.446357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:28.446357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:28.446357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:28.446357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:28.446357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:28.446357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:28.446357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:28.446357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:28.447821 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:28.447821 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:28.447821 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:28.447821 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:28.447821 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 290/580] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:28.448395 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c165f64-3cc0-4e22-ab6a-8f9c63f5bf0a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:28.485262 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e0fd8-742b-434d-a93b-f9c28eb169a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:28.486186 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e0fd8-742b-434d-a93b-f9c28eb169a3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:28.486470 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e0fd8-742b-434d-a93b-f9c28eb169a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:28.486767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e0fd8-742b-434d-a93b-f9c28eb169a3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:28.494028 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e0fd8-742b-434d-a93b-f9c28eb169a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:28.495485 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e0fd8-742b-434d-a93b-f9c28eb169a3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:28.511529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-292e0fd8-742b-434d-a93b-f9c28eb169a3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 07 21:48:28.511529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:28.511529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:28.511529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:28.511529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:28.511529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:28.511529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:28.511529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:28.511529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:28.511529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:28.511529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:28.511529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:28.511529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:28.511529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:28.511529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:28.511529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:28.512638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:28.514204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:28.514204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:28.514204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:28.514204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:28.514204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:28.514204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:28.514204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:28.514204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:28.514204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 07 21:48:28.514204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:28.514204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 291/581] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:28.514204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e0fd8-742b-434d-a93b-f9c28eb169a3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:28.526205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:28.558901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c165f64-3cc0-4e22-ab6a-8f9c63f5bf0a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:28.592097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda2e49-a2de-4ce1-9792-b6f304c0eb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:28.592879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda2e49-a2de-4ce1-9792-b6f304c0eb51 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:28.593164 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda2e49-a2de-4ce1-9792-b6f304c0eb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:28.593439 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda2e49-a2de-4ce1-9792-b6f304c0eb51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:28.604479 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda2e49-a2de-4ce1-9792-b6f304c0eb51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:28.605922 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda2e49-a2de-4ce1-9792-b6f304c0eb51 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:28.619251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e0fd8-742b-434d-a93b-f9c28eb169a3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:28.623013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-6bda2e49-a2de-4ce1-9792-b6f304c0eb51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:28.623013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:28.623013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:28.623013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:28.623013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:28.623013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:28.623013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:28.623013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:28.623013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:28.623013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:28.623013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:28.623013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:28.623013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:28.623013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:28.623013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:28.623868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:28.623868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:28.623868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:28.623868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:28.623868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:28.623868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:28.623868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:28.623868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:28.623868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:28.623868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:28.623868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:28.623868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:28.623868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:28.623868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:28.623868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:28.623868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:28.623868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:28.624743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:28.624743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:28.624743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:28.624743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:28.624743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 291/582] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:28.625021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda2e49-a2de-4ce1-9792-b6f304c0eb51 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:28.650744 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:28.659012 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea22b06-5088-4267-bcfb-4cffba2d359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:28.660033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea22b06-5088-4267-bcfb-4cffba2d359c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:28.660490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea22b06-5088-4267-bcfb-4cffba2d359c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:28.660935 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea22b06-5088-4267-bcfb-4cffba2d359c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:28.668447 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea22b06-5088-4267-bcfb-4cffba2d359c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:28.669886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea22b06-5088-4267-bcfb-4cffba2d359c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:28.683931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-1ea22b06-5088-4267-bcfb-4cffba2d359c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:28.683931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:28.683931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:28.683931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:28.683931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:28.683931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:28.683931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:28.683931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:28.683931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:28.683931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:28.683931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:28.683931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:28.683931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:28.683931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:28.683931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:28.684828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:28.684828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:28.684828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:28.684828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:28.684828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:28.684828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:28.684828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:28.684828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:28.684828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:28.684828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:28.684828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:28.684828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:28.684828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:28.684828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:28.684828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:28.684828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:28.684828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:28.685714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:28.685714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:28.685714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:28.685714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:28.685714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:28.685714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:28.685714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:28.685714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:28.685714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 292/583] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:28.686942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea22b06-5088-4267-bcfb-4cffba2d359c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:28.743268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda2e49-a2de-4ce1-9792-b6f304c0eb51 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:28.756609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:28.780182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c92d49-3d57-4123-ae7f-9a5dcaff795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:28.780768 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c92d49-3d57-4123-ae7f-9a5dcaff795a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:28.781053 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c92d49-3d57-4123-ae7f-9a5dcaff795a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:28.781330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c92d49-3d57-4123-ae7f-9a5dcaff795a None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:28.782080 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c92d49-3d57-4123-ae7f-9a5dcaff795a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:28.782504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c92d49-3d57-4123-ae7f-9a5dcaff795a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:28.783983 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c92d49-3d57-4123-ae7f-9a5dcaff795a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:28.792110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea22b06-5088-4267-bcfb-4cffba2d359c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:28.797209 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 292/584] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:28.798237 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c92d49-3d57-4123-ae7f-9a5dcaff795a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:28.829323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b6a8f-f2e9-405f-9e41-ab253e9c5772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:28.830018 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b6a8f-f2e9-405f-9e41-ab253e9c5772 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:28.830304 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b6a8f-f2e9-405f-9e41-ab253e9c5772 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:28.830577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b6a8f-f2e9-405f-9e41-ab253e9c5772 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:28.831410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b6a8f-f2e9-405f-9e41-ab253e9c5772 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:28.831719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b6a8f-f2e9-405f-9e41-ab253e9c5772 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:28.833144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b6a8f-f2e9-405f-9e41-ab253e9c5772 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:28.851151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 293/585] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jun 7 21:48:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:28.851965 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b6a8f-f2e9-405f-9e41-ab253e9c5772 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:28.892865 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:28.913522 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c92d49-3d57-4123-ae7f-9a5dcaff795a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:28.948133 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b170e31-47ee-4aec-b618-2c89ac972673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:28.948889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b170e31-47ee-4aec-b618-2c89ac972673 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:28.949244 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b170e31-47ee-4aec-b618-2c89ac972673 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:28.950022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b170e31-47ee-4aec-b618-2c89ac972673 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:28.950833 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b170e31-47ee-4aec-b618-2c89ac972673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:28.951297 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b170e31-47ee-4aec-b618-2c89ac972673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:28.952689 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b170e31-47ee-4aec-b618-2c89ac972673 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:28.962145 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b6a8f-f2e9-405f-9e41-ab253e9c5772 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:28.969178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 293/586] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:28.969178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b170e31-47ee-4aec-b618-2c89ac972673 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:28.997907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:29.006916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23837cf1-8064-4008-9fd3-419eb14bb876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:29.007855 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23837cf1-8064-4008-9fd3-419eb14bb876 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:29.007995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23837cf1-8064-4008-9fd3-419eb14bb876 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:29.008229 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23837cf1-8064-4008-9fd3-419eb14bb876 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:29.009011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23837cf1-8064-4008-9fd3-419eb14bb876 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:29.009953 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23837cf1-8064-4008-9fd3-419eb14bb876 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:29.011506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23837cf1-8064-4008-9fd3-419eb14bb876 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:29.023771 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 294/587] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:29.024702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23837cf1-8064-4008-9fd3-419eb14bb876 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:29.089739 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b170e31-47ee-4aec-b618-2c89ac972673 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:29.123747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4178b36-0da9-4f0d-9137-15c6b526c8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:29.124535 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4178b36-0da9-4f0d-9137-15c6b526c8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:29.124817 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4178b36-0da9-4f0d-9137-15c6b526c8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:29.125091 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4178b36-0da9-4f0d-9137-15c6b526c8a3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:29.132913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4178b36-0da9-4f0d-9137-15c6b526c8a3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:29.134909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4178b36-0da9-4f0d-9137-15c6b526c8a3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:29.141428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23837cf1-8064-4008-9fd3-419eb14bb876 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:29.149008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-d4178b36-0da9-4f0d-9137-15c6b526c8a3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 21:48:29.149008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:29.149008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:29.149008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:29.149008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:29.149008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:29.149008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:29.149008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:29.149008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:29.149008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:29.149008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:29.149008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:29.149008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:29.149008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:29.149008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:29.149008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:29.150266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:29.151428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:29.151428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:29.151428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:29.151428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:29.151428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:29.151428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:29.151428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:29.151428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:29.151428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 21:48:29.151428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:29.155052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 294/588] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:29.155604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4178b36-0da9-4f0d-9137-15c6b526c8a3 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:29.158462 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:29.180718 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e702f-5dcf-4dab-9c08-9d9d45b15c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:29.181567 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e702f-5dcf-4dab-9c08-9d9d45b15c3d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:29.181844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e702f-5dcf-4dab-9c08-9d9d45b15c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:29.182147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e702f-5dcf-4dab-9c08-9d9d45b15c3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:29.195176 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e702f-5dcf-4dab-9c08-9d9d45b15c3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:29.197300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e702f-5dcf-4dab-9c08-9d9d45b15c3d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:29.215761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-159e702f-5dcf-4dab-9c08-9d9d45b15c3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:29.215761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:29.215761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:29.215761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:29.215761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:29.215761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:29.215761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:29.215761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:29.215761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:29.215761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:29.215761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:29.215761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:29.215761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:29.215761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:29.215761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:29.216731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:29.216731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:29.216731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:29.216731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:29.216731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:29.216731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:29.216731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:29.216731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:29.216731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:29.216731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:29.216731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:29.216731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:29.216731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:29.216731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:29.216731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:29.216731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:29.216731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:29.217691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:29.217691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:29.217691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:29.217691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:29.217691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 295/589] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:29.217691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e702f-5dcf-4dab-9c08-9d9d45b15c3d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:29.264959 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:29.270542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4178b36-0da9-4f0d-9137-15c6b526c8a3 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:29.305480 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da8a6d-88f7-4fbd-9f08-a04f37996480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:29.306365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da8a6d-88f7-4fbd-9f08-a04f37996480 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:29.306658 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da8a6d-88f7-4fbd-9f08-a04f37996480 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:29.306936 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da8a6d-88f7-4fbd-9f08-a04f37996480 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:29.314431 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da8a6d-88f7-4fbd-9f08-a04f37996480 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:29.315866 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da8a6d-88f7-4fbd-9f08-a04f37996480 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:29.330358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-c7da8a6d-88f7-4fbd-9f08-a04f37996480 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 21:48:29.330358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:29.330358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:29.330358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:29.330358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:29.330358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:29.330358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:29.330358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:29.330358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:29.330358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:29.330358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:29.330358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:29.330358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:29.330358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:29.330358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:29.330358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:29.331330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:29.332251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:29.332251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:29.332251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:29.332251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:29.332251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:29.332251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:29.332251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:29.332251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:29.332251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 21:48:29.332251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:29.332251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 295/590] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:29.332849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da8a6d-88f7-4fbd-9f08-a04f37996480 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:29.335338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e702f-5dcf-4dab-9c08-9d9d45b15c3d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:29.375889 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3e1a8-4862-4d40-b86f-1b2733c28e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:29.376860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3e1a8-4862-4d40-b86f-1b2733c28e83 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:29.377220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3e1a8-4862-4d40-b86f-1b2733c28e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:29.377502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3e1a8-4862-4d40-b86f-1b2733c28e83 None admin] PATH_INFO: `/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/1d5760a3f9f946978b1251d3e2aaa943/roles/382652f08fc24ce39f91164181237006` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:29.393469 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3e1a8-4862-4d40-b86f-1b2733c28e83 None admin] RBAC: Authorizing `identity:create_grant(project_id=eca8f481deb242789622ebb10aa2c5da, user_id=1d5760a3f9f946978b1251d3e2aaa943, role_id=382652f08fc24ce39f91164181237006)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:29.394952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3e1a8-4862-4d40-b86f-1b2733c28e83 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:29.400706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:29.408591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 296/591] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:48:29 2022] PUT /identity/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/1d5760a3f9f946978b1251d3e2aaa943/roles/382652f08fc24ce39f91164181237006 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:48:29.409505 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3e1a8-4862-4d40-b86f-1b2733c28e83 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:29.474738 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da8a6d-88f7-4fbd-9f08-a04f37996480 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:29.527608 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9410da-039e-4480-974c-d2354391fb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:29.528285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9410da-039e-4480-974c-d2354391fb29 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:29.528563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9410da-039e-4480-974c-d2354391fb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:29.528832 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9410da-039e-4480-974c-d2354391fb29 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:29.529671 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9410da-039e-4480-974c-d2354391fb29 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:29.530003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9410da-039e-4480-974c-d2354391fb29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:29.531455 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9410da-039e-4480-974c-d2354391fb29 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:29.531577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:29.546009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3e1a8-4862-4d40-b86f-1b2733c28e83 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:29.550815 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 296/592] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Jun 7 21:48:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:29.551681 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9410da-039e-4480-974c-d2354391fb29 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:29.589168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a435b92-4167-4e14-b76a-c7cc846e5e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:29.590141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a435b92-4167-4e14-b76a-c7cc846e5e04 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:29.590603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a435b92-4167-4e14-b76a-c7cc846e5e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:29.591026 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a435b92-4167-4e14-b76a-c7cc846e5e04 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:29.592102 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a435b92-4167-4e14-b76a-c7cc846e5e04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:29.592418 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a435b92-4167-4e14-b76a-c7cc846e5e04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:29.593898 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a435b92-4167-4e14-b76a-c7cc846e5e04 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:29.611652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 297/593] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:29.611652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440886d7-49e8-4ad7-84f1-1c7d58b031fd None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:29.611652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440886d7-49e8-4ad7-84f1-1c7d58b031fd None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:29.611652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440886d7-49e8-4ad7-84f1-1c7d58b031fd None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:29.611652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 298/594] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:29.611652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440886d7-49e8-4ad7-84f1-1c7d58b031fd None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:29.672035 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9410da-039e-4480-974c-d2354391fb29 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:29.696898 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:29.713513 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb9704-65cc-4dfa-952c-473848d9d81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:29.714084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb9704-65cc-4dfa-952c-473848d9d81b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:29.714362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb9704-65cc-4dfa-952c-473848d9d81b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:29.714649 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb9704-65cc-4dfa-952c-473848d9d81b None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:29.715448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb9704-65cc-4dfa-952c-473848d9d81b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:29.715751 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb9704-65cc-4dfa-952c-473848d9d81b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:29.717160 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb9704-65cc-4dfa-952c-473848d9d81b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:29.720492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440886d7-49e8-4ad7-84f1-1c7d58b031fd None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:29.739594 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 297/595] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jun 7 21:48:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:29.739594 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb9704-65cc-4dfa-952c-473848d9d81b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:29.762568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919e699-7dcf-4d1f-9cc7-fcfa453ff00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:29.763916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919e699-7dcf-4d1f-9cc7-fcfa453ff00f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:29.764199 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919e699-7dcf-4d1f-9cc7-fcfa453ff00f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:29.764475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919e699-7dcf-4d1f-9cc7-fcfa453ff00f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:29.775957 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919e699-7dcf-4d1f-9cc7-fcfa453ff00f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:29.777411 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919e699-7dcf-4d1f-9cc7-fcfa453ff00f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:29.795081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-e919e699-7dcf-4d1f-9cc7-fcfa453ff00f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:29.795081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:29.795081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:29.795081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:29.795081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:29.795081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:29.795081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:29.795081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:29.795081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:29.795081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:29.795081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:29.795081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:29.795081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:29.795081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:29.795081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:29.795991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:29.795991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:29.795991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:29.795991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:29.795991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:29.795991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:29.795991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:29.795991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:29.795991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:29.795991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:29.795991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:29.795991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:29.795991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:29.795991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:29.795991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:29.795991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:29.795991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:29.796849 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:29.796849 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:29.796849 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:29.796849 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:29.796849 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 299/596] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:29.797849 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9665cd-ded3-4e8d-bd05-3352e6cdc135 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:29.797849 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9665cd-ded3-4e8d-bd05-3352e6cdc135 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:29.798028 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9665cd-ded3-4e8d-bd05-3352e6cdc135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:29.804247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:29.817645 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ea9665cd-ded3-4e8d-bd05-3352e6cdc135 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:29.818871 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ea9665cd-ded3-4e8d-bd05-3352e6cdc135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:29.850354 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb9704-65cc-4dfa-952c-473848d9d81b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:29.886188 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312aa03b-34d9-436e-9b5b-04bee33d7bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:29.886982 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aa03b-34d9-436e-9b5b-04bee33d7bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:29.887264 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aa03b-34d9-436e-9b5b-04bee33d7bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:29.887538 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aa03b-34d9-436e-9b5b-04bee33d7bd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:29.894352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312aa03b-34d9-436e-9b5b-04bee33d7bd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:29.895785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312aa03b-34d9-436e-9b5b-04bee33d7bd0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:29.906001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 300/597] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:29.906001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9665cd-ded3-4e8d-bd05-3352e6cdc135 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:29.914674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-312aa03b-34d9-436e-9b5b-04bee33d7bd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:29.914674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:29.914674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:29.914674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:29.914674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:29.914674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:29.914674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:29.914674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:29.914674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:29.914674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:29.914674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:29.914674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:29.914674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:29.914674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:29.914674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:29.916210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:29.916210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:29.916210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:29.916210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:29.916210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:29.916210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:29.916210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:29.916210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:29.916210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:29.916210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:29.916210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:29.916210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:29.916210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:29.916210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:29.916210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:29.916210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:29.916210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:29.917122 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:29.917122 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:29.917122 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:29.917122 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:29.917122 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:29.917122 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:29.917122 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:29.917122 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:29.919618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 298/598] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:29.920652 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312aa03b-34d9-436e-9b5b-04bee33d7bd0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:29.963030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:30.023735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9665cd-ded3-4e8d-bd05-3352e6cdc135 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:30.027025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312aa03b-34d9-436e-9b5b-04bee33d7bd0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:30.055206 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:30.060917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfac0d-a2e4-43e8-a788-e5e9c4e756ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:30.061705 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfac0d-a2e4-43e8-a788-e5e9c4e756ef None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:30.062011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfac0d-a2e4-43e8-a788-e5e9c4e756ef None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:30.062286 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfac0d-a2e4-43e8-a788-e5e9c4e756ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:30.071391 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940c7bc-d0b7-4f4c-9b25-2da7c3f39212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:30.072566 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940c7bc-d0b7-4f4c-9b25-2da7c3f39212 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:30.072687 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cfac0d-a2e4-43e8-a788-e5e9c4e756ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:30.073183 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940c7bc-d0b7-4f4c-9b25-2da7c3f39212 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:30.073672 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940c7bc-d0b7-4f4c-9b25-2da7c3f39212 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:30.074109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cfac0d-a2e4-43e8-a788-e5e9c4e756ef None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:30.074871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940c7bc-d0b7-4f4c-9b25-2da7c3f39212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:30.075379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940c7bc-d0b7-4f4c-9b25-2da7c3f39212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:30.077514 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940c7bc-d0b7-4f4c-9b25-2da7c3f39212 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:30.091562 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 299/599] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:30.092001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-40cfac0d-a2e4-43e8-a788-e5e9c4e756ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:30.092001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:30.092001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:30.092001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:30.092001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:30.092001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:30.092001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:30.092001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:30.092001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:30.092001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:30.092001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:30.092001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:30.092001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:30.092001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:30.092001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:30.092865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:30.092865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:30.092865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:30.092865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:30.092865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:30.092865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:30.092865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:30.092865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:30.092865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:30.092865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:30.092865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:30.092865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:30.092865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:30.092865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:30.092865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:30.092865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:30.092865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:30.093774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:30.093774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:30.093774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:30.093774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:30.095769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940c7bc-d0b7-4f4c-9b25-2da7c3f39212 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:30.097562 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 301/600] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:30.098424 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfac0d-a2e4-43e8-a788-e5e9c4e756ef None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:30.201331 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfac0d-a2e4-43e8-a788-e5e9c4e756ef None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:30.207424 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:30.211423 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940c7bc-d0b7-4f4c-9b25-2da7c3f39212 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:30.240933 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f8102-503c-4d6c-a4d0-5ba1f805fee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:30.241516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f8102-503c-4d6c-a4d0-5ba1f805fee9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:30.241797 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f8102-503c-4d6c-a4d0-5ba1f805fee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:30.242122 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f8102-503c-4d6c-a4d0-5ba1f805fee9 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:30.242902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f8102-503c-4d6c-a4d0-5ba1f805fee9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:30.243213 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f8102-503c-4d6c-a4d0-5ba1f805fee9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:30.245161 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f8102-503c-4d6c-a4d0-5ba1f805fee9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:30.248782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a68672-dd09-4608-8312-daa7cd8c281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:30.249578 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a68672-dd09-4608-8312-daa7cd8c281c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:30.249857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a68672-dd09-4608-8312-daa7cd8c281c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:30.250161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a68672-dd09-4608-8312-daa7cd8c281c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:30.257632 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 302/601] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:30.258712 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f8102-503c-4d6c-a4d0-5ba1f805fee9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:30.266408 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a68672-dd09-4608-8312-daa7cd8c281c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:30.274295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-25a68672-dd09-4608-8312-daa7cd8c281c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:30.274295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:30.274295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:30.274295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:30.274295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:30.274295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:30.274295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:30.274295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:30.274295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:30.274295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:30.274295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:30.274295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:30.274295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:30.274295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:30.274295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:30.274295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:30.275263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:30.275263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:30.275263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:30.275263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:30.275263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:30.275263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:30.275263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:30.275263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:30.275263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:30.275263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:30.275263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:30.275263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:30.275263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:30.275263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:30.275263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:30.275263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:30.276081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:30.276081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:30.276081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:30.276081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:30.276081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:30.276081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:30.276081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:30.276081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:30.276081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:30.276081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:30.276081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:30.276081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:30.276081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 300/602] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:30.276791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a68672-dd09-4608-8312-daa7cd8c281c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:30.311602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:30.375636 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f8102-503c-4d6c-a4d0-5ba1f805fee9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:30.384722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a68672-dd09-4608-8312-daa7cd8c281c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:30.412241 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0e93d-f059-42d1-8a34-ccf0bd99a365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:30.413127 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0e93d-f059-42d1-8a34-ccf0bd99a365 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:30.413481 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0e93d-f059-42d1-8a34-ccf0bd99a365 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:30.413840 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0e93d-f059-42d1-8a34-ccf0bd99a365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:30.418865 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd7874-b4ce-4dd3-b10f-37aff95b04e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:30.419519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd7874-b4ce-4dd3-b10f-37aff95b04e3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:30.419965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd7874-b4ce-4dd3-b10f-37aff95b04e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:30.420227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd7874-b4ce-4dd3-b10f-37aff95b04e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:30.420590 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0e93d-f059-42d1-8a34-ccf0bd99a365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:30.420943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd7874-b4ce-4dd3-b10f-37aff95b04e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:30.421250 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd7874-b4ce-4dd3-b10f-37aff95b04e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:30.422070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0e93d-f059-42d1-8a34-ccf0bd99a365 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:30.422615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd7874-b4ce-4dd3-b10f-37aff95b04e3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:30.435002 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 301/603] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:30.436653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd7874-b4ce-4dd3-b10f-37aff95b04e3 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:30.436891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-dcf0e93d-f059-42d1-8a34-ccf0bd99a365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:30.436891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:30.436891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:30.436891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:30.436891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:30.436891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:30.436891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:30.436891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:30.436891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:30.436891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:30.436891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:30.436891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:30.436891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:30.436891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:30.436891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:30.437754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:30.437754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:30.437754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:30.437754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:30.437754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:30.437754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:30.437754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:30.437754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:30.437754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:30.437754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:30.437754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:30.437754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:30.437754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:30.437754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:30.437754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:30.437754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:30.437754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:30.439016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:30.439016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:30.439016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:30.439016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:30.439016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:30.439016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:30.439016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:30.439016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:30.440070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 303/604] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:30.440870 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0e93d-f059-42d1-8a34-ccf0bd99a365 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:30.460567 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:30.545795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd7874-b4ce-4dd3-b10f-37aff95b04e3 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:30.553195 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0e93d-f059-42d1-8a34-ccf0bd99a365 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:30.557222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:30.584200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf4a21-be41-4e98-b944-f8363f0dda57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:30.585088 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf4a21-be41-4e98-b944-f8363f0dda57 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:30.585369 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf4a21-be41-4e98-b944-f8363f0dda57 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:30.585642 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf4a21-be41-4e98-b944-f8363f0dda57 None admin] PATH_INFO: `/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/1a3c022963e74e989a703938ff057757/roles/382652f08fc24ce39f91164181237006` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:30.594471 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181151f-c676-4a91-92a3-c7fef49c58a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:30.595132 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181151f-c676-4a91-92a3-c7fef49c58a8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:30.595418 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181151f-c676-4a91-92a3-c7fef49c58a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:30.595690 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181151f-c676-4a91-92a3-c7fef49c58a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:30.596427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181151f-c676-4a91-92a3-c7fef49c58a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:30.596741 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181151f-c676-4a91-92a3-c7fef49c58a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:30.598135 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181151f-c676-4a91-92a3-c7fef49c58a8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:30.600978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf4a21-be41-4e98-b944-f8363f0dda57 None admin] RBAC: Authorizing `identity:create_grant(project_id=eca8f481deb242789622ebb10aa2c5da, user_id=1a3c022963e74e989a703938ff057757, role_id=382652f08fc24ce39f91164181237006)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:30.602628 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf4a21-be41-4e98-b944-f8363f0dda57 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:30.607850 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 304/605] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:30.608456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181151f-c676-4a91-92a3-c7fef49c58a8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:30.629955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 302/606] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:48:30 2022] PUT /identity/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/1a3c022963e74e989a703938ff057757/roles/382652f08fc24ce39f91164181237006 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:48:30.629955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf4a21-be41-4e98-b944-f8363f0dda57 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:30.719818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:30.735140 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181151f-c676-4a91-92a3-c7fef49c58a8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:30.768387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf4a21-be41-4e98-b944-f8363f0dda57 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:30.779281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3192cf-df5e-4171-9253-0cf3ac733440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:30.780137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3192cf-df5e-4171-9253-0cf3ac733440 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:30.780418 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3192cf-df5e-4171-9253-0cf3ac733440 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:30.780750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3192cf-df5e-4171-9253-0cf3ac733440 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:30.788825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3192cf-df5e-4171-9253-0cf3ac733440 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:30.791258 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3192cf-df5e-4171-9253-0cf3ac733440 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:30.808360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-4e3192cf-df5e-4171-9253-0cf3ac733440 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:30.808360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:30.808360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:30.808360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:30.808360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:30.808360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:30.808360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:30.808360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:30.808360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:30.808360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:30.808360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:30.808360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:30.808360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:30.808360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:30.808360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:30.809490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:30.809490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:30.809490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:30.809490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:30.809490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:30.809490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:30.809490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:30.809490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:30.809490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:30.809490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:30.809490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:30.809490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:30.809490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:30.809490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:30.809490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:30.809490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:30.809490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:30.810618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:30.810618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:30.810618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:30.810618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:30.810618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:30.810618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:30.810618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:30.810618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:30.812467 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cfc0f-fd6c-4818-8624-2b03e63051b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:30.813288 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cfc0f-fd6c-4818-8624-2b03e63051b3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:30.813715 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cfc0f-fd6c-4818-8624-2b03e63051b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:30.814253 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 305/607] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:30.814585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cfc0f-fd6c-4818-8624-2b03e63051b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:30.815207 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3192cf-df5e-4171-9253-0cf3ac733440 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:30.815826 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cfc0f-fd6c-4818-8624-2b03e63051b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:30.816334 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cfc0f-fd6c-4818-8624-2b03e63051b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:30.818176 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cfc0f-fd6c-4818-8624-2b03e63051b3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:30.832372 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 303/608] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:30.833565 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cfc0f-fd6c-4818-8624-2b03e63051b3 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:30.849809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:30.934320 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3192cf-df5e-4171-9253-0cf3ac733440 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:30.968403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cfc0f-fd6c-4818-8624-2b03e63051b3 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:30.974388 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ae7e3-bf72-4e4c-8c82-2bd186ed91d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:30.975449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ae7e3-bf72-4e4c-8c82-2bd186ed91d4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:30.975730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ae7e3-bf72-4e4c-8c82-2bd186ed91d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:30.976531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ae7e3-bf72-4e4c-8c82-2bd186ed91d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:30.990444 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ae7e3-bf72-4e4c-8c82-2bd186ed91d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:30.991902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ae7e3-bf72-4e4c-8c82-2bd186ed91d4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:31.005544 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:31.013561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-dd3ae7e3-bf72-4e4c-8c82-2bd186ed91d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:31.013561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:31.013561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:31.013561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:31.013561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:31.013561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:31.013561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:31.013561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:31.013561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:31.013561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:31.013561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:31.013561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:31.013561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:31.013561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:31.013561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:31.014525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:31.014525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:31.014525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:31.014525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:31.014525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:31.014525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:31.014525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:31.014525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:31.014525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:31.014525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:31.014525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:31.014525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:31.014525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:31.014525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:31.014525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:31.014525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:31.014525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:31.015419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:31.015419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:31.015419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:31.015419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:31.018057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb909c04-a70d-468a-b440-e8a6eef5167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:31.018981 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb909c04-a70d-468a-b440-e8a6eef5167d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:31.019485 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 306/609] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:31.019725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb909c04-a70d-468a-b440-e8a6eef5167d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:31.020199 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb909c04-a70d-468a-b440-e8a6eef5167d None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:31.020315 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ae7e3-bf72-4e4c-8c82-2bd186ed91d4 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:31.021290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb909c04-a70d-468a-b440-e8a6eef5167d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:31.021807 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb909c04-a70d-468a-b440-e8a6eef5167d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:31.025388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb909c04-a70d-468a-b440-e8a6eef5167d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:31.041806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 304/610] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:31.042984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb909c04-a70d-468a-b440-e8a6eef5167d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:31.122534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:31.153097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ae7e3-bf72-4e4c-8c82-2bd186ed91d4 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:31.162194 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb909c04-a70d-468a-b440-e8a6eef5167d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:31.199075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4af13-1362-4c27-bccd-cc892a89cee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:31.199311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c95f02-418f-481b-80d4-3d9a12f59b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:31.199867 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4af13-1362-4c27-bccd-cc892a89cee7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:31.200213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4af13-1362-4c27-bccd-cc892a89cee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:31.200551 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4af13-1362-4c27-bccd-cc892a89cee7 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:31.200965 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c95f02-418f-481b-80d4-3d9a12f59b17 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:31.201391 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4af13-1362-4c27-bccd-cc892a89cee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:31.201619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c95f02-418f-481b-80d4-3d9a12f59b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:31.201761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4af13-1362-4c27-bccd-cc892a89cee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:31.202226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c95f02-418f-481b-80d4-3d9a12f59b17 None admin] PATH_INFO: `/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/aab50bc9064e444184afb1b4c585ce39/roles/382652f08fc24ce39f91164181237006` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:31.203326 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4af13-1362-4c27-bccd-cc892a89cee7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:31.220341 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 305/611] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:31.221211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c95f02-418f-481b-80d4-3d9a12f59b17 None admin] RBAC: Authorizing `identity:create_grant(project_id=eca8f481deb242789622ebb10aa2c5da, user_id=aab50bc9064e444184afb1b4c585ce39, role_id=382652f08fc24ce39f91164181237006)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:31.221325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4af13-1362-4c27-bccd-cc892a89cee7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:31.223091 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c95f02-418f-481b-80d4-3d9a12f59b17 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:31.247585 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 307/612] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:48:31 2022] PUT /identity/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/aab50bc9064e444184afb1b4c585ce39/roles/382652f08fc24ce39f91164181237006 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:48:31.248814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c95f02-418f-481b-80d4-3d9a12f59b17 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:31.324385 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:31.381509 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c95f02-418f-481b-80d4-3d9a12f59b17 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:31.418973 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:31.429402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f6869-d160-4c46-ae13-b4e05839c6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:31.430828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f6869-d160-4c46-ae13-b4e05839c6ec None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:31.431437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f6869-d160-4c46-ae13-b4e05839c6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:31.432209 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f6869-d160-4c46-ae13-b4e05839c6ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:31.442646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f6869-d160-4c46-ae13-b4e05839c6ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:31.445067 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f6869-d160-4c46-ae13-b4e05839c6ec None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:31.463474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-e73f6869-d160-4c46-ae13-b4e05839c6ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 21:48:31.463474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:31.463474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:31.463474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:31.463474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:31.463474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:31.463474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:31.463474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:31.463474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:31.463474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:31.463474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:31.463474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:31.463474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:31.463474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:31.463474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:31.463474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:31.464486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:31.465435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:31.465435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:31.465435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:31.465435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:31.465435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:31.465435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:31.465435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:31.465435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:31.465435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 21:48:31.465435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:31.468515 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 308/613] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:48:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:31.473703 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f6869-d160-4c46-ae13-b4e05839c6ec None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:31.480567 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4af13-1362-4c27-bccd-cc892a89cee7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:31.529950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527898e4-8b4f-4866-9c77-e327e64de872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:31.531174 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527898e4-8b4f-4866-9c77-e327e64de872 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:31.532072 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527898e4-8b4f-4866-9c77-e327e64de872 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:31.532533 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527898e4-8b4f-4866-9c77-e327e64de872 None admin] PATH_INFO: `/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/5688ba6551834757b7eeef45a15f16e9/roles/382652f08fc24ce39f91164181237006` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:31.551839 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527898e4-8b4f-4866-9c77-e327e64de872 None admin] RBAC: Authorizing `identity:create_grant(project_id=eca8f481deb242789622ebb10aa2c5da, user_id=5688ba6551834757b7eeef45a15f16e9, role_id=382652f08fc24ce39f91164181237006)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:31.553291 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527898e4-8b4f-4866-9c77-e327e64de872 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:31.569396 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 306/614] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:48:31 2022] PUT /identity/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/5688ba6551834757b7eeef45a15f16e9/roles/382652f08fc24ce39f91164181237006 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:48:31.608831 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f6869-d160-4c46-ae13-b4e05839c6ec None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:31.649864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562b7c3-2976-425f-b797-2314edabd3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:31.651454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562b7c3-2976-425f-b797-2314edabd3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:31.651927 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562b7c3-2976-425f-b797-2314edabd3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:31.652440 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562b7c3-2976-425f-b797-2314edabd3e3 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:31.653495 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562b7c3-2976-425f-b797-2314edabd3e3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:31.654021 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562b7c3-2976-425f-b797-2314edabd3e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:31.655810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562b7c3-2976-425f-b797-2314edabd3e3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:31.676832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 309/615] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jun 7 21:48:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:31.682769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527898e4-8b4f-4866-9c77-e327e64de872 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:31.824003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:31.827994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527898e4-8b4f-4866-9c77-e327e64de872 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:31.840663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d62c7-d79e-472a-a7f7-de0ee5099356 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:31.841612 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d62c7-d79e-472a-a7f7-de0ee5099356 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:31.842127 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d62c7-d79e-472a-a7f7-de0ee5099356 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:31.844018 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 310/616] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:31.849758 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c899d1-99f2-4adb-92a9-06486b38f617 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:31.850344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c899d1-99f2-4adb-92a9-06486b38f617 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:31.850627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c899d1-99f2-4adb-92a9-06486b38f617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:31.875131 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05215d-1719-4bae-8d99-4ce97c08d0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:31.875353 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f5c899d1-99f2-4adb-92a9-06486b38f617 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:31.876382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05215d-1719-4bae-8d99-4ce97c08d0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:31.876560 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f5c899d1-99f2-4adb-92a9-06486b38f617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:31.877040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05215d-1719-4bae-8d99-4ce97c08d0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:31.877508 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05215d-1719-4bae-8d99-4ce97c08d0c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:31.899107 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05215d-1719-4bae-8d99-4ce97c08d0c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:31.902193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05215d-1719-4bae-8d99-4ce97c08d0c0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:31.924675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-ea05215d-1719-4bae-8d99-4ce97c08d0c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:31.924675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:31.924675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:31.924675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:31.924675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:31.924675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:31.924675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:31.924675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:31.924675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:31.924675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:31.924675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:31.924675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:31.924675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:31.924675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:31.924675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:31.925614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:31.925614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:31.925614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:31.925614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:31.925614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:31.925614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:31.925614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:31.925614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:31.925614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:31.925614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:31.925614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:31.925614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:31.925614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:31.925614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:31.925614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:31.925614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:31.925614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:31.926519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:31.926519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:31.926519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:31.926519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:31.929079 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 307/617] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:31.935529 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05215d-1719-4bae-8d99-4ce97c08d0c0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:31.963418 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:32.015865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 311/618] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:48:32.040046 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c899d1-99f2-4adb-92a9-06486b38f617 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:32.063408 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05215d-1719-4bae-8d99-4ce97c08d0c0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:32.099713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eadf1-f81d-440a-a993-f7491bb897e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:32.100642 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eadf1-f81d-440a-a993-f7491bb897e1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:32.100919 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eadf1-f81d-440a-a993-f7491bb897e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:32.101177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eadf1-f81d-440a-a993-f7491bb897e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:32.101885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eadf1-f81d-440a-a993-f7491bb897e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:32.102213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eadf1-f81d-440a-a993-f7491bb897e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:32.104108 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eadf1-f81d-440a-a993-f7491bb897e1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:32.116320 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 308/619] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:32.122223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eadf1-f81d-440a-a993-f7491bb897e1 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:32.143893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:32.224135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eadf1-f81d-440a-a993-f7491bb897e1 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:32.257180 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c899d1-99f2-4adb-92a9-06486b38f617 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:32.257996 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5135a8-c128-455b-88a5-3d5d5f105d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:32.258796 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5135a8-c128-455b-88a5-3d5d5f105d18 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:32.259083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5135a8-c128-455b-88a5-3d5d5f105d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:32.259906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5135a8-c128-455b-88a5-3d5d5f105d18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:32.274189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5135a8-c128-455b-88a5-3d5d5f105d18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:32.276184 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5135a8-c128-455b-88a5-3d5d5f105d18 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:32.293044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-ae5135a8-c128-455b-88a5-3d5d5f105d18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:32.293044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:32.293044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:32.293044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:32.293044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:32.293044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:32.293044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:32.293044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:32.293044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:32.293044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:32.293044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:32.293044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:32.293044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:32.293044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:32.293044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:32.294006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:32.294006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:32.294006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:32.294006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:32.294006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:32.294006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:32.294006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:32.294006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:32.294006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:32.294006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:32.294006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:32.294006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:32.294006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:32.294006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:32.294006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:32.294006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:32.294006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:32.294888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:32.294888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:32.294888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:32.294888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:32.294888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:32.294888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:32.294888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:32.294888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:32.294888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 309/620] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:32.300086 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5135a8-c128-455b-88a5-3d5d5f105d18 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:32.340257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af7ee6-cb94-425e-87fa-33ab366d23bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:32.341052 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af7ee6-cb94-425e-87fa-33ab366d23bb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:32.341331 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af7ee6-cb94-425e-87fa-33ab366d23bb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:32.341598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af7ee6-cb94-425e-87fa-33ab366d23bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:32.370886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af7ee6-cb94-425e-87fa-33ab366d23bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:32.378641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-e5af7ee6-cb94-425e-87fa-33ab366d23bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:32.378641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:32.378641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:32.378641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:32.378641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:32.378641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:32.378641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:32.378641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:32.378641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:32.378641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:32.378641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:32.378641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:32.378641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:32.378641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:32.378641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:32.378641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:32.379570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:32.379570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:32.379570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:32.379570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:32.379570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:32.379570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:32.379570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:32.379570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:32.379570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:32.379570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:32.379570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:32.379570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:32.379570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:32.379570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:32.379570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:32.379570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:32.380393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:32.380393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:32.380393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:32.380393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:32.380393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:32.380393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:32.380393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:32.380393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:32.380393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:32.380393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:32.380393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:32.380393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:32.381955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 312/621] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:32.388667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af7ee6-cb94-425e-87fa-33ab366d23bb None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:32.418290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:32.456305 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:32.473304 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5135a8-c128-455b-88a5-3d5d5f105d18 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:32.536016 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373b5b5-37f6-41ab-acef-bac5a91cc21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:32.536603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373b5b5-37f6-41ab-acef-bac5a91cc21a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:32.536895 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373b5b5-37f6-41ab-acef-bac5a91cc21a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:32.537175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373b5b5-37f6-41ab-acef-bac5a91cc21a None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:32.538111 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373b5b5-37f6-41ab-acef-bac5a91cc21a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:32.538429 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373b5b5-37f6-41ab-acef-bac5a91cc21a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:32.539861 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373b5b5-37f6-41ab-acef-bac5a91cc21a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:32.561519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 310/622] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:32.567226 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373b5b5-37f6-41ab-acef-bac5a91cc21a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:32.573153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af7ee6-cb94-425e-87fa-33ab366d23bb None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:32.638170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b17014-ec28-4a51-b598-b1f3efc70615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:32.638841 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b17014-ec28-4a51-b598-b1f3efc70615 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:32.639124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b17014-ec28-4a51-b598-b1f3efc70615 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:32.639401 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b17014-ec28-4a51-b598-b1f3efc70615 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:32.640146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b17014-ec28-4a51-b598-b1f3efc70615 None admin] RBAC: Adding query filter params (name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:32.640556 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b17014-ec28-4a51-b598-b1f3efc70615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:32.642072 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b17014-ec28-4a51-b598-b1f3efc70615 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:32.662659 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 313/623] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:32.668204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b17014-ec28-4a51-b598-b1f3efc70615 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:32.673293 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373b5b5-37f6-41ab-acef-bac5a91cc21a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:32.731324 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:32.745845 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ecb29-fd76-44aa-8da2-c280de77105e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:32.746769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ecb29-fd76-44aa-8da2-c280de77105e None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:32.747049 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ecb29-fd76-44aa-8da2-c280de77105e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:32.747324 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ecb29-fd76-44aa-8da2-c280de77105e None admin] PATH_INFO: `/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/a4b69c708fbc470aae3e3954e21a1e88/roles/382652f08fc24ce39f91164181237006` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:32.777082 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ecb29-fd76-44aa-8da2-c280de77105e None admin] RBAC: Authorizing `identity:create_grant(project_id=eca8f481deb242789622ebb10aa2c5da, user_id=a4b69c708fbc470aae3e3954e21a1e88, role_id=382652f08fc24ce39f91164181237006)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:32.778567 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ecb29-fd76-44aa-8da2-c280de77105e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:32.806975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 311/624] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:48:32 2022] PUT /identity/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/a4b69c708fbc470aae3e3954e21a1e88/roles/382652f08fc24ce39f91164181237006 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:48:32.812955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b17014-ec28-4a51-b598-b1f3efc70615 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:32.822312 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:32.851412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834bb5-9b63-4bc6-a1de-1bd5191df013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:32.852251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834bb5-9b63-4bc6-a1de-1bd5191df013 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:32.852506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834bb5-9b63-4bc6-a1de-1bd5191df013 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:32.852780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834bb5-9b63-4bc6-a1de-1bd5191df013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:32.866008 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e834bb5-9b63-4bc6-a1de-1bd5191df013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:32.867920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e834bb5-9b63-4bc6-a1de-1bd5191df013 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:32.888168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-0e834bb5-9b63-4bc6-a1de-1bd5191df013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:32.888168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:32.888168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:32.888168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:32.888168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:32.888168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:32.888168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:32.888168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:32.888168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:32.888168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:32.888168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:32.888168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:32.888168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:32.888168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:32.888168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:32.889137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:32.889137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:32.889137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:32.889137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:32.889137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:32.889137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:32.889137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:32.889137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:32.889137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:32.889137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:32.889137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:32.889137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:32.889137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:32.889137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:32.889137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:32.889137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:32.889137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:32.890074 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:32.890074 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:32.890074 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:32.890074 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:32.892585 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 314/625] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:32.898298 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ecb29-fd76-44aa-8da2-c280de77105e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:33.055899 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ecb29-fd76-44aa-8da2-c280de77105e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:33.104372 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84d08a-5a57-454e-9186-8d4e4d05a395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:33.105139 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84d08a-5a57-454e-9186-8d4e4d05a395 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:33.105325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84d08a-5a57-454e-9186-8d4e4d05a395 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:33.105577 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84d08a-5a57-454e-9186-8d4e4d05a395 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:33.106334 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84d08a-5a57-454e-9186-8d4e4d05a395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:33.106635 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84d08a-5a57-454e-9186-8d4e4d05a395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:33.108007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84d08a-5a57-454e-9186-8d4e4d05a395 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:33.121123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 312/626] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:33.126211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834bb5-9b63-4bc6-a1de-1bd5191df013 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:33.243134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6afdc-8f27-469f-9249-ba0f788998a8 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:33.243519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6afdc-8f27-469f-9249-ba0f788998a8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:33.243785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6afdc-8f27-469f-9249-ba0f788998a8 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:33.245293 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 313/627] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:33.250174 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f62bb-f80f-4e36-b5c1-ff2bbe3b4809 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:33.250460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f62bb-f80f-4e36-b5c1-ff2bbe3b4809 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:33.250734 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f62bb-f80f-4e36-b5c1-ff2bbe3b4809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:33.284071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834bb5-9b63-4bc6-a1de-1bd5191df013 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:33.285328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-cf8f62bb-f80f-4e36-b5c1-ff2bbe3b4809 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:33.289805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-cf8f62bb-f80f-4e36-b5c1-ff2bbe3b4809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:33.353509 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24914ab5-846f-4bad-964d-ccdf7c7457df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:33.355030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24914ab5-846f-4bad-964d-ccdf7c7457df None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:33.356108 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24914ab5-846f-4bad-964d-ccdf7c7457df None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:33.357109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24914ab5-846f-4bad-964d-ccdf7c7457df None admin] PATH_INFO: `/v3/users/nova` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:33.367708 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:33.377015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24914ab5-846f-4bad-964d-ccdf7c7457df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:33.379589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24914ab5-846f-4bad-964d-ccdf7c7457df None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:33.401104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-24914ab5-846f-4bad-964d-ccdf7c7457df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:48:33.401104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:33.401104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:33.401104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:33.401104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:33.401104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:33.401104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:33.401104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:33.401104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:33.401104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:33.401104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:33.401104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:33.401104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:33.401104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:33.401104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:33.401104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:33.402137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:33.403169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:33.403169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:33.403169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:33.403169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:33.403169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:33.403169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:33.403169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:33.403169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:33.403169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:48:33.403169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:33.406049 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 315/628] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 7 21:48:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:33.410785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24914ab5-846f-4bad-964d-ccdf7c7457df None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:33.418258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 314/629] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:48:33.424670 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:33.446104 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f62bb-f80f-4e36-b5c1-ff2bbe3b4809 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:33.585641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24914ab5-846f-4bad-964d-ccdf7c7457df None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:33.615526 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f62bb-f80f-4e36-b5c1-ff2bbe3b4809 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:33.650471 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af078262-375b-4f37-8219-4a4e833a98bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:33.651160 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af078262-375b-4f37-8219-4a4e833a98bd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:33.651443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af078262-375b-4f37-8219-4a4e833a98bd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:33.651716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af078262-375b-4f37-8219-4a4e833a98bd None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:33.652712 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af078262-375b-4f37-8219-4a4e833a98bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:33.653018 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af078262-375b-4f37-8219-4a4e833a98bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:33.654471 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af078262-375b-4f37-8219-4a4e833a98bd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:33.679812 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed145ca-534a-4c69-a2b1-c74f79940221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:33.680661 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed145ca-534a-4c69-a2b1-c74f79940221 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:33.680944 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed145ca-534a-4c69-a2b1-c74f79940221 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:33.681247 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed145ca-534a-4c69-a2b1-c74f79940221 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:33.694499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 316/630] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 7 21:48:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:33.697449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af078262-375b-4f37-8219-4a4e833a98bd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:33.711056 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed145ca-534a-4c69-a2b1-c74f79940221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:33.725592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-2ed145ca-534a-4c69-a2b1-c74f79940221 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:33.725592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:33.725592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:33.725592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:33.725592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:33.725592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:33.725592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:33.725592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:33.725592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:33.725592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:33.725592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:33.725592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:33.725592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:33.725592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:33.725592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:33.725592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:33.726645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:33.726645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:33.726645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:33.726645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:33.726645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:33.726645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:33.726645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:33.726645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:33.726645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:33.726645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:33.726645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:33.726645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:33.726645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:33.726645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:33.726645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:33.726645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:33.727505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:33.727505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:33.727505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:33.727505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:33.727505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:33.727505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:33.727505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:33.727505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:33.727505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:33.727505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:33.727505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:33.727505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:33.728191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 315/631] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:33.733738 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed145ca-534a-4c69-a2b1-c74f79940221 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:33.786270 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:33.806437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:33.840800 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af078262-375b-4f37-8219-4a4e833a98bd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:33.876140 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a656c-d792-4981-87bd-59be9f2cc708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:33.876760 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a656c-d792-4981-87bd-59be9f2cc708 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:33.876970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a656c-d792-4981-87bd-59be9f2cc708 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:33.877293 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a656c-d792-4981-87bd-59be9f2cc708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:33.946990 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a656c-d792-4981-87bd-59be9f2cc708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:33.948487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a656c-d792-4981-87bd-59be9f2cc708 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:33.992010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed145ca-534a-4c69-a2b1-c74f79940221 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:34.021161 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:34.061294 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 317/632] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:34.068031 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a656c-d792-4981-87bd-59be9f2cc708 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:34.084184 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3d29e-5f6f-4cad-9dad-aa72e82ef893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:34.084867 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3d29e-5f6f-4cad-9dad-aa72e82ef893 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:34.085148 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3d29e-5f6f-4cad-9dad-aa72e82ef893 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:34.085421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3d29e-5f6f-4cad-9dad-aa72e82ef893 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:34.086363 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3d29e-5f6f-4cad-9dad-aa72e82ef893 None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:34.086664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3d29e-5f6f-4cad-9dad-aa72e82ef893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:34.091619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3d29e-5f6f-4cad-9dad-aa72e82ef893 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:34.106893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 316/633] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:34.108341 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76add8e1-4c66-4f0f-b3ad-af44d6818d24 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:34.108637 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76add8e1-4c66-4f0f-b3ad-af44d6818d24 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:34.108914 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76add8e1-4c66-4f0f-b3ad-af44d6818d24 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:34.110414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 317/634] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:34.114940 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76add8e1-4c66-4f0f-b3ad-af44d6818d24 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:34.197078 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a656c-d792-4981-87bd-59be9f2cc708 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:34.232168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:34.234790 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f780884-f0c6-4877-844e-3772292cdd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:34.235596 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f780884-f0c6-4877-844e-3772292cdd47 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:34.235968 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f780884-f0c6-4877-844e-3772292cdd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:34.236150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f780884-f0c6-4877-844e-3772292cdd47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:34.245909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76add8e1-4c66-4f0f-b3ad-af44d6818d24 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:34.247680 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f780884-f0c6-4877-844e-3772292cdd47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:34.249204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f780884-f0c6-4877-844e-3772292cdd47 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:34.273952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-9f780884-f0c6-4877-844e-3772292cdd47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:34.273952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:34.273952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:34.273952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:34.273952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:34.273952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:34.273952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:34.273952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:34.273952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:34.273952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:34.273952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:34.273952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:34.273952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:34.273952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:34.273952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:34.275428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:34.275428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:34.275428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:34.275428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:34.275428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:34.275428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:34.275428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:34.275428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:34.275428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:34.275428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:34.275428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:34.275428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:34.275428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:34.275428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:34.275428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:34.275428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:34.275428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:34.276308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:34.276308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:34.276308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:34.276308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:34.276308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 318/635] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:34.276308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0ae4a-1f44-401e-a131-9a0204346501 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:34.276308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0ae4a-1f44-401e-a131-9a0204346501 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:34.276308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0ae4a-1f44-401e-a131-9a0204346501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:34.285171 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf8138-adfa-45d0-9822-097c3270b202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:34.286086 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf8138-adfa-45d0-9822-097c3270b202 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:34.286432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf8138-adfa-45d0-9822-097c3270b202 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:34.286777 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf8138-adfa-45d0-9822-097c3270b202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:34.293286 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e8c0ae4a-1f44-401e-a131-9a0204346501 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:34.295043 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e8c0ae4a-1f44-401e-a131-9a0204346501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:34.297524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf8138-adfa-45d0-9822-097c3270b202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:34.299383 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf8138-adfa-45d0-9822-097c3270b202 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:34.316618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:34.319691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-24bf8138-adfa-45d0-9822-097c3270b202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:34.319691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:34.319691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:34.319691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:34.319691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:34.319691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:34.319691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:34.319691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:34.319691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:34.319691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:34.319691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:34.319691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:34.319691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:34.319691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:34.319691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:34.323592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:34.323592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:34.323592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:34.323592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:34.323592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:34.323592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:34.323592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:34.323592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:34.323592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:34.323592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:34.323592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:34.323592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:34.323592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:34.323592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:34.323592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:34.323592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:34.323592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:34.324667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:34.324667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:34.324667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:34.324667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:34.324667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 318/636] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:34.325575 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf8138-adfa-45d0-9822-097c3270b202 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:34.394018 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 319/637] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:34.395118 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0ae4a-1f44-401e-a131-9a0204346501 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:34.456992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf8138-adfa-45d0-9822-097c3270b202 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:34.492410 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662bacb-4783-4234-8a75-ab3ed8d36c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:34.493126 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662bacb-4783-4234-8a75-ab3ed8d36c86 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:34.493407 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662bacb-4783-4234-8a75-ab3ed8d36c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:34.493706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662bacb-4783-4234-8a75-ab3ed8d36c86 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:34.494448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662bacb-4783-4234-8a75-ab3ed8d36c86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:34.494753 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662bacb-4783-4234-8a75-ab3ed8d36c86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:34.496123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662bacb-4783-4234-8a75-ab3ed8d36c86 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:34.507102 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 319/638] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:34.508293 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea3ac-bcb2-4049-a230-26c0c52673aa None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:34.508575 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea3ac-bcb2-4049-a230-26c0c52673aa None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:34.508844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea3ac-bcb2-4049-a230-26c0c52673aa None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:34.514645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 320/639] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:34.515286 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdea3ac-bcb2-4049-a230-26c0c52673aa None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:34.517970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0ae4a-1f44-401e-a131-9a0204346501 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:34.519571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:34.556662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd4de9-1650-48a1-8d80-ca71d9fa3a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:34.557311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd4de9-1650-48a1-8d80-ca71d9fa3a55 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:34.557691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd4de9-1650-48a1-8d80-ca71d9fa3a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:34.558082 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd4de9-1650-48a1-8d80-ca71d9fa3a55 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:34.558789 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd4de9-1650-48a1-8d80-ca71d9fa3a55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:34.559089 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd4de9-1650-48a1-8d80-ca71d9fa3a55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:34.560577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd4de9-1650-48a1-8d80-ca71d9fa3a55 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:34.577736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 320/640] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:34.578583 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd4de9-1650-48a1-8d80-ca71d9fa3a55 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:34.590953 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:34.620393 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdea3ac-bcb2-4049-a230-26c0c52673aa None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:34.656192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8d878-9e89-46cd-9e8a-cd30f4efb977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:34.656979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8d878-9e89-46cd-9e8a-cd30f4efb977 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:34.657255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8d878-9e89-46cd-9e8a-cd30f4efb977 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:34.657525 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8d878-9e89-46cd-9e8a-cd30f4efb977 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:34.669318 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8d878-9e89-46cd-9e8a-cd30f4efb977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:34.677653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-a4e8d878-9e89-46cd-9e8a-cd30f4efb977 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:34.677653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:34.677653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:34.677653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:34.677653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:34.677653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:34.677653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:34.677653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:34.677653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:34.677653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:34.677653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:34.677653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:34.677653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:34.677653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:34.677653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:34.677653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:34.678592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:34.678592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:34.678592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:34.678592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:34.678592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:34.678592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:34.678592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:34.678592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:34.678592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:34.678592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:34.678592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:34.678592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:34.678592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:34.678592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:34.678592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:34.678592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:34.679404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:34.679404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:34.679404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:34.679404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:34.679404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:34.679404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:34.679404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:34.679404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:34.679404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:34.679404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:34.679404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:34.679404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:34.679404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 321/641] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:34.680082 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2939c-0288-4762-bae8-2f90ba041df8 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:34.680632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2939c-0288-4762-bae8-2f90ba041df8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:34.680632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2939c-0288-4762-bae8-2f90ba041df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:34.689095 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd4de9-1650-48a1-8d80-ca71d9fa3a55 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:34.697513 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-33a2939c-0288-4762-bae8-2f90ba041df8 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:34.698883 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-33a2939c-0288-4762-bae8-2f90ba041df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:34.726622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058e08e-8b38-450d-8081-f63debcbb58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:34.727344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058e08e-8b38-450d-8081-f63debcbb58a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:34.727625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058e08e-8b38-450d-8081-f63debcbb58a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:34.728434 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058e08e-8b38-450d-8081-f63debcbb58a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:34.735153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058e08e-8b38-450d-8081-f63debcbb58a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:34.736593 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058e08e-8b38-450d-8081-f63debcbb58a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:34.750825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-2058e08e-8b38-450d-8081-f63debcbb58a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:34.750825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:34.750825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:34.750825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:34.750825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:34.750825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:34.750825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:34.750825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:34.750825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:34.750825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:34.750825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:34.750825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:34.750825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:34.750825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:34.750825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:34.751776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:34.751776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:34.751776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:34.751776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:34.751776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:34.751776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:34.751776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:34.751776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:34.751776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:34.751776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:34.751776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:34.751776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:34.751776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:34.751776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:34.751776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:34.751776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:34.751776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:34.752655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:34.752655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:34.752655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:34.752655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:34.752655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:34.752655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:34.752655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:34.752655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:34.752655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 321/642] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:34.753132 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058e08e-8b38-450d-8081-f63debcbb58a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:34.766436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:34.782240 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 322/643] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:34.782932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2939c-0288-4762-bae8-2f90ba041df8 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:34.829088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:34.863393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058e08e-8b38-450d-8081-f63debcbb58a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:34.891169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2939c-0288-4762-bae8-2f90ba041df8 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:34.899374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e6eef-4611-420a-a14b-1608b85887d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:34.900790 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e6eef-4611-420a-a14b-1608b85887d3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:34.901271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e6eef-4611-420a-a14b-1608b85887d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:34.901379 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e6eef-4611-420a-a14b-1608b85887d3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:34.908705 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e6eef-4611-420a-a14b-1608b85887d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:34.910173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e6eef-4611-420a-a14b-1608b85887d3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:34.924661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-a10e6eef-4611-420a-a14b-1608b85887d3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 07 21:48:34.924661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:34.924661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:34.924661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:34.924661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:34.924661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:34.924661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:34.924661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:34.924661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:34.924661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:34.924661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:34.924661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:34.924661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:34.924661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:34.924661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:34.924661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:34.925638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:34.926668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:34.926668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:34.926668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:34.926668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:34.926668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:34.926668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:34.926668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:34.926668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:34.926668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 07 21:48:34.926668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:34.926668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 322/644] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:34.926668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e6eef-4611-420a-a14b-1608b85887d3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:34.934655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec3fb2-c9cc-49e2-89f6-b03d1210c213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:34.935336 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec3fb2-c9cc-49e2-89f6-b03d1210c213 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:34.935620 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec3fb2-c9cc-49e2-89f6-b03d1210c213 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:34.935892 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec3fb2-c9cc-49e2-89f6-b03d1210c213 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:34.937168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec3fb2-c9cc-49e2-89f6-b03d1210c213 None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:34.937476 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec3fb2-c9cc-49e2-89f6-b03d1210c213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:34.939227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec3fb2-c9cc-49e2-89f6-b03d1210c213 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:34.948411 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 323/645] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:34.953362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec3fb2-c9cc-49e2-89f6-b03d1210c213 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:35.008804 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:35.039092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e6eef-4611-420a-a14b-1608b85887d3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:35.056706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec3fb2-c9cc-49e2-89f6-b03d1210c213 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:35.071425 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:35.078580 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3fe1e-5582-4c75-b4b6-b8b40df44959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:35.079233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3fe1e-5582-4c75-b4b6-b8b40df44959 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:35.079514 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3fe1e-5582-4c75-b4b6-b8b40df44959 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:35.079782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3fe1e-5582-4c75-b4b6-b8b40df44959 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:35.080562 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3fe1e-5582-4c75-b4b6-b8b40df44959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:35.080873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3fe1e-5582-4c75-b4b6-b8b40df44959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:35.082345 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3fe1e-5582-4c75-b4b6-b8b40df44959 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:35.093545 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333117c9-8db6-46db-b8db-d8f4af515f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:35.094361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333117c9-8db6-46db-b8db-d8f4af515f3d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:35.094644 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333117c9-8db6-46db-b8db-d8f4af515f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:35.094918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333117c9-8db6-46db-b8db-d8f4af515f3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:35.095529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 323/646] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:35.096115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3fe1e-5582-4c75-b4b6-b8b40df44959 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:35.110309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333117c9-8db6-46db-b8db-d8f4af515f3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:35.117836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-333117c9-8db6-46db-b8db-d8f4af515f3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:35.117836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:35.117836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:35.117836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:35.117836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:35.117836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:35.117836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:35.117836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:35.117836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:35.117836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:35.117836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:35.117836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:35.117836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:35.117836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:35.117836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:35.117836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:35.118859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:35.118859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:35.118859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:35.118859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:35.118859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:35.118859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:35.118859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:35.118859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:35.118859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:35.118859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:35.118859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:35.118859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:35.118859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:35.118859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:35.118859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:35.118859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:35.119694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:35.119694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:35.119694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:35.119694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:35.119694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:35.119694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:35.119694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:35.119694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:35.119694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:35.119694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:35.119694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:35.119694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:35.119694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 324/647] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:35.120379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333117c9-8db6-46db-b8db-d8f4af515f3d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:35.205448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3fe1e-5582-4c75-b4b6-b8b40df44959 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:35.227633 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333117c9-8db6-46db-b8db-d8f4af515f3d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:35.240326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a4842-8bb9-4ea0-a608-9c955dd48424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:35.240989 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a4842-8bb9-4ea0-a608-9c955dd48424 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:35.241384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a4842-8bb9-4ea0-a608-9c955dd48424 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:35.241654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a4842-8bb9-4ea0-a608-9c955dd48424 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:35.242619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a4842-8bb9-4ea0-a608-9c955dd48424 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:35.242920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a4842-8bb9-4ea0-a608-9c955dd48424 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:35.244687 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:35.245486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a4842-8bb9-4ea0-a608-9c955dd48424 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:35.264213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a9632-0e57-4b51-835c-48f6a1d1e504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:35.264925 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a9632-0e57-4b51-835c-48f6a1d1e504 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:35.265203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a9632-0e57-4b51-835c-48f6a1d1e504 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:35.265471 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a9632-0e57-4b51-835c-48f6a1d1e504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:35.268586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 324/648] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jun 7 21:48:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:35.269554 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a4842-8bb9-4ea0-a608-9c955dd48424 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:35.276044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a9632-0e57-4b51-835c-48f6a1d1e504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:35.277494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a9632-0e57-4b51-835c-48f6a1d1e504 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:35.295824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-1c0a9632-0e57-4b51-835c-48f6a1d1e504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:35.295824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:35.295824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:35.295824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:35.295824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:35.295824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:35.295824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:35.295824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:35.295824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:35.295824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:35.295824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:35.295824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:35.295824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:35.295824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:35.295824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:35.296725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:35.296725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:35.296725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:35.296725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:35.296725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:35.296725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:35.296725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:35.296725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:35.296725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:35.296725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:35.296725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:35.296725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:35.296725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:35.296725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:35.296725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:35.296725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:35.296725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:35.297607 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:35.297607 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:35.297607 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:35.297607 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:35.297607 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 325/649] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:35.297904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a9632-0e57-4b51-835c-48f6a1d1e504 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:35.327679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:35.387315 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a4842-8bb9-4ea0-a608-9c955dd48424 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:35.402582 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a9632-0e57-4b51-835c-48f6a1d1e504 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:35.420141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe372c2-c393-4ea8-b70a-97010200bd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:35.420779 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe372c2-c393-4ea8-b70a-97010200bd3b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:35.421062 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe372c2-c393-4ea8-b70a-97010200bd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:35.421331 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe372c2-c393-4ea8-b70a-97010200bd3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:35.422179 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe372c2-c393-4ea8-b70a-97010200bd3b None admin] RBAC: Adding query filter params (role.id=382652f08fc24ce39f91164181237006, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=1d5760a3f9f946978b1251d3e2aaa943) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:35.422492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe372c2-c393-4ea8-b70a-97010200bd3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:35.423914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe372c2-c393-4ea8-b70a-97010200bd3b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:35.429529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 325/650] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:48:35 2022] GET /identity/v3/role_assignments?user.id=1d5760a3f9f946978b1251d3e2aaa943&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=382652f08fc24ce39f91164181237006 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:35.430321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe372c2-c393-4ea8-b70a-97010200bd3b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:35.443522 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5535062-9e47-4a65-a3b6-345fc7254571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:35.444213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5535062-9e47-4a65-a3b6-345fc7254571 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:35.444495 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5535062-9e47-4a65-a3b6-345fc7254571 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:35.444767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5535062-9e47-4a65-a3b6-345fc7254571 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:35.445528 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5535062-9e47-4a65-a3b6-345fc7254571 None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:35.445834 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5535062-9e47-4a65-a3b6-345fc7254571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:35.447869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5535062-9e47-4a65-a3b6-345fc7254571 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:35.457279 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 326/651] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:35.458121 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5535062-9e47-4a65-a3b6-345fc7254571 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:35.491855 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:35.557014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe372c2-c393-4ea8-b70a-97010200bd3b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:35.572160 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:35.580082 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5535062-9e47-4a65-a3b6-345fc7254571 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:35.596453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a1f1a-cdac-4081-86ed-e577b7efdc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:35.597136 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a1f1a-cdac-4081-86ed-e577b7efdc93 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:35.597414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a1f1a-cdac-4081-86ed-e577b7efdc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:35.597686 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a1f1a-cdac-4081-86ed-e577b7efdc93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:35.616848 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a35171-98b1-4dda-9792-245fafb29c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:35.617520 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35171-98b1-4dda-9792-245fafb29c97 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:35.617804 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35171-98b1-4dda-9792-245fafb29c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:35.619310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35171-98b1-4dda-9792-245fafb29c97 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:35.619456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a35171-98b1-4dda-9792-245fafb29c97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:35.619753 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a35171-98b1-4dda-9792-245fafb29c97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:35.621130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a35171-98b1-4dda-9792-245fafb29c97 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:35.637275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 327/652] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:35.637275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed05c60-0284-40db-8468-8ccb8a001b38 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:35.637275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed05c60-0284-40db-8468-8ccb8a001b38 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:35.637275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed05c60-0284-40db-8468-8ccb8a001b38 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:35.637687 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 328/653] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:35.638246 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed05c60-0284-40db-8468-8ccb8a001b38 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:35.691075 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a1f1a-cdac-4081-86ed-e577b7efdc93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:35.695806 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a1f1a-cdac-4081-86ed-e577b7efdc93 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:35.740328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:35.752150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed05c60-0284-40db-8468-8ccb8a001b38 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:35.787372 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3dc19-c693-4dc9-afab-a91e7867504b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:35.788245 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3dc19-c693-4dc9-afab-a91e7867504b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:35.788536 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3dc19-c693-4dc9-afab-a91e7867504b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:35.788817 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3dc19-c693-4dc9-afab-a91e7867504b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:35.799595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3dc19-c693-4dc9-afab-a91e7867504b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:35.801040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3dc19-c693-4dc9-afab-a91e7867504b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:35.809724 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 326/654] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:35.810814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a1f1a-cdac-4081-86ed-e577b7efdc93 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:35.823202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-a7c3dc19-c693-4dc9-afab-a91e7867504b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:35.823202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:35.823202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:35.823202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:35.823202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:35.823202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:35.823202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:35.823202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:35.823202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:35.823202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:35.823202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:35.823202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:35.823202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:35.823202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:35.823202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:35.824228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:35.824228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:35.824228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:35.824228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:35.824228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:35.824228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:35.824228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:35.824228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:35.824228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:35.824228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:35.824228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:35.824228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:35.824228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:35.824228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:35.824228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:35.824228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:35.824228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:35.825414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:35.825414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:35.825414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:35.825414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:35.826882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:35.831609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 329/655] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:35.832938 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564c3c0-8cb9-45d6-949e-ad8ab77e59c9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:35.833232 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564c3c0-8cb9-45d6-949e-ad8ab77e59c9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:35.833514 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564c3c0-8cb9-45d6-949e-ad8ab77e59c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:35.849862 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4564c3c0-8cb9-45d6-949e-ad8ab77e59c9 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:35.851324 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4564c3c0-8cb9-45d6-949e-ad8ab77e59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:35.917890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a1f1a-cdac-4081-86ed-e577b7efdc93 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:35.926738 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 330/656] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:35.926738 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564c3c0-8cb9-45d6-949e-ad8ab77e59c9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:35.960363 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4e167-aa5a-4f6f-9c97-6598ae943659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:35.961262 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4e167-aa5a-4f6f-9c97-6598ae943659 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:35.961559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4e167-aa5a-4f6f-9c97-6598ae943659 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:35.961922 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4e167-aa5a-4f6f-9c97-6598ae943659 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:35.969373 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4e167-aa5a-4f6f-9c97-6598ae943659 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:35.970967 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4e167-aa5a-4f6f-9c97-6598ae943659 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:35.987298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-09d4e167-aa5a-4f6f-9c97-6598ae943659 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 21:48:35.987298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:35.987298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:35.987298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:35.987298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:35.987298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:35.987298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:35.987298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:35.987298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:35.987298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:35.987298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:35.987298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:35.987298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:35.987298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:35.987298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:35.987298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:35.988357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:35.989395 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:35.989395 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:35.989395 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:35.989395 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:35.989395 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:35.989395 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:35.989395 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:35.989395 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:35.989395 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 21:48:35.989395 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:35.993160 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 327/657] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:35.994228 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4e167-aa5a-4f6f-9c97-6598ae943659 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:36.005772 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:36.038620 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564c3c0-8cb9-45d6-949e-ad8ab77e59c9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:36.073332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282f4a0-6ac7-43b0-be54-b225fef06bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:36.074146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f4a0-6ac7-43b0-be54-b225fef06bfc None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:36.074429 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f4a0-6ac7-43b0-be54-b225fef06bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:36.074702 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f4a0-6ac7-43b0-be54-b225fef06bfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:36.078094 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:36.085727 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282f4a0-6ac7-43b0-be54-b225fef06bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:36.087272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282f4a0-6ac7-43b0-be54-b225fef06bfc None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:36.106044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e282f4a0-6ac7-43b0-be54-b225fef06bfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:36.106044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:36.106044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:36.106044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:36.106044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:36.106044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:36.106044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:36.106044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:36.106044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:36.106044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:36.106044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:36.106044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:36.106044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:36.106044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:36.106044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:36.106948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:36.106948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:36.106948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:36.106948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:36.106948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:36.106948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:36.106948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:36.106948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:36.106948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:36.106948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:36.106948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:36.106948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:36.106948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:36.106948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:36.106948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:36.106948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:36.106948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:36.108564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:36.108564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:36.108564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:36.108564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:36.108564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 331/658] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:36.108564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282f4a0-6ac7-43b0-be54-b225fef06bfc None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:36.117647 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4e167-aa5a-4f6f-9c97-6598ae943659 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:36.156809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b83651-1d6f-43a8-a5b7-e300d4c6f629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:36.157699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b83651-1d6f-43a8-a5b7-e300d4c6f629 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:36.158177 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b83651-1d6f-43a8-a5b7-e300d4c6f629 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:36.158452 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b83651-1d6f-43a8-a5b7-e300d4c6f629 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:36.159177 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b83651-1d6f-43a8-a5b7-e300d4c6f629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:36.159480 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b83651-1d6f-43a8-a5b7-e300d4c6f629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:36.160860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b83651-1d6f-43a8-a5b7-e300d4c6f629 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:36.173229 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 328/659] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:36.174104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b83651-1d6f-43a8-a5b7-e300d4c6f629 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:36.225495 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282f4a0-6ac7-43b0-be54-b225fef06bfc None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:36.251018 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:36.264272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e735c0-7e7e-4012-8417-fc16847cc731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:36.265071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e735c0-7e7e-4012-8417-fc16847cc731 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:36.265354 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e735c0-7e7e-4012-8417-fc16847cc731 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:36.265628 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e735c0-7e7e-4012-8417-fc16847cc731 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:36.279097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b83651-1d6f-43a8-a5b7-e300d4c6f629 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:36.279270 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e735c0-7e7e-4012-8417-fc16847cc731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:36.287916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-05e735c0-7e7e-4012-8417-fc16847cc731 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:36.287916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:36.287916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:36.287916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:36.287916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:36.287916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:36.287916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:36.287916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:36.287916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:36.287916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:36.287916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:36.287916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:36.287916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:36.287916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:36.287916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:36.287916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:36.288893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:36.288893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:36.288893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:36.288893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:36.288893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:36.288893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:36.288893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:36.288893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:36.288893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:36.288893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:36.288893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:36.288893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:36.288893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:36.288893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:36.288893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:36.288893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:36.289719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:36.289719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:36.289719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:36.289719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:36.289719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:36.289719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:36.289719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:36.289719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:36.289719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:36.289719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:36.289719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:36.289719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:36.289719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 332/660] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:36.291987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e735c0-7e7e-4012-8417-fc16847cc731 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:36.316130 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:36.322449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e80d1c-dc4b-4a2d-8edf-2b6ef85b8b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:36.323115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e80d1c-dc4b-4a2d-8edf-2b6ef85b8b52 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:36.323445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e80d1c-dc4b-4a2d-8edf-2b6ef85b8b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:36.323668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e80d1c-dc4b-4a2d-8edf-2b6ef85b8b52 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:36.324495 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e80d1c-dc4b-4a2d-8edf-2b6ef85b8b52 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:36.324802 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e80d1c-dc4b-4a2d-8edf-2b6ef85b8b52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:36.326635 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e80d1c-dc4b-4a2d-8edf-2b6ef85b8b52 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:36.345041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 329/661] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Jun 7 21:48:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:36.345639 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e80d1c-dc4b-4a2d-8edf-2b6ef85b8b52 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:36.405516 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e735c0-7e7e-4012-8417-fc16847cc731 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:36.439437 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f963c-7cbe-441d-bf38-c944c20cc79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:36.440216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f963c-7cbe-441d-bf38-c944c20cc79b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:36.440598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f963c-7cbe-441d-bf38-c944c20cc79b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:36.440998 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f963c-7cbe-441d-bf38-c944c20cc79b None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:36.441814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f963c-7cbe-441d-bf38-c944c20cc79b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:36.442158 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f963c-7cbe-441d-bf38-c944c20cc79b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:36.443516 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f963c-7cbe-441d-bf38-c944c20cc79b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:36.454810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e80d1c-dc4b-4a2d-8edf-2b6ef85b8b52 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:36.455305 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 333/662] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:36.456092 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f963c-7cbe-441d-bf38-c944c20cc79b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:36.495308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97363bb9-e25c-49bc-b4b2-a3e6cb4cdab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:36.496257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97363bb9-e25c-49bc-b4b2-a3e6cb4cdab9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:36.496638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97363bb9-e25c-49bc-b4b2-a3e6cb4cdab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:36.497000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97363bb9-e25c-49bc-b4b2-a3e6cb4cdab9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:36.504174 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97363bb9-e25c-49bc-b4b2-a3e6cb4cdab9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:36.505481 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:36.505798 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97363bb9-e25c-49bc-b4b2-a3e6cb4cdab9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:36.521071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-97363bb9-e25c-49bc-b4b2-a3e6cb4cdab9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 21:48:36.521071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:36.521071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:36.521071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:36.521071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:36.521071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:36.521071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:36.521071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:36.521071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:36.521071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:36.521071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:36.521071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:36.521071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:36.521071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:36.521071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:36.521071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:36.522251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:36.523436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:36.523436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:36.523436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:36.523436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:36.523436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:36.523436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:36.523436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:36.523436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:36.523436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 21:48:36.523436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:36.523436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 330/663] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:36.523436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97363bb9-e25c-49bc-b4b2-a3e6cb4cdab9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:36.568185 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f963c-7cbe-441d-bf38-c944c20cc79b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:36.578716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:36.605760 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab7a8b-9c32-4245-a780-d514d5d39237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:36.606674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7a8b-9c32-4245-a780-d514d5d39237 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:36.607029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7a8b-9c32-4245-a780-d514d5d39237 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:36.607380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7a8b-9c32-4245-a780-d514d5d39237 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:36.608155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab7a8b-9c32-4245-a780-d514d5d39237 None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:36.608469 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab7a8b-9c32-4245-a780-d514d5d39237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:36.609880 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab7a8b-9c32-4245-a780-d514d5d39237 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:36.618628 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 334/664] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:36.619437 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab7a8b-9c32-4245-a780-d514d5d39237 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:36.640686 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97363bb9-e25c-49bc-b4b2-a3e6cb4cdab9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:36.680802 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0100f-0745-446f-912d-1c782e2324db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:36.681565 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0100f-0745-446f-912d-1c782e2324db None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:36.681982 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0100f-0745-446f-912d-1c782e2324db None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:36.682265 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0100f-0745-446f-912d-1c782e2324db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:36.721600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab7a8b-9c32-4245-a780-d514d5d39237 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:36.729685 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:36.759661 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d28088-54ce-489f-944d-b6aaaa6f4ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:36.760054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0100f-0745-446f-912d-1c782e2324db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:36.760779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d28088-54ce-489f-944d-b6aaaa6f4ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:36.761152 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d28088-54ce-489f-944d-b6aaaa6f4ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:36.761516 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d28088-54ce-489f-944d-b6aaaa6f4ca7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:36.761615 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0100f-0745-446f-912d-1c782e2324db None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:36.768436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d28088-54ce-489f-944d-b6aaaa6f4ca7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:36.770009 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d28088-54ce-489f-944d-b6aaaa6f4ca7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:36.784302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-46d28088-54ce-489f-944d-b6aaaa6f4ca7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:36.784302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:36.784302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:36.784302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:36.784302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:36.784302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:36.784302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:36.784302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:36.784302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:36.784302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:36.784302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:36.784302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:36.784302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:36.784302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:36.784302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:36.785380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:36.785380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:36.785380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:36.785380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:36.785380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:36.785380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:36.785380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:36.785380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:36.785380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:36.785380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:36.785380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:36.785380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:36.785380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:36.785380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:36.785380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:36.785380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:36.785380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:36.786475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:36.786475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:36.786475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:36.786475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:36.786475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:36.786475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:36.786475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:36.786475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:36.790160 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 335/665] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:36.791009 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d28088-54ce-489f-944d-b6aaaa6f4ca7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:36.819372 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:36.878413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 331/666] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:36.878413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0100f-0745-446f-912d-1c782e2324db None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:36.904493 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d28088-54ce-489f-944d-b6aaaa6f4ca7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:36.938339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c0842-124c-407a-ad91-3a3438f10498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:36.938997 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c0842-124c-407a-ad91-3a3438f10498 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:36.939282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c0842-124c-407a-ad91-3a3438f10498 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:36.939550 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c0842-124c-407a-ad91-3a3438f10498 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:36.940375 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c0842-124c-407a-ad91-3a3438f10498 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:36.940684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c0842-124c-407a-ad91-3a3438f10498 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:36.942123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c0842-124c-407a-ad91-3a3438f10498 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:36.963636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 336/667] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jun 7 21:48:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:36.963636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c0842-124c-407a-ad91-3a3438f10498 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:36.986289 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:36.986995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0100f-0745-446f-912d-1c782e2324db None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:37.023799 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8d22e-4171-4a62-8cdf-e843aff2c8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:37.024587 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8d22e-4171-4a62-8cdf-e843aff2c8fe None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:37.025403 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8d22e-4171-4a62-8cdf-e843aff2c8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:37.025679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8d22e-4171-4a62-8cdf-e843aff2c8fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:37.036014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8d22e-4171-4a62-8cdf-e843aff2c8fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:37.037465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8d22e-4171-4a62-8cdf-e843aff2c8fe None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:37.055303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-a4d8d22e-4171-4a62-8cdf-e843aff2c8fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:37.055303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:37.055303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:37.055303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:37.055303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:37.055303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:37.055303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:37.055303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:37.055303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:37.055303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:37.055303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:37.055303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:37.055303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:37.055303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:37.055303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:37.056732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:37.056732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:37.056732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:37.056732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:37.056732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:37.056732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:37.056732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:37.056732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:37.056732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:37.056732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:37.056732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:37.056732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:37.056732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:37.056732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:37.056732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:37.056732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:37.056732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:37.057621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:37.057621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:37.057621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:37.057621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:37.057621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 332/668] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:37.057904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8d22e-4171-4a62-8cdf-e843aff2c8fe None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:37.060549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:37.072257 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c0842-124c-407a-ad91-3a3438f10498 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:37.108519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b285f-def6-4af0-8a27-8a8be3132cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:37.109179 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b285f-def6-4af0-8a27-8a8be3132cab None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:37.109462 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b285f-def6-4af0-8a27-8a8be3132cab None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:37.109776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b285f-def6-4af0-8a27-8a8be3132cab None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:37.110834 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b285f-def6-4af0-8a27-8a8be3132cab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:37.110834 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b285f-def6-4af0-8a27-8a8be3132cab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:37.112279 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b285f-def6-4af0-8a27-8a8be3132cab None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:37.129270 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 337/669] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:37.129270 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b285f-def6-4af0-8a27-8a8be3132cab None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:37.172483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8d22e-4171-4a62-8cdf-e843aff2c8fe None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:37.207250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec7838-b30f-483c-8430-5174439a0fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:37.208042 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec7838-b30f-483c-8430-5174439a0fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:37.208340 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec7838-b30f-483c-8430-5174439a0fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:37.208602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec7838-b30f-483c-8430-5174439a0fd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:37.220669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec7838-b30f-483c-8430-5174439a0fd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:37.222164 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec7838-b30f-483c-8430-5174439a0fd4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:37.223867 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:37.240423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-52ec7838-b30f-483c-8430-5174439a0fd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:37.240423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:37.240423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:37.240423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:37.240423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:37.240423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:37.240423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:37.240423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:37.240423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:37.240423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:37.240423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:37.240423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:37.240423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:37.240423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:37.240423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:37.241356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:37.241356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:37.241356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:37.241356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:37.241356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:37.241356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:37.241356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:37.241356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:37.241356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:37.241356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:37.241356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:37.241356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:37.241356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:37.241356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:37.241356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:37.241356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:37.241356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:37.247942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:37.247942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:37.247942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:37.247942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:37.247942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 333/670] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:37.248236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b285f-def6-4af0-8a27-8a8be3132cab None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:37.248673 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec7838-b30f-483c-8430-5174439a0fd4 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:37.283333 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf350fb-e85a-4cca-b080-edf0ca3072b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:37.284175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf350fb-e85a-4cca-b080-edf0ca3072b7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:37.284286 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf350fb-e85a-4cca-b080-edf0ca3072b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:37.284527 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf350fb-e85a-4cca-b080-edf0ca3072b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:37.301663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:37.348977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec7838-b30f-483c-8430-5174439a0fd4 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:37.358084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf350fb-e85a-4cca-b080-edf0ca3072b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:37.359538 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf350fb-e85a-4cca-b080-edf0ca3072b7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:37.388926 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5db66-d60b-4946-8256-664035ac3dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:37.389821 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5db66-d60b-4946-8256-664035ac3dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:37.390288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5db66-d60b-4946-8256-664035ac3dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:37.390561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5db66-d60b-4946-8256-664035ac3dd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:37.391399 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5db66-d60b-4946-8256-664035ac3dd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:37.391599 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5db66-d60b-4946-8256-664035ac3dd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:37.393039 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5db66-d60b-4946-8256-664035ac3dd5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:37.406832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 334/671] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:37.407604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5db66-d60b-4946-8256-664035ac3dd5 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:37.460771 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:37.478730 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 338/672] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:37.479573 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf350fb-e85a-4cca-b080-edf0ca3072b7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:37.520910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5db66-d60b-4946-8256-664035ac3dd5 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:37.536569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:37.558904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0e33e-f9a8-435d-944b-601307991525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:37.559654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0e33e-f9a8-435d-944b-601307991525 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:37.560020 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0e33e-f9a8-435d-944b-601307991525 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:37.560385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0e33e-f9a8-435d-944b-601307991525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:37.561219 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0e33e-f9a8-435d-944b-601307991525 None admin] RBAC: Adding query filter params (role.id=382652f08fc24ce39f91164181237006, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=1a3c022963e74e989a703938ff057757) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:37.561539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0e33e-f9a8-435d-944b-601307991525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:37.563015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0e33e-f9a8-435d-944b-601307991525 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:37.568882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 335/673] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:48:37 2022] GET /identity/v3/role_assignments?user.id=1a3c022963e74e989a703938ff057757&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=382652f08fc24ce39f91164181237006 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:37.569654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0e33e-f9a8-435d-944b-601307991525 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:37.605120 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf350fb-e85a-4cca-b080-edf0ca3072b7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:37.660303 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d3a9d-c339-4192-ac68-84f2606e9c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:37.661233 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d3a9d-c339-4192-ac68-84f2606e9c05 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:37.661989 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d3a9d-c339-4192-ac68-84f2606e9c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:37.662706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d3a9d-c339-4192-ac68-84f2606e9c05 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:37.663621 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d3a9d-c339-4192-ac68-84f2606e9c05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:37.664074 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d3a9d-c339-4192-ac68-84f2606e9c05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:37.666705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d3a9d-c339-4192-ac68-84f2606e9c05 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:37.685623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 339/674] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:37.685623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d3a9d-c339-4192-ac68-84f2606e9c05 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:37.702146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0e33e-f9a8-435d-944b-601307991525 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:37.740837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:37.755679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb0cfd-8942-4662-9649-8fcaac0df706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:37.756488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb0cfd-8942-4662-9649-8fcaac0df706 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:37.756774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb0cfd-8942-4662-9649-8fcaac0df706 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:37.757245 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb0cfd-8942-4662-9649-8fcaac0df706 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:37.766428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb0cfd-8942-4662-9649-8fcaac0df706 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:37.768022 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb0cfd-8942-4662-9649-8fcaac0df706 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:37.783543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-06bb0cfd-8942-4662-9649-8fcaac0df706 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 21:48:37.783543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:37.783543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:37.783543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:37.783543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:37.783543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:37.783543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:37.783543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:37.783543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:37.783543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:37.783543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:37.783543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:37.783543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:37.783543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:37.783543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:37.783543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:37.784549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:37.785484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:37.785484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:37.785484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:37.785484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:37.785484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:37.785484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:37.785484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:37.785484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:37.785484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 21:48:37.785484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:37.785484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 336/675] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:48:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:37.786104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb0cfd-8942-4662-9649-8fcaac0df706 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:37.812086 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d3a9d-c339-4192-ac68-84f2606e9c05 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:37.830235 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:37.851822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4ff67-8ce0-4387-b854-736c6b61737e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:37.853445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4ff67-8ce0-4387-b854-736c6b61737e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:37.853736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4ff67-8ce0-4387-b854-736c6b61737e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:37.854038 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4ff67-8ce0-4387-b854-736c6b61737e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:37.869963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4ff67-8ce0-4387-b854-736c6b61737e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:37.869963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4ff67-8ce0-4387-b854-736c6b61737e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:37.885398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-02c4ff67-8ce0-4387-b854-736c6b61737e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:37.885398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:37.885398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:37.885398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:37.885398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:37.885398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:37.885398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:37.885398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:37.885398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:37.885398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:37.885398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:37.885398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:37.885398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:37.885398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:37.885398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:37.886494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:37.886494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:37.886494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:37.886494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:37.886494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:37.886494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:37.886494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:37.886494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:37.886494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:37.886494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:37.886494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:37.886494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:37.886494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:37.886494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:37.886494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:37.886494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:37.886494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:37.887376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:37.887376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:37.887376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:37.887376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:37.887376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 340/676] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:37.887884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fc877-c45b-4670-a67b-1b8c546e5936 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:37.888290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fc877-c45b-4670-a67b-1b8c546e5936 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:37.888392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fc877-c45b-4670-a67b-1b8c546e5936 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:37.889719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 341/677] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:37.894315 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fc877-c45b-4670-a67b-1b8c546e5936 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:37.901900 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb0cfd-8942-4662-9649-8fcaac0df706 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:37.937994 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87021f5-2871-41d8-9e83-c9c32a0bf61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:37.938713 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87021f5-2871-41d8-9e83-c9c32a0bf61f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:37.938992 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87021f5-2871-41d8-9e83-c9c32a0bf61f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:37.939296 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87021f5-2871-41d8-9e83-c9c32a0bf61f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:37.946286 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87021f5-2871-41d8-9e83-c9c32a0bf61f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:37.947769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87021f5-2871-41d8-9e83-c9c32a0bf61f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:37.961883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c87021f5-2871-41d8-9e83-c9c32a0bf61f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:37.961883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:37.961883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:37.961883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:37.961883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:37.961883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:37.961883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:37.961883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:37.961883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:37.961883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:37.961883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:37.961883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:37.961883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:37.961883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:37.961883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:37.963357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:37.963357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:37.963357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:37.963357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:37.963357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:37.963357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:37.963357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:37.963357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:37.963357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:37.963357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:37.963357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:37.963357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:37.963357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:37.963357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:37.963357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:37.963357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:37.963357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:37.964233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:37.964233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:37.964233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:37.964233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:37.964233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:37.964233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:37.964233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:37.964233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:37.964233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 337/678] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:37.964710 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87021f5-2871-41d8-9e83-c9c32a0bf61f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:38.003387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:38.010854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fc877-c45b-4670-a67b-1b8c546e5936 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:38.047420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584b72f-f544-4620-b545-e9de50ed2da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:38.048176 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584b72f-f544-4620-b545-e9de50ed2da5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:38.048465 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584b72f-f544-4620-b545-e9de50ed2da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:38.048738 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584b72f-f544-4620-b545-e9de50ed2da5 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:38.049575 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584b72f-f544-4620-b545-e9de50ed2da5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:38.049882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584b72f-f544-4620-b545-e9de50ed2da5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:38.052600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584b72f-f544-4620-b545-e9de50ed2da5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:38.070013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 342/679] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jun 7 21:48:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:38.073107 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:38.076435 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0ceac-f280-4693-82f4-24da995a321b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:38.076922 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0ceac-f280-4693-82f4-24da995a321b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:38.077398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0ceac-f280-4693-82f4-24da995a321b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:38.078029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87021f5-2871-41d8-9e83-c9c32a0bf61f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:38.095864 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-34b0ceac-f280-4693-82f4-24da995a321b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:38.097382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-34b0ceac-f280-4693-82f4-24da995a321b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:38.114801 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76356560-2b2c-42a7-9378-603d95e46b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:38.115461 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76356560-2b2c-42a7-9378-603d95e46b17 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:38.115742 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76356560-2b2c-42a7-9378-603d95e46b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:38.116015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76356560-2b2c-42a7-9378-603d95e46b17 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:38.116725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76356560-2b2c-42a7-9378-603d95e46b17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:38.117031 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76356560-2b2c-42a7-9378-603d95e46b17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:38.118482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76356560-2b2c-42a7-9378-603d95e46b17 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:38.136071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 338/680] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:38.136071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76356560-2b2c-42a7-9378-603d95e46b17 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:38.182020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 343/681] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:38.182020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0ceac-f280-4693-82f4-24da995a321b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:38.246049 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76356560-2b2c-42a7-9378-603d95e46b17 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:38.275936 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:38.282654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d67628-643d-4332-94e9-a1e0acd447cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:38.283310 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d67628-643d-4332-94e9-a1e0acd447cf None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:38.283593 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d67628-643d-4332-94e9-a1e0acd447cf None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:38.283873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d67628-643d-4332-94e9-a1e0acd447cf None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:38.284652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d67628-643d-4332-94e9-a1e0acd447cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:38.284965 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d67628-643d-4332-94e9-a1e0acd447cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:38.286445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d67628-643d-4332-94e9-a1e0acd447cf None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:38.293281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0ceac-f280-4693-82f4-24da995a321b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:38.299270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 339/682] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:38.300492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d67628-643d-4332-94e9-a1e0acd447cf None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:38.323184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:38.332018 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6019ae-07c1-43c3-a15c-1b76094f864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:38.332985 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6019ae-07c1-43c3-a15c-1b76094f864a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:38.333274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6019ae-07c1-43c3-a15c-1b76094f864a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:38.333554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6019ae-07c1-43c3-a15c-1b76094f864a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:38.408538 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6019ae-07c1-43c3-a15c-1b76094f864a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:38.410027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6019ae-07c1-43c3-a15c-1b76094f864a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:38.416799 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d67628-643d-4332-94e9-a1e0acd447cf None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:38.454703 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8b979-4293-401d-9f86-8b21d2602b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:38.455741 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8b979-4293-401d-9f86-8b21d2602b41 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:38.456030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8b979-4293-401d-9f86-8b21d2602b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:38.456313 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8b979-4293-401d-9f86-8b21d2602b41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:38.463069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8b979-4293-401d-9f86-8b21d2602b41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:38.464523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8b979-4293-401d-9f86-8b21d2602b41 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:38.478577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-5ce8b979-4293-401d-9f86-8b21d2602b41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:38.478577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:38.478577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:38.478577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:38.478577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:38.478577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:38.478577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:38.478577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:38.478577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:38.478577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:38.478577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:38.478577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:38.478577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:38.478577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:38.478577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:38.479511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:38.479511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:38.479511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:38.479511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:38.479511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:38.479511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:38.479511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:38.479511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:38.479511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:38.479511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:38.479511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:38.479511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:38.479511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:38.479511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:38.479511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:38.479511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:38.479511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:38.480384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:38.480384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:38.480384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:38.480384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:38.480384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:38.480384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:38.480384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:38.480384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:38.480384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 340/683] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:38.480859 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8b979-4293-401d-9f86-8b21d2602b41 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:38.505417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:38.526639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 344/684] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:38.527648 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6019ae-07c1-43c3-a15c-1b76094f864a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:38.564376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:38.588962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8b979-4293-401d-9f86-8b21d2602b41 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:38.625577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f3663-6d78-455f-a349-7629a5aeb262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:38.626490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f3663-6d78-455f-a349-7629a5aeb262 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:38.626771 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f3663-6d78-455f-a349-7629a5aeb262 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:38.627046 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f3663-6d78-455f-a349-7629a5aeb262 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:38.629143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6019ae-07c1-43c3-a15c-1b76094f864a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:38.637095 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f3663-6d78-455f-a349-7629a5aeb262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:38.644628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-ec8f3663-6d78-455f-a349-7629a5aeb262 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:38.644628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:38.644628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:38.644628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:38.644628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:38.644628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:38.644628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:38.644628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:38.644628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:38.644628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:38.644628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:38.644628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:38.644628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:38.644628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:38.644628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:38.644628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:38.645604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:38.645604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:38.645604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:38.645604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:38.645604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:38.645604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:38.645604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:38.645604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:38.645604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:38.645604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:38.645604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:38.645604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:38.645604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:38.645604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:38.645604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:38.645604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:38.646465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:38.646465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:38.646465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:38.646465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:38.646465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:38.646465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:38.646465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:38.646465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:38.646465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:38.646465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:38.646465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:38.646465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:38.646465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 341/685] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:48:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:38.647158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f3663-6d78-455f-a349-7629a5aeb262 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:38.675172 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b97441-b7a4-49fd-9d34-e25a99443fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:38.675824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b97441-b7a4-49fd-9d34-e25a99443fbd None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:38.676110 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b97441-b7a4-49fd-9d34-e25a99443fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:38.676635 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b97441-b7a4-49fd-9d34-e25a99443fbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:38.677203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b97441-b7a4-49fd-9d34-e25a99443fbd None admin] RBAC: Adding query filter params (role.id=382652f08fc24ce39f91164181237006, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=aab50bc9064e444184afb1b4c585ce39) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:38.677517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b97441-b7a4-49fd-9d34-e25a99443fbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:38.678983 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b97441-b7a4-49fd-9d34-e25a99443fbd None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:38.685045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 345/686] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:48:38 2022] GET /identity/v3/role_assignments?user.id=aab50bc9064e444184afb1b4c585ce39&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=382652f08fc24ce39f91164181237006 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:38.685823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b97441-b7a4-49fd-9d34-e25a99443fbd None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:38.758029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f3663-6d78-455f-a349-7629a5aeb262 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:38.768204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:38.804439 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65c6cd-b1e2-4192-8869-beb96849b4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:38.805488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65c6cd-b1e2-4192-8869-beb96849b4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:38.805774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65c6cd-b1e2-4192-8869-beb96849b4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:38.806133 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65c6cd-b1e2-4192-8869-beb96849b4b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:38.807117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65c6cd-b1e2-4192-8869-beb96849b4b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:38.807429 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65c6cd-b1e2-4192-8869-beb96849b4b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:38.809702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65c6cd-b1e2-4192-8869-beb96849b4b9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:38.819170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:38.826950 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 342/687] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:38.827901 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65c6cd-b1e2-4192-8869-beb96849b4b9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:38.833686 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b97441-b7a4-49fd-9d34-e25a99443fbd None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:38.872776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a2c09-0a83-44f7-b890-4bde1fdd4ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:38.874035 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a2c09-0a83-44f7-b890-4bde1fdd4ccb None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:38.874584 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a2c09-0a83-44f7-b890-4bde1fdd4ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:38.875058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a2c09-0a83-44f7-b890-4bde1fdd4ccb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:38.888302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a2c09-0a83-44f7-b890-4bde1fdd4ccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:38.890296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a2c09-0a83-44f7-b890-4bde1fdd4ccb None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:38.910419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-688a2c09-0a83-44f7-b890-4bde1fdd4ccb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:38.910419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:38.910419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:38.910419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:38.910419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:38.910419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:38.910419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:38.910419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:38.910419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:38.910419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:38.910419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:38.910419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:38.910419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:38.910419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:38.910419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:38.911350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:38.911350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:38.911350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:38.911350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:38.911350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:38.911350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:38.911350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:38.911350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:38.911350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:38.911350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:38.911350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:38.911350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:38.911350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:38.911350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:38.911350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:38.911350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:38.911350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:38.912231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:38.912231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:38.912231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:38.912231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:38.912231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 346/688] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:38.913564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a2c09-0a83-44f7-b890-4bde1fdd4ccb None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:38.940957 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65c6cd-b1e2-4192-8869-beb96849b4b9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:38.988221 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5d809-48e8-4351-a2fb-9d7ea37fb653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:38.988905 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5d809-48e8-4351-a2fb-9d7ea37fb653 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:38.989190 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5d809-48e8-4351-a2fb-9d7ea37fb653 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:38.989470 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5d809-48e8-4351-a2fb-9d7ea37fb653 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:38.990269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5d809-48e8-4351-a2fb-9d7ea37fb653 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:38.990560 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5d809-48e8-4351-a2fb-9d7ea37fb653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:38.992361 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5d809-48e8-4351-a2fb-9d7ea37fb653 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:39.006009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 343/689] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:39.007138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5d809-48e8-4351-a2fb-9d7ea37fb653 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:39.032567 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:39.035826 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a2c09-0a83-44f7-b890-4bde1fdd4ccb None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:39.072260 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:39.076375 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a1e27-0bed-4fd4-9d9e-a80d4653f90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:39.077063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a1e27-0bed-4fd4-9d9e-a80d4653f90f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:39.077349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a1e27-0bed-4fd4-9d9e-a80d4653f90f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:39.077662 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a1e27-0bed-4fd4-9d9e-a80d4653f90f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:39.078776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a1e27-0bed-4fd4-9d9e-a80d4653f90f None admin] RBAC: Adding query filter params (role.id=382652f08fc24ce39f91164181237006, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=5688ba6551834757b7eeef45a15f16e9) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:39.079097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a1e27-0bed-4fd4-9d9e-a80d4653f90f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:39.081160 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a1e27-0bed-4fd4-9d9e-a80d4653f90f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:39.088600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 347/690] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:48:38 2022] GET /identity/v3/role_assignments?user.id=5688ba6551834757b7eeef45a15f16e9&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=382652f08fc24ce39f91164181237006 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:39.089524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a1e27-0bed-4fd4-9d9e-a80d4653f90f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:39.120510 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5d809-48e8-4351-a2fb-9d7ea37fb653 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:39.158995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09299cc5-8819-49b1-8186-823f00b38baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:39.160128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09299cc5-8819-49b1-8186-823f00b38baa None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:39.160702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09299cc5-8819-49b1-8186-823f00b38baa None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:39.161190 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09299cc5-8819-49b1-8186-823f00b38baa None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:39.162153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09299cc5-8819-49b1-8186-823f00b38baa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:39.162668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09299cc5-8819-49b1-8186-823f00b38baa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:39.164332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09299cc5-8819-49b1-8186-823f00b38baa None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:39.178704 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 344/691] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:39.191368 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09299cc5-8819-49b1-8186-823f00b38baa None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:39.205649 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a1e27-0bed-4fd4-9d9e-a80d4653f90f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:39.245485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736d6be-f930-41ca-8569-b66beb8540ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:39.246437 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736d6be-f930-41ca-8569-b66beb8540ad None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:39.246724 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736d6be-f930-41ca-8569-b66beb8540ad None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:39.246997 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736d6be-f930-41ca-8569-b66beb8540ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:39.259369 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736d6be-f930-41ca-8569-b66beb8540ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:39.261051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736d6be-f930-41ca-8569-b66beb8540ad None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:39.280958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-9736d6be-f930-41ca-8569-b66beb8540ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:39.280958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:39.280958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:39.280958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:39.280958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:39.280958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:39.280958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:39.280958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:39.280958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:39.280958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:39.280958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:39.280958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:39.280958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:39.280958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:39.280958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:39.282377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:39.282377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:39.282377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:39.282377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:39.282377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:39.282377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:39.282377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:39.282377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:39.282377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:39.282377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:39.282377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:39.282377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:39.282377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:39.282377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:39.282377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:39.282377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:39.282377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:39.283380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:39.283380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:39.283380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:39.283380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:39.289965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 348/692] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:39.289965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736d6be-f930-41ca-8569-b66beb8540ad None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:39.310296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:39.365972 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09299cc5-8819-49b1-8186-823f00b38baa None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:39.393324 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:39.412716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ec90f-e101-4cc2-8bff-734dc17ed4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:39.413706 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ec90f-e101-4cc2-8bff-734dc17ed4ed None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:39.414077 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ec90f-e101-4cc2-8bff-734dc17ed4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:39.414424 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ec90f-e101-4cc2-8bff-734dc17ed4ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:39.423552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ec90f-e101-4cc2-8bff-734dc17ed4ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:39.425104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ec90f-e101-4cc2-8bff-734dc17ed4ed None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:39.429104 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736d6be-f930-41ca-8569-b66beb8540ad None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:39.443141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-9a3ec90f-e101-4cc2-8bff-734dc17ed4ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:39.443141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:39.443141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:39.443141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:39.443141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:39.443141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:39.443141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:39.443141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:39.443141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:39.443141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:39.443141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:39.443141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:39.443141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:39.443141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:39.443141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:39.444100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:39.444100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:39.444100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:39.444100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:39.444100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:39.444100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:39.444100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:39.444100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:39.444100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:39.444100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:39.444100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:39.444100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:39.444100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:39.444100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:39.444100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:39.444100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:39.444100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:39.444996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:39.444996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:39.444996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:39.444996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:39.444996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:39.444996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:39.444996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:39.444996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:39.448412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 345/693] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:39.454955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ec90f-e101-4cc2-8bff-734dc17ed4ed None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:39.473664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4629fac-56d9-4c29-b9e3-ded3a961d4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:39.474363 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4629fac-56d9-4c29-b9e3-ded3a961d4fd None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:39.474642 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4629fac-56d9-4c29-b9e3-ded3a961d4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:39.474915 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4629fac-56d9-4c29-b9e3-ded3a961d4fd None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:39.475902 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4629fac-56d9-4c29-b9e3-ded3a961d4fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:39.476206 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4629fac-56d9-4c29-b9e3-ded3a961d4fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:39.477578 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4629fac-56d9-4c29-b9e3-ded3a961d4fd None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:39.490912 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 349/694] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:39.507478 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4629fac-56d9-4c29-b9e3-ded3a961d4fd None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:39.588912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ec90f-e101-4cc2-8bff-734dc17ed4ed None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:39.627474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ae275-ceba-4622-8a7b-74f763d9385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:39.628152 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ae275-ceba-4622-8a7b-74f763d9385f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:39.628436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ae275-ceba-4622-8a7b-74f763d9385f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:39.628717 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ae275-ceba-4622-8a7b-74f763d9385f None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:39.629530 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ae275-ceba-4622-8a7b-74f763d9385f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:39.629843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ae275-ceba-4622-8a7b-74f763d9385f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:39.631342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ae275-ceba-4622-8a7b-74f763d9385f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:39.647013 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 346/695] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:39.652660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ae275-ceba-4622-8a7b-74f763d9385f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:39.668212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:39.702292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:39.746511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4629fac-56d9-4c29-b9e3-ded3a961d4fd None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:39.781820 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ae275-ceba-4622-8a7b-74f763d9385f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:39.799195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cd927-b8d9-4ac5-b506-033b7c44e152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:39.800532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cd927-b8d9-4ac5-b506-033b7c44e152 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:39.801038 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cd927-b8d9-4ac5-b506-033b7c44e152 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:39.801544 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cd927-b8d9-4ac5-b506-033b7c44e152 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:39.812731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cd927-b8d9-4ac5-b506-033b7c44e152 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:39.814195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cd927-b8d9-4ac5-b506-033b7c44e152 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:39.823003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7679f-e232-4f9c-b56d-7a3e60799747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:39.823772 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7679f-e232-4f9c-b56d-7a3e60799747 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:39.824156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7679f-e232-4f9c-b56d-7a3e60799747 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:39.824531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7679f-e232-4f9c-b56d-7a3e60799747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:39.825465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7679f-e232-4f9c-b56d-7a3e60799747 None admin] RBAC: Adding query filter params (role.id=382652f08fc24ce39f91164181237006, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=a4b69c708fbc470aae3e3954e21a1e88) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:39.825880 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7679f-e232-4f9c-b56d-7a3e60799747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:39.827500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7679f-e232-4f9c-b56d-7a3e60799747 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:39.828548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e76cd927-b8d9-4ac5-b506-033b7c44e152 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:48:39.828548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:39.828548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:39.828548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:39.828548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:39.828548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:39.828548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:39.828548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:39.828548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:39.828548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:39.828548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:39.828548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:39.828548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:39.828548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:39.828548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:39.828548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:39.829623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:39.830909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:39.830909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:39.830909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:39.830909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:39.830909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:39.830909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:39.830909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:39.830909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:39.830909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:48:39.830909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:39.830909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 350/696] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 7 21:48:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:39.840539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 347/697] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:48:39 2022] GET /identity/v3/role_assignments?user.id=a4b69c708fbc470aae3e3954e21a1e88&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=382652f08fc24ce39f91164181237006 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:39.841302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cd927-b8d9-4ac5-b506-033b7c44e152 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:39.952975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cd927-b8d9-4ac5-b506-033b7c44e152 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:39.993982 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6408c5c-3751-4c20-b60f-427d4f6b3f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:39.995102 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6408c5c-3751-4c20-b60f-427d4f6b3f29 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:39.995395 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6408c5c-3751-4c20-b60f-427d4f6b3f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:39.995668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6408c5c-3751-4c20-b60f-427d4f6b3f29 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:39.996507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6408c5c-3751-4c20-b60f-427d4f6b3f29 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:39.996819 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6408c5c-3751-4c20-b60f-427d4f6b3f29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:39.998260 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6408c5c-3751-4c20-b60f-427d4f6b3f29 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:40.001093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:40.024390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 351/698] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 7 21:48:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:40.030794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7679f-e232-4f9c-b56d-7a3e60799747 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:40.126883 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59a96f-b0b9-4f5d-9f9b-0084440596b4 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:40.127061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59a96f-b0b9-4f5d-9f9b-0084440596b4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:40.127294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59a96f-b0b9-4f5d-9f9b-0084440596b4 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:40.128662 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 352/699] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:48:40.147307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4991f-1f07-4621-8beb-b77a7996db22 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:40.147625 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4991f-1f07-4621-8beb-b77a7996db22 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:40.147859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4991f-1f07-4621-8beb-b77a7996db22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:40.163184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7679f-e232-4f9c-b56d-7a3e60799747 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:40.174326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:40.183296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-9ee4991f-1f07-4621-8beb-b77a7996db22 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:40.185049 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9ee4991f-1f07-4621-8beb-b77a7996db22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:40.205254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896035b9-b806-4429-ae64-4bd0854f0e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:40.206362 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896035b9-b806-4429-ae64-4bd0854f0e0a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:40.206855 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896035b9-b806-4429-ae64-4bd0854f0e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:40.207472 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896035b9-b806-4429-ae64-4bd0854f0e0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:40.265342 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 353/700] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:48:40.290657 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4991f-1f07-4621-8beb-b77a7996db22 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:40.292050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896035b9-b806-4429-ae64-4bd0854f0e0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:40.293519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896035b9-b806-4429-ae64-4bd0854f0e0a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:40.394722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 348/701] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:40.394895 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4991f-1f07-4621-8beb-b77a7996db22 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:40.400645 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896035b9-b806-4429-ae64-4bd0854f0e0a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:40.429140 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:40.433444 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cf438-8b63-452a-8679-7b749620a53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:40.434272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cf438-8b63-452a-8679-7b749620a53c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:40.434556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cf438-8b63-452a-8679-7b749620a53c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:40.434826 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cf438-8b63-452a-8679-7b749620a53c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:40.445872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cf438-8b63-452a-8679-7b749620a53c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:40.448422 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cf438-8b63-452a-8679-7b749620a53c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:40.469879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-dc5cf438-8b63-452a-8679-7b749620a53c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:40.469879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:40.469879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:40.469879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:40.469879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:40.469879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:40.469879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:40.469879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:40.469879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:40.469879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:40.469879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:40.469879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:40.469879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:40.469879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:40.469879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:40.470824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:40.470824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:40.470824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:40.470824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:40.470824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:40.470824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:40.470824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:40.470824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:40.470824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:40.470824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:40.470824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:40.470824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:40.470824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:40.470824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:40.470824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:40.470824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:40.470824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:40.472178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:40.472178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:40.472178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:40.472178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:40.472178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 354/702] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:40.473042 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:40.478485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cf438-8b63-452a-8679-7b749620a53c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:40.507567 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896035b9-b806-4429-ae64-4bd0854f0e0a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:40.549623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693904d-4629-4938-baae-d7d0a86a127d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:40.550682 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693904d-4629-4938-baae-d7d0a86a127d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:40.550969 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693904d-4629-4938-baae-d7d0a86a127d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:40.551623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693904d-4629-4938-baae-d7d0a86a127d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:40.564638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693904d-4629-4938-baae-d7d0a86a127d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:40.566155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693904d-4629-4938-baae-d7d0a86a127d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:40.589166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-7693904d-4629-4938-baae-d7d0a86a127d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:40.589166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:40.589166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:40.589166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:40.589166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:40.589166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:40.589166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:40.589166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:40.589166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:40.589166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:40.589166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:40.589166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:40.589166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:40.589166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:40.589166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:40.590146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:40.590146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:40.590146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:40.590146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:40.590146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:40.590146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:40.590146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:40.590146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:40.590146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:40.590146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:40.590146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:40.590146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:40.590146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:40.590146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:40.590146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:40.590146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:40.590146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:40.591193 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:40.591193 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:40.591193 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:40.591193 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:40.591193 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 349/703] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:40.598622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693904d-4629-4938-baae-d7d0a86a127d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:40.610560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cf438-8b63-452a-8679-7b749620a53c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:40.674486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:40.701653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87544e-5513-4b48-9386-f39486331344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:40.702724 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87544e-5513-4b48-9386-f39486331344 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:40.703195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87544e-5513-4b48-9386-f39486331344 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:40.703654 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87544e-5513-4b48-9386-f39486331344 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:40.704563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87544e-5513-4b48-9386-f39486331344 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:40.705075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87544e-5513-4b48-9386-f39486331344 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:40.706663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87544e-5513-4b48-9386-f39486331344 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:40.713774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693904d-4629-4938-baae-d7d0a86a127d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:40.740292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 355/704] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:40.745714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87544e-5513-4b48-9386-f39486331344 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:40.749473 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebf230-4e47-482c-b2b5-7b99ddcc942f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:40.750167 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebf230-4e47-482c-b2b5-7b99ddcc942f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:40.750450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebf230-4e47-482c-b2b5-7b99ddcc942f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:40.750725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebf230-4e47-482c-b2b5-7b99ddcc942f None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:40.751444 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebf230-4e47-482c-b2b5-7b99ddcc942f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:40.751750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebf230-4e47-482c-b2b5-7b99ddcc942f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:40.757950 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebf230-4e47-482c-b2b5-7b99ddcc942f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:40.766537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 350/705] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:40.770863 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebf230-4e47-482c-b2b5-7b99ddcc942f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:40.819386 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:40.935811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebf230-4e47-482c-b2b5-7b99ddcc942f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:40.938411 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87544e-5513-4b48-9386-f39486331344 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:40.971406 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7b700-ea68-4076-9f37-3a3102524fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:40.972166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7b700-ea68-4076-9f37-3a3102524fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:40.972453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7b700-ea68-4076-9f37-3a3102524fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:40.972728 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7b700-ea68-4076-9f37-3a3102524fb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:40.979962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7b700-ea68-4076-9f37-3a3102524fb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:40.981421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7b700-ea68-4076-9f37-3a3102524fb0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:40.989970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:40.997301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-0bb7b700-ea68-4076-9f37-3a3102524fb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:40.997301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:40.997301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:40.997301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:40.997301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:40.997301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:40.997301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:40.997301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:40.997301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:40.997301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:40.997301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:40.997301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:40.997301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:40.997301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:40.997301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:40.998266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:40.998266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:40.998266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:40.998266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:40.998266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:40.998266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:40.998266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:40.998266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:40.998266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:40.998266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:40.998266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:40.998266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:40.998266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:40.998266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:40.998266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:40.998266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:40.998266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:40.999147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:40.999147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:40.999147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:40.999147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:40.999147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:40.999147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:40.999147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:40.999147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:40.999147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 351/706] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:41.009950 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7b700-ea68-4076-9f37-3a3102524fb0 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:41.018631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e0cb3-bffb-4428-bbab-20df2b0cd3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:41.019503 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e0cb3-bffb-4428-bbab-20df2b0cd3e5 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:41.019928 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e0cb3-bffb-4428-bbab-20df2b0cd3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:41.020362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e0cb3-bffb-4428-bbab-20df2b0cd3e5 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:41.021207 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e0cb3-bffb-4428-bbab-20df2b0cd3e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:41.022952 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e0cb3-bffb-4428-bbab-20df2b0cd3e5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:41.062830 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 356/707] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:48:40 2022] POST /identity/v3/users => generated 254 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:48:41.117566 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7b700-ea68-4076-9f37-3a3102524fb0 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:41.156139 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af60be8-cff9-4e61-aebc-7eed760b6081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:41.156803 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af60be8-cff9-4e61-aebc-7eed760b6081 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:41.157086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af60be8-cff9-4e61-aebc-7eed760b6081 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:41.157362 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af60be8-cff9-4e61-aebc-7eed760b6081 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:41.158175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af60be8-cff9-4e61-aebc-7eed760b6081 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:41.158486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af60be8-cff9-4e61-aebc-7eed760b6081 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:41.159913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af60be8-cff9-4e61-aebc-7eed760b6081 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:41.173736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 352/708] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:41.179333 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e0cb3-bffb-4428-bbab-20df2b0cd3e5 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:41.316762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:41.328642 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e0cb3-bffb-4428-bbab-20df2b0cd3e5 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:41.364172 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3e249-6287-4a0e-84d2-2194827fae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:41.369953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3e249-6287-4a0e-84d2-2194827fae80 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:41.369953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3e249-6287-4a0e-84d2-2194827fae80 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:41.369953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3e249-6287-4a0e-84d2-2194827fae80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:41.369953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3e249-6287-4a0e-84d2-2194827fae80 None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=1d5760a3f9f946978b1251d3e2aaa943) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:41.369953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3e249-6287-4a0e-84d2-2194827fae80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:41.369953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3e249-6287-4a0e-84d2-2194827fae80 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:41.375179 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 357/709] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:48:41 2022] GET /identity/v3/role_assignments?user.id=1d5760a3f9f946978b1251d3e2aaa943&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=8f58ef9d28494d97a68de20b84355450 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:41.573136 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2319ab2-3db8-4ccc-ba11-d990ae27b863 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:41.573831 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2319ab2-3db8-4ccc-ba11-d990ae27b863 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:41.574352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2319ab2-3db8-4ccc-ba11-d990ae27b863 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:41.576244 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 353/710] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:41.583014 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45552b-afc9-4842-82f2-450a8c8ed80b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:41.583666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45552b-afc9-4842-82f2-450a8c8ed80b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:41.584146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45552b-afc9-4842-82f2-450a8c8ed80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:41.603745 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3a45552b-afc9-4842-82f2-450a8c8ed80b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:41.605251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3a45552b-afc9-4842-82f2-450a8c8ed80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:41.681584 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 358/711] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:41.708451 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2319ab2-3db8-4ccc-ba11-d990ae27b863 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:41.754177 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:41.779203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7ae9b-4618-46a2-b9d4-f77d4ae4e16b None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:41.779552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7ae9b-4618-46a2-b9d4-f77d4ae4e16b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:41.779755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7ae9b-4618-46a2-b9d4-f77d4ae4e16b None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:41.781387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 359/712] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:41.786230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48aca8-cef5-48f2-9f11-13dd80db81d3 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:41.786514 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48aca8-cef5-48f2-9f11-13dd80db81d3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:41.786822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48aca8-cef5-48f2-9f11-13dd80db81d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:41.804297 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3e48aca8-cef5-48f2-9f11-13dd80db81d3 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:41.805477 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3e48aca8-cef5-48f2-9f11-13dd80db81d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:41.835867 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2319ab2-3db8-4ccc-ba11-d990ae27b863 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:41.910788 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d8333-3ce1-4c27-b4a1-d56e95b73802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:41.911594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d8333-3ce1-4c27-b4a1-d56e95b73802 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:41.911876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d8333-3ce1-4c27-b4a1-d56e95b73802 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:41.912152 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d8333-3ce1-4c27-b4a1-d56e95b73802 None admin] PATH_INFO: `/v3/services/network` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:41.912814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d8333-3ce1-4c27-b4a1-d56e95b73802 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:41.914235 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d8333-3ce1-4c27-b4a1-d56e95b73802 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:41.928267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 360/713] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:41.937427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c41d8333-3ce1-4c27-b4a1-d56e95b73802 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 21:48:41.937427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:41.937427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:48:41.937427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:48:41.937427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:48:41.937427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:48:41.937427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:48:41.937427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:41.937427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 21:48:41.937427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:41.937427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:48:41.937427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:41.937427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:41.937427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:41.937427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:41.937427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:41.937427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:41.938479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:41.938479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:41.938479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:41.938479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:41.938479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:41.938479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:41.938479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:48:41.938479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:48:41.938479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:48:41.938479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:48:41.938479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:41.938479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:41.938479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:41.938479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:41.938479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:41.938479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:41.940017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:41.940017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:41.940017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:41.940017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:41.940017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:41.940017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:41.940017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:41.940017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:41.940017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:41.940017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:41.940017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:48:41.940017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:41.940017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 21:48:41.940017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:41.940017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 354/714] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:41 2022] GET /identity/v3/services/network => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:41.944938 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48aca8-cef5-48f2-9f11-13dd80db81d3 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:41.957197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d8333-3ce1-4c27-b4a1-d56e95b73802 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:41.973281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:42.111443 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48aca8-cef5-48f2-9f11-13dd80db81d3 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:42.141166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:42.145956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d8333-3ce1-4c27-b4a1-d56e95b73802 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:42.155793 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3a5be-8518-42bc-bbc6-db52bf5e83f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:42.156458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3a5be-8518-42bc-bbc6-db52bf5e83f3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:42.156736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3a5be-8518-42bc-bbc6-db52bf5e83f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:42.157008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3a5be-8518-42bc-bbc6-db52bf5e83f3 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:42.157713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3a5be-8518-42bc-bbc6-db52bf5e83f3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:42.158037 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3a5be-8518-42bc-bbc6-db52bf5e83f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:42.159414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3a5be-8518-42bc-bbc6-db52bf5e83f3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:42.164492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 361/715] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 7 21:48:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:42.172244 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3a5be-8518-42bc-bbc6-db52bf5e83f3 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:42.196927 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f67a0-2835-42be-b72a-ff2b2c555feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:42.199565 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f67a0-2835-42be-b72a-ff2b2c555feb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:42.201360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f67a0-2835-42be-b72a-ff2b2c555feb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:42.201867 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f67a0-2835-42be-b72a-ff2b2c555feb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:42.202768 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f67a0-2835-42be-b72a-ff2b2c555feb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:42.205609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f67a0-2835-42be-b72a-ff2b2c555feb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:42.224781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-072f67a0-2835-42be-b72a-ff2b2c555feb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 21:48:42.224781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:42.224781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:48:42.224781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:48:42.224781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:48:42.224781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:48:42.224781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:48:42.224781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:42.224781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 21:48:42.224781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:42.224781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:48:42.224781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:42.224781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:42.224781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:42.224781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:42.224781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:42.226123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:42.226123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:42.226123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:42.226123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:42.226123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:42.226123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:42.226123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:42.226123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:48:42.226123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:48:42.226123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:48:42.226123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:48:42.226123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:42.226123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:42.226123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:42.226123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:42.226123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:42.226985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:42.226985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:42.226985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:42.226985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:42.226985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:42.226985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:42.226985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:42.226985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:42.226985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:42.226985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:42.226985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:42.226985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:48:42.226985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:42.226985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 21:48:42.226985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:42.230654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 355/716] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Jun 7 21:48:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:42.238872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f67a0-2835-42be-b72a-ff2b2c555feb None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:42.300135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:42.337900 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3a5be-8518-42bc-bbc6-db52bf5e83f3 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:42.416079 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbac1f-e2b8-4b58-97fa-90627ef9eee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:42.418437 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbac1f-e2b8-4b58-97fa-90627ef9eee7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:42.418928 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbac1f-e2b8-4b58-97fa-90627ef9eee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:42.419457 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbac1f-e2b8-4b58-97fa-90627ef9eee7 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:42.421351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbac1f-e2b8-4b58-97fa-90627ef9eee7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:42.422180 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbac1f-e2b8-4b58-97fa-90627ef9eee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:42.424442 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbac1f-e2b8-4b58-97fa-90627ef9eee7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:42.436747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 362/717] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 7 21:48:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:42.449353 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f67a0-2835-42be-b72a-ff2b2c555feb None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:42.489190 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d370ca-2182-46df-ae32-d68143a6890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:42.490336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d370ca-2182-46df-ae32-d68143a6890a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:42.490829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d370ca-2182-46df-ae32-d68143a6890a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:42.491359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d370ca-2182-46df-ae32-d68143a6890a None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:42.492312 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d370ca-2182-46df-ae32-d68143a6890a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:42.492831 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d370ca-2182-46df-ae32-d68143a6890a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:42.494518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d370ca-2182-46df-ae32-d68143a6890a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:42.500600 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 356/718] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jun 7 21:48:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:42.511234 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbac1f-e2b8-4b58-97fa-90627ef9eee7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:42.657690 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbac1f-e2b8-4b58-97fa-90627ef9eee7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:42.693213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073110c-6495-47df-a20f-e610f73a78fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:42.694256 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073110c-6495-47df-a20f-e610f73a78fe None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:42.694783 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073110c-6495-47df-a20f-e610f73a78fe None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:42.695259 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073110c-6495-47df-a20f-e610f73a78fe None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:42.696246 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073110c-6495-47df-a20f-e610f73a78fe None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:42.697290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073110c-6495-47df-a20f-e610f73a78fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:42.698932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073110c-6495-47df-a20f-e610f73a78fe None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:42.704227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 363/719] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jun 7 21:48:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:43.075053 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fc4a6-ae13-41cc-9443-3ec3f3219fe7 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:43.075438 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fc4a6-ae13-41cc-9443-3ec3f3219fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:43.075626 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fc4a6-ae13-41cc-9443-3ec3f3219fe7 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:43.077241 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 357/720] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:43.082279 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ae13c-dc55-4f05-90c5-f5ece51765c7 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:43.082568 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ae13c-dc55-4f05-90c5-f5ece51765c7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:43.082847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ae13c-dc55-4f05-90c5-f5ece51765c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:43.101238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ca2ae13c-dc55-4f05-90c5-f5ece51765c7 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:43.102455 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ca2ae13c-dc55-4f05-90c5-f5ece51765c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:43.105017 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:43.195469 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 364/721] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:43.218746 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fc4a6-ae13-41cc-9443-3ec3f3219fe7 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:43.248334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:43.332791 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fc4a6-ae13-41cc-9443-3ec3f3219fe7 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:43.383047 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be037a-6c00-4c4f-8c29-98afd6b35673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:43.383846 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be037a-6c00-4c4f-8c29-98afd6b35673 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:43.384179 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be037a-6c00-4c4f-8c29-98afd6b35673 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:43.384449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be037a-6c00-4c4f-8c29-98afd6b35673 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:43.400928 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be037a-6c00-4c4f-8c29-98afd6b35673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:43.408571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-b8be037a-6c00-4c4f-8c29-98afd6b35673 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:43.408571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:43.408571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:43.408571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:43.408571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:43.408571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:43.408571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:43.408571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:43.408571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:43.408571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:43.408571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:43.408571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:43.408571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:43.408571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:43.408571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:43.408571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:43.409538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:43.409538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:43.409538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:43.409538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:43.409538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:43.409538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:43.409538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:43.409538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:43.409538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:43.409538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:43.409538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:43.409538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:43.409538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:43.409538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:43.409538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:43.409538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:43.411030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:43.411030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:43.411030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:43.411030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:43.411030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:43.411030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:43.411030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:43.411030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:43.411030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:43.411030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:43.411030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:43.411030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:43.411030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 358/722] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:48:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:43.419027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ae13c-dc55-4f05-90c5-f5ece51765c7 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:43.537617 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ae13c-dc55-4f05-90c5-f5ece51765c7 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:43.587706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992b974-7ab2-404d-a26e-79bad3e171a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:43.588361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992b974-7ab2-404d-a26e-79bad3e171a1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:43.588670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992b974-7ab2-404d-a26e-79bad3e171a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:43.588944 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992b974-7ab2-404d-a26e-79bad3e171a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:43.589687 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992b974-7ab2-404d-a26e-79bad3e171a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:43.590008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992b974-7ab2-404d-a26e-79bad3e171a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:43.591388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992b974-7ab2-404d-a26e-79bad3e171a1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:43.602459 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:43.608667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 365/723] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:43.614327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be037a-6c00-4c4f-8c29-98afd6b35673 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:43.746903 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:43.759161 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be037a-6c00-4c4f-8c29-98afd6b35673 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:43.802637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2add70-0c00-4b51-a086-0f005495b115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:43.803438 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2add70-0c00-4b51-a086-0f005495b115 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:43.803713 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2add70-0c00-4b51-a086-0f005495b115 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:43.803984 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2add70-0c00-4b51-a086-0f005495b115 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:43.819255 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2add70-0c00-4b51-a086-0f005495b115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:43.820692 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2add70-0c00-4b51-a086-0f005495b115 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:43.842454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-7c2add70-0c00-4b51-a086-0f005495b115 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:43.842454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:43.842454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:43.842454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:43.842454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:43.842454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:43.842454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:43.842454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:43.842454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:43.842454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:43.842454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:43.842454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:43.842454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:43.842454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:43.842454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:43.843347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:43.843347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:43.843347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:43.843347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:43.843347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:43.843347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:43.843347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:43.843347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:43.843347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:43.843347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:43.843347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:43.843347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:43.843347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:43.843347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:43.843347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:43.843347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:43.843347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:43.844298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:43.844298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:43.844298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:43.844298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:43.844298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 359/724] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:43.850573 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992b974-7ab2-404d-a26e-79bad3e171a1 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:44.009483 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992b974-7ab2-404d-a26e-79bad3e171a1 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:44.044526 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905f33a-16c9-489a-9da1-5c2eaa7baf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:44.045414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905f33a-16c9-489a-9da1-5c2eaa7baf3e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:44.045835 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905f33a-16c9-489a-9da1-5c2eaa7baf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:44.046271 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905f33a-16c9-489a-9da1-5c2eaa7baf3e None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:44.047148 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905f33a-16c9-489a-9da1-5c2eaa7baf3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:44.047591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905f33a-16c9-489a-9da1-5c2eaa7baf3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:44.049075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905f33a-16c9-489a-9da1-5c2eaa7baf3e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:44.061737 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 366/725] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:44.067224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2add70-0c00-4b51-a086-0f005495b115 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:44.175234 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631da04-c93b-413b-b885-c4badae1a377 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:44.175826 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631da04-c93b-413b-b885-c4badae1a377 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:44.176425 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631da04-c93b-413b-b885-c4badae1a377 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:44.182062 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 367/726] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:44.187408 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dabb2-19bd-408c-a3ad-7bbf04d30996 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:44.188026 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dabb2-19bd-408c-a3ad-7bbf04d30996 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:44.188740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dabb2-19bd-408c-a3ad-7bbf04d30996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:44.195893 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2add70-0c00-4b51-a086-0f005495b115 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:44.236217 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-420dabb2-19bd-408c-a3ad-7bbf04d30996 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:44.238204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-420dabb2-19bd-408c-a3ad-7bbf04d30996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:44.298899 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b922ee-ba85-4ed4-9d88-fcb1fc2d2405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:44.300466 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b922ee-ba85-4ed4-9d88-fcb1fc2d2405 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:44.300947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b922ee-ba85-4ed4-9d88-fcb1fc2d2405 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:44.301465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b922ee-ba85-4ed4-9d88-fcb1fc2d2405 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:44.322695 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b922ee-ba85-4ed4-9d88-fcb1fc2d2405 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:44.324211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b922ee-ba85-4ed4-9d88-fcb1fc2d2405 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:44.331006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:44.362382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:44.365995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-87b922ee-ba85-4ed4-9d88-fcb1fc2d2405 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 21:48:44.365995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:44.365995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:44.365995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:44.365995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:44.365995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:44.365995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:44.365995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:44.365995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:44.365995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:44.365995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:44.365995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:44.365995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:44.365995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:44.365995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:44.365995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:44.366916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:44.367947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:44.367947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:44.367947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:44.367947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:44.367947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:44.367947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:44.367947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:44.367947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:44.367947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 21:48:44.367947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:44.369689 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 360/727] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:48:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:44.372033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a9aff-e7d2-498f-9097-f33f4b457b6d None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:44.372328 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a9aff-e7d2-498f-9097-f33f4b457b6d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:44.372605 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a9aff-e7d2-498f-9097-f33f4b457b6d None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:44.374016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 361/728] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:44.377883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a9aff-e7d2-498f-9097-f33f4b457b6d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:44.390127 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 368/729] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 21:48:44.391686 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e3403-e8e4-478c-ab7f-802d18b8be84 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:44.391981 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e3403-e8e4-478c-ab7f-802d18b8be84 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:44.392262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e3403-e8e4-478c-ab7f-802d18b8be84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:44.425656 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-323e3403-e8e4-478c-ab7f-802d18b8be84 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:44.426776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-323e3403-e8e4-478c-ab7f-802d18b8be84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:44.498133 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a9aff-e7d2-498f-9097-f33f4b457b6d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:44.514003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 369/730] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:44.515252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e3403-e8e4-478c-ab7f-802d18b8be84 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:44.557366 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf8b99-e187-4586-acef-2dc8cbb8011d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:44.558080 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf8b99-e187-4586-acef-2dc8cbb8011d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:44.558360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf8b99-e187-4586-acef-2dc8cbb8011d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:44.558631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf8b99-e187-4586-acef-2dc8cbb8011d None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:44.559751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf8b99-e187-4586-acef-2dc8cbb8011d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:44.560059 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf8b99-e187-4586-acef-2dc8cbb8011d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:44.562225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf8b99-e187-4586-acef-2dc8cbb8011d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:44.587874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 362/731] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jun 7 21:48:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:44.589186 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf8b99-e187-4586-acef-2dc8cbb8011d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:44.642552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e3403-e8e4-478c-ab7f-802d18b8be84 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:44.668545 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:44.670151 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:44.685786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53cb02-7847-4818-865a-5c4425121d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:44.687119 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53cb02-7847-4818-865a-5c4425121d5a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:44.687604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53cb02-7847-4818-865a-5c4425121d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:44.688079 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53cb02-7847-4818-865a-5c4425121d5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:44.699561 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53cb02-7847-4818-865a-5c4425121d5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:44.708063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-aa53cb02-7847-4818-865a-5c4425121d5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:44.708063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:44.708063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:44.708063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:44.708063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:44.708063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:44.708063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:44.708063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:44.708063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:44.708063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:44.708063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:44.708063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:44.708063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:44.708063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:44.708063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:44.708063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:44.708976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:44.708976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:44.708976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:44.708976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:44.708976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:44.708976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:44.708976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:44.708976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:44.708976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:44.708976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:44.708976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:44.708976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:44.708976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:44.708976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:44.708976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:44.708976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:44.709806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:44.709806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:44.709806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:44.709806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:44.709806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:44.709806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:44.709806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:44.709806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:44.709806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:44.709806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:44.709806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:44.709806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:44.717802 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 370/732] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:44.718157 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf8b99-e187-4586-acef-2dc8cbb8011d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:44.719192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53cb02-7847-4818-865a-5c4425121d5a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:44.766451 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d5656-1fdd-4921-9e3a-ba82dafa7129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:44.767749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d5656-1fdd-4921-9e3a-ba82dafa7129 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:44.768035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d5656-1fdd-4921-9e3a-ba82dafa7129 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:44.768316 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d5656-1fdd-4921-9e3a-ba82dafa7129 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:44.781881 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d5656-1fdd-4921-9e3a-ba82dafa7129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:44.792974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-478d5656-1fdd-4921-9e3a-ba82dafa7129 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:44.792974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:44.792974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:44.792974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:44.792974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:44.792974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:44.792974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:44.792974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:44.792974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:44.792974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:44.792974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:44.792974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:44.792974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:44.792974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:44.792974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:44.792974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:44.793920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:44.793920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:44.793920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:44.793920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:44.793920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:44.793920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:44.793920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:44.793920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:44.793920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:44.793920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:44.793920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:44.793920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:44.793920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:44.793920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:44.793920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:44.793920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:44.794780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:44.794780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:44.794780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:44.794780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:44.794780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:44.794780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:44.794780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:44.794780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:44.794780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:44.794780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:44.794780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:44.794780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:44.797995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 363/733] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:48:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:44.799438 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d5656-1fdd-4921-9e3a-ba82dafa7129 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:44.847285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53cb02-7847-4818-865a-5c4425121d5a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:44.891459 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada72de-8a6d-4ad8-8163-5c4149162632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:44.892130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada72de-8a6d-4ad8-8163-5c4149162632 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:44.892408 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada72de-8a6d-4ad8-8163-5c4149162632 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:44.892680 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada72de-8a6d-4ad8-8163-5c4149162632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:44.913740 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d5656-1fdd-4921-9e3a-ba82dafa7129 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:44.932855 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:44.953212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063cd84-4f8f-4c0c-8521-fcd7e278f6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:44.954361 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063cd84-4f8f-4c0c-8521-fcd7e278f6ac None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:44.954970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063cd84-4f8f-4c0c-8521-fcd7e278f6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:44.955488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063cd84-4f8f-4c0c-8521-fcd7e278f6ac None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:44.955847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:44.956992 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063cd84-4f8f-4c0c-8521-fcd7e278f6ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:44.957579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063cd84-4f8f-4c0c-8521-fcd7e278f6ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:44.959266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063cd84-4f8f-4c0c-8521-fcd7e278f6ac None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:44.973716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 364/734] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:44.975003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063cd84-4f8f-4c0c-8521-fcd7e278f6ac None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:44.982191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada72de-8a6d-4ad8-8163-5c4149162632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:44.983670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada72de-8a6d-4ad8-8163-5c4149162632 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:45.087839 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063cd84-4f8f-4c0c-8521-fcd7e278f6ac None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:45.111071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 371/735] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 21:48:45.111952 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada72de-8a6d-4ad8-8163-5c4149162632 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:45.130002 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b7e29-6432-4c24-bcbb-e58a71cd0856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:45.131013 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b7e29-6432-4c24-bcbb-e58a71cd0856 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:45.131496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b7e29-6432-4c24-bcbb-e58a71cd0856 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:45.131969 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b7e29-6432-4c24-bcbb-e58a71cd0856 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:45.133034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b7e29-6432-4c24-bcbb-e58a71cd0856 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:45.133626 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b7e29-6432-4c24-bcbb-e58a71cd0856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:45.136070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b7e29-6432-4c24-bcbb-e58a71cd0856 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:45.145744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 365/736] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:45.146894 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b7e29-6432-4c24-bcbb-e58a71cd0856 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:45.205320 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:45.217896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:45.243721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada72de-8a6d-4ad8-8163-5c4149162632 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:45.273138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b7e29-6432-4c24-bcbb-e58a71cd0856 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:45.278787 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed220ff9-1b90-41c2-966c-20a3dfae1f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:45.279571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed220ff9-1b90-41c2-966c-20a3dfae1f4d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:45.279856 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed220ff9-1b90-41c2-966c-20a3dfae1f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:45.280131 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed220ff9-1b90-41c2-966c-20a3dfae1f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:45.291052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed220ff9-1b90-41c2-966c-20a3dfae1f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:45.292545 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed220ff9-1b90-41c2-966c-20a3dfae1f4d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:45.309120 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add9056-3b24-4114-8bdb-8078bb01a69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:45.309908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add9056-3b24-4114-8bdb-8078bb01a69a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:45.310228 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add9056-3b24-4114-8bdb-8078bb01a69a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:45.310499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add9056-3b24-4114-8bdb-8078bb01a69a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:45.310896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-ed220ff9-1b90-41c2-966c-20a3dfae1f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:45.310896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:45.310896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:45.310896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:45.310896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:45.310896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:45.310896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:45.310896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:45.310896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:45.310896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:45.310896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:45.310896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:45.310896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:45.310896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:45.310896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:45.311728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:45.311728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:45.311728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:45.311728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:45.311728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:45.311728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:45.311728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:45.311728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:45.311728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:45.311728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:45.311728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:45.311728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:45.311728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:45.311728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:45.311728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:45.311728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:45.311728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:45.312590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:45.312590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:45.312590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:45.312590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:45.312815 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 372/737] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:45.313456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed220ff9-1b90-41c2-966c-20a3dfae1f4d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:45.325968 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add9056-3b24-4114-8bdb-8078bb01a69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:45.327414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add9056-3b24-4114-8bdb-8078bb01a69a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:45.344714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-0add9056-3b24-4114-8bdb-8078bb01a69a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:45.344714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:45.344714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:45.344714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:45.344714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:45.344714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:45.344714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:45.344714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:45.344714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:45.344714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:45.344714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:45.344714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:45.344714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:45.344714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:45.344714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:45.345744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:45.345744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:45.345744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:45.345744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:45.345744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:45.345744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:45.345744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:45.345744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:45.345744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:45.345744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:45.345744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:45.345744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:45.345744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:45.345744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:45.345744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:45.345744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:45.345744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:45.354907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:45.354907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:45.354907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:45.354907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:45.354907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 366/738] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:45.354907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cd763-53a6-4679-8985-5cc3f679ffa9 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:45.354907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cd763-53a6-4679-8985-5cc3f679ffa9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:45.354907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cd763-53a6-4679-8985-5cc3f679ffa9 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:45.354907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 367/739] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:45.355425 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cd763-53a6-4679-8985-5cc3f679ffa9 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:45.430012 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed220ff9-1b90-41c2-966c-20a3dfae1f4d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:45.460275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:45.461178 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:45.466788 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0f0c8-a3c8-4203-b3ee-f9cf5d3143a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:45.467535 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0f0c8-a3c8-4203-b3ee-f9cf5d3143a2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:45.467813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0f0c8-a3c8-4203-b3ee-f9cf5d3143a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:45.468036 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0f0c8-a3c8-4203-b3ee-f9cf5d3143a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:45.470830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cd763-53a6-4679-8985-5cc3f679ffa9 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:45.480148 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0f0c8-a3c8-4203-b3ee-f9cf5d3143a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:45.481595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0f0c8-a3c8-4203-b3ee-f9cf5d3143a2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:45.499547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-46b0f0c8-a3c8-4203-b3ee-f9cf5d3143a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:45.499547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:45.499547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:45.499547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:45.499547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:45.499547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:45.499547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:45.499547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:45.499547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:45.499547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:45.499547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:45.499547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:45.499547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:45.499547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:45.499547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:45.500474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:45.500474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:45.500474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:45.500474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:45.500474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:45.500474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:45.500474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:45.500474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:45.500474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:45.500474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:45.500474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:45.500474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:45.500474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:45.500474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:45.500474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:45.500474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:45.500474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:45.501345 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:45.501345 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:45.501345 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:45.501345 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:45.501345 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 373/740] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:45.501638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0f0c8-a3c8-4203-b3ee-f9cf5d3143a2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:45.517510 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531958c-30fc-4dc2-b227-c2e4f1c99270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:45.518591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531958c-30fc-4dc2-b227-c2e4f1c99270 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:45.518871 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531958c-30fc-4dc2-b227-c2e4f1c99270 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:45.519409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531958c-30fc-4dc2-b227-c2e4f1c99270 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:45.520149 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531958c-30fc-4dc2-b227-c2e4f1c99270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:45.520604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531958c-30fc-4dc2-b227-c2e4f1c99270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:45.522314 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531958c-30fc-4dc2-b227-c2e4f1c99270 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:45.539283 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 368/741] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:45.541261 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf00430-7097-400c-b275-5ffd962b8e9f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:45.541554 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf00430-7097-400c-b275-5ffd962b8e9f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:45.541831 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf00430-7097-400c-b275-5ffd962b8e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:45.558441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-bbf00430-7097-400c-b275-5ffd962b8e9f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:45.559604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bbf00430-7097-400c-b275-5ffd962b8e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:45.604170 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0f0c8-a3c8-4203-b3ee-f9cf5d3143a2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:45.624903 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 369/742] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:45.625719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf00430-7097-400c-b275-5ffd962b8e9f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:45.637510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a68ab8-1f41-4ddf-a2a3-86585284ab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:45.638189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a68ab8-1f41-4ddf-a2a3-86585284ab3f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:45.638472 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a68ab8-1f41-4ddf-a2a3-86585284ab3f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:45.638749 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a68ab8-1f41-4ddf-a2a3-86585284ab3f None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:45.639459 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a68ab8-1f41-4ddf-a2a3-86585284ab3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:45.639763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a68ab8-1f41-4ddf-a2a3-86585284ab3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:45.641127 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a68ab8-1f41-4ddf-a2a3-86585284ab3f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:45.658596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 374/743] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:45.658596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a68ab8-1f41-4ddf-a2a3-86585284ab3f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:45.700244 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:45.725778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:45.741306 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf00430-7097-400c-b275-5ffd962b8e9f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:45.753184 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a68ab8-1f41-4ddf-a2a3-86585284ab3f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:45.775008 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea966754-ff1f-43fa-8e59-de0ed79c2946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:45.775660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea966754-ff1f-43fa-8e59-de0ed79c2946 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:45.776198 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea966754-ff1f-43fa-8e59-de0ed79c2946 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:45.776198 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea966754-ff1f-43fa-8e59-de0ed79c2946 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:45.776919 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea966754-ff1f-43fa-8e59-de0ed79c2946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:45.777226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea966754-ff1f-43fa-8e59-de0ed79c2946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:45.778645 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea966754-ff1f-43fa-8e59-de0ed79c2946 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:45.786184 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727700b8-cfaa-4032-8027-962ced68decd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:45.786962 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727700b8-cfaa-4032-8027-962ced68decd None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:45.787245 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727700b8-cfaa-4032-8027-962ced68decd None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:45.787510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727700b8-cfaa-4032-8027-962ced68decd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:45.791456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 370/744] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:45.792686 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cdfa4-f391-4c4d-9569-aa99f77a94bf None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:45.792975 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cdfa4-f391-4c4d-9569-aa99f77a94bf None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:45.793250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cdfa4-f391-4c4d-9569-aa99f77a94bf None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:45.795007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 371/745] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:45.795110 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727700b8-cfaa-4032-8027-962ced68decd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:45.796382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727700b8-cfaa-4032-8027-962ced68decd None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:45.798616 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cdfa4-f391-4c4d-9569-aa99f77a94bf None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:45.812978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-727700b8-cfaa-4032-8027-962ced68decd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 21:48:45.812978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:45.812978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:45.812978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:45.812978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:45.812978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:45.812978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:45.812978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:45.812978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:45.812978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:45.812978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:45.812978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:45.812978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:45.812978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:45.812978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:45.812978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:45.813993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:45.815388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:45.815388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:45.815388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:45.815388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:45.815388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:45.815388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:45.815388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:45.815388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:45.815388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 21:48:45.815388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:45.815388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 375/746] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 7 21:48:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:45.815388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727700b8-cfaa-4032-8027-962ced68decd None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:45.900693 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cdfa4-f391-4c4d-9569-aa99f77a94bf None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:45.911622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727700b8-cfaa-4032-8027-962ced68decd None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:45.913848 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:45.934533 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc4d3d-ca83-47c7-9a54-ea12e990a0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:45.935185 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc4d3d-ca83-47c7-9a54-ea12e990a0e3 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:45.935465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc4d3d-ca83-47c7-9a54-ea12e990a0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:45.935742 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc4d3d-ca83-47c7-9a54-ea12e990a0e3 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:45.936486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc4d3d-ca83-47c7-9a54-ea12e990a0e3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:45.937850 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc4d3d-ca83-47c7-9a54-ea12e990a0e3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:45.946930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a66e7-6374-4ef4-8bd9-27757982073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:45.947716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a66e7-6374-4ef4-8bd9-27757982073f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:45.948001 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a66e7-6374-4ef4-8bd9-27757982073f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:45.948279 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a66e7-6374-4ef4-8bd9-27757982073f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:45.952137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 372/747] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 7 21:48:45 2022] POST /identity/v3/services => generated 240 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:48:45.952924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc4d3d-ca83-47c7-9a54-ea12e990a0e3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:45.956283 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:45.962608 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a66e7-6374-4ef4-8bd9-27757982073f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:45.964090 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a66e7-6374-4ef4-8bd9-27757982073f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:45.981844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-854a66e7-6374-4ef4-8bd9-27757982073f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:45.981844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:45.981844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:45.981844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:45.981844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:45.981844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:45.981844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:45.981844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:45.981844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:45.981844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:45.981844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:45.981844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:45.981844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:45.981844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:45.981844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:45.982974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:45.982974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:45.982974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:45.982974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:45.982974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:45.982974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:45.982974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:45.982974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:45.982974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:45.982974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:45.982974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:45.982974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:45.982974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:45.982974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:45.982974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:45.982974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:45.982974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:45.983907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:45.983907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:45.983907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:45.983907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:45.983907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:45.983907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:45.983907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:45.983907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:45.983907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 376/748] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:45.984658 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3eb5f-c8bf-407b-a840-0fa93c631e47 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:45.984939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3eb5f-c8bf-407b-a840-0fa93c631e47 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:45.985212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3eb5f-c8bf-407b-a840-0fa93c631e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:46.005570 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b5d3eb5f-c8bf-407b-a840-0fa93c631e47 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:46.006999 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b5d3eb5f-c8bf-407b-a840-0fa93c631e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:46.083743 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc4d3d-ca83-47c7-9a54-ea12e990a0e3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:46.096669 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 377/749] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:45 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 21:48:46.097709 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3eb5f-c8bf-407b-a840-0fa93c631e47 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:46.125509 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6469e43-550d-4cf2-99cf-0108957ec0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:46.126535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6469e43-550d-4cf2-99cf-0108957ec0bb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:46.126917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6469e43-550d-4cf2-99cf-0108957ec0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:46.127299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6469e43-550d-4cf2-99cf-0108957ec0bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:46.136287 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6469e43-550d-4cf2-99cf-0108957ec0bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:46.137902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6469e43-550d-4cf2-99cf-0108957ec0bb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:46.153413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-f6469e43-550d-4cf2-99cf-0108957ec0bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:48:46.153413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:46.153413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:46.153413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:46.153413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:46.153413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:46.153413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:46.153413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:46.153413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:46.153413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:46.153413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:46.153413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:46.153413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:46.153413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:46.153413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:46.153413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:46.154654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:46.155719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:46.155719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:46.155719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:46.155719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:46.155719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:46.155719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:46.155719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:46.155719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:46.155719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:48:46.155719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:46.155719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 373/750] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 7 21:48:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:46.156422 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6469e43-550d-4cf2-99cf-0108957ec0bb None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:46.212916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:46.223482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3eb5f-c8bf-407b-a840-0fa93c631e47 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:46.224583 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:46.261491 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f950c94-4dbb-4982-8412-1e19e67cf708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:46.262272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f950c94-4dbb-4982-8412-1e19e67cf708 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:46.262555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f950c94-4dbb-4982-8412-1e19e67cf708 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:46.262829 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f950c94-4dbb-4982-8412-1e19e67cf708 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:46.263668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f950c94-4dbb-4982-8412-1e19e67cf708 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:46.263975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f950c94-4dbb-4982-8412-1e19e67cf708 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:46.265656 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f950c94-4dbb-4982-8412-1e19e67cf708 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:46.267921 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6469e43-550d-4cf2-99cf-0108957ec0bb None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:46.290174 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 378/751] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jun 7 21:48:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:46.290174 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f950c94-4dbb-4982-8412-1e19e67cf708 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:46.305295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464bd15-463b-481d-9a85-beb8be576589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:46.306020 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464bd15-463b-481d-9a85-beb8be576589 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:46.306307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464bd15-463b-481d-9a85-beb8be576589 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:46.306583 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464bd15-463b-481d-9a85-beb8be576589 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:46.307376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464bd15-463b-481d-9a85-beb8be576589 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:46.307681 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464bd15-463b-481d-9a85-beb8be576589 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:46.309168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464bd15-463b-481d-9a85-beb8be576589 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:46.322656 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 374/752] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:46.323484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464bd15-463b-481d-9a85-beb8be576589 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:46.404736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f950c94-4dbb-4982-8412-1e19e67cf708 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:46.434481 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464bd15-463b-481d-9a85-beb8be576589 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:46.440567 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8bee7-5857-4a59-b0fc-2f237a4a177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:46.441238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8bee7-5857-4a59-b0fc-2f237a4a177b None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:46.441518 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8bee7-5857-4a59-b0fc-2f237a4a177b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:46.442225 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8bee7-5857-4a59-b0fc-2f237a4a177b None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:46.442953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8bee7-5857-4a59-b0fc-2f237a4a177b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:46.444685 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8bee7-5857-4a59-b0fc-2f237a4a177b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:46.456374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:46.462088 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 379/753] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 7 21:48:46 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:48:46.462998 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8bee7-5857-4a59-b0fc-2f237a4a177b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:46.475557 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:46.493458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231aecc-cbca-4a8c-9bf1-6a197b1ca725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:46.494776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231aecc-cbca-4a8c-9bf1-6a197b1ca725 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:46.495216 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231aecc-cbca-4a8c-9bf1-6a197b1ca725 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:46.495858 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231aecc-cbca-4a8c-9bf1-6a197b1ca725 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:46.496757 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231aecc-cbca-4a8c-9bf1-6a197b1ca725 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:46.497549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231aecc-cbca-4a8c-9bf1-6a197b1ca725 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:46.499450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231aecc-cbca-4a8c-9bf1-6a197b1ca725 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:46.531178 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 375/754] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 7 21:48:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:46.531178 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231aecc-cbca-4a8c-9bf1-6a197b1ca725 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:46.597813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8bee7-5857-4a59-b0fc-2f237a4a177b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:46.649257 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cae5f5-8a96-4c8a-b17e-b01766c2f128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:46.650013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cae5f5-8a96-4c8a-b17e-b01766c2f128 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:46.650299 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cae5f5-8a96-4c8a-b17e-b01766c2f128 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:46.650576 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cae5f5-8a96-4c8a-b17e-b01766c2f128 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:46.650953 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231aecc-cbca-4a8c-9bf1-6a197b1ca725 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:46.697242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb88037-3192-4f2c-a153-53d715fd10b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:46.698723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb88037-3192-4f2c-a153-53d715fd10b8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:46.698723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb88037-3192-4f2c-a153-53d715fd10b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:46.698723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb88037-3192-4f2c-a153-53d715fd10b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:46.699730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb88037-3192-4f2c-a153-53d715fd10b8 None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=a4b69c708fbc470aae3e3954e21a1e88) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:46.700143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb88037-3192-4f2c-a153-53d715fd10b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:46.702605 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb88037-3192-4f2c-a153-53d715fd10b8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:46.709527 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 376/755] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:48:46 2022] GET /identity/v3/role_assignments?user.id=a4b69c708fbc470aae3e3954e21a1e88&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=8f58ef9d28494d97a68de20b84355450 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:46.714864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb88037-3192-4f2c-a153-53d715fd10b8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:46.737168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cae5f5-8a96-4c8a-b17e-b01766c2f128 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:46.739005 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cae5f5-8a96-4c8a-b17e-b01766c2f128 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:46.752858 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:46.775364 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:46.855593 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb88037-3192-4f2c-a153-53d715fd10b8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:46.904326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f01bdc-afc0-4bd8-9733-9c8803b236bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:46.905144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f01bdc-afc0-4bd8-9733-9c8803b236bd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:46.905424 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f01bdc-afc0-4bd8-9733-9c8803b236bd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:46.905695 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f01bdc-afc0-4bd8-9733-9c8803b236bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:46.925389 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 380/756] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:48:46.926534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f01bdc-afc0-4bd8-9733-9c8803b236bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:46.928063 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f01bdc-afc0-4bd8-9733-9c8803b236bd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:46.932814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cae5f5-8a96-4c8a-b17e-b01766c2f128 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:46.952449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-70f01bdc-afc0-4bd8-9733-9c8803b236bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:46.952449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:46.952449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:46.952449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:46.952449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:46.952449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:46.952449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:46.952449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:46.952449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:46.952449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:46.952449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:46.952449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:46.952449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:46.952449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:46.952449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:46.953618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:46.953618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:46.953618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:46.953618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:46.953618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:46.953618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:46.953618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:46.953618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:46.953618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:46.953618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:46.953618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:46.953618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:46.953618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:46.953618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:46.953618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:46.953618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:46.953618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:46.954756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:46.954756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:46.954756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:46.954756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:46.961159 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 377/757] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:46.963132 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f01bdc-afc0-4bd8-9733-9c8803b236bd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:47.061554 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:47.071222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cae5f5-8a96-4c8a-b17e-b01766c2f128 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:47.072554 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f01bdc-afc0-4bd8-9733-9c8803b236bd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:47.092761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:47.116268 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e95c3-424e-4815-a1ab-59cb7f719220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:47.117182 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e95c3-424e-4815-a1ab-59cb7f719220 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:47.117615 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e95c3-424e-4815-a1ab-59cb7f719220 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:47.118057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e95c3-424e-4815-a1ab-59cb7f719220 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:47.119483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e95c3-424e-4815-a1ab-59cb7f719220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:47.120683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e95c3-424e-4815-a1ab-59cb7f719220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:47.122253 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e95c3-424e-4815-a1ab-59cb7f719220 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:47.144493 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 378/758] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:47.146560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065b165-9bc3-40a0-9efb-b6b4d1631539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:47.147540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065b165-9bc3-40a0-9efb-b6b4d1631539 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:47.147971 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065b165-9bc3-40a0-9efb-b6b4d1631539 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:47.148415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065b165-9bc3-40a0-9efb-b6b4d1631539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:47.156649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e95c3-424e-4815-a1ab-59cb7f719220 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:47.169269 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065b165-9bc3-40a0-9efb-b6b4d1631539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:47.170969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065b165-9bc3-40a0-9efb-b6b4d1631539 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:47.195806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-f065b165-9bc3-40a0-9efb-b6b4d1631539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:47.195806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:47.195806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:47.195806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:47.195806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:47.195806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:47.195806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:47.195806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:47.195806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:47.195806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:47.195806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:47.195806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:47.195806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:47.195806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:47.195806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:47.196960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:47.196960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:47.196960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:47.196960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:47.196960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:47.196960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:47.196960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:47.196960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:47.196960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:47.196960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:47.196960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:47.196960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:47.196960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:47.196960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:47.196960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:47.196960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:47.196960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:47.198076 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:47.198076 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:47.198076 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:47.198076 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:47.203431 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 381/759] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:47.205596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065b165-9bc3-40a0-9efb-b6b4d1631539 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:47.341969 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e95c3-424e-4815-a1ab-59cb7f719220 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:47.375187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bc40c-7f43-4176-997e-8922c85dc2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:47.375982 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bc40c-7f43-4176-997e-8922c85dc2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:47.376258 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bc40c-7f43-4176-997e-8922c85dc2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:47.376529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bc40c-7f43-4176-997e-8922c85dc2a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:47.383289 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bc40c-7f43-4176-997e-8922c85dc2a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:47.384777 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bc40c-7f43-4176-997e-8922c85dc2a3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:47.398906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-814bc40c-7f43-4176-997e-8922c85dc2a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:47.398906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:47.398906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:47.398906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:47.398906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:47.398906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:47.398906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:47.398906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:47.398906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:47.398906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:47.398906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:47.398906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:47.398906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:47.398906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:47.398906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:47.399847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:47.399847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:47.399847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:47.399847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:47.399847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:47.399847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:47.399847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:47.399847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:47.399847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:47.399847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:47.399847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:47.399847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:47.399847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:47.399847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:47.399847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:47.399847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:47.399847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:47.400730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:47.400730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:47.400730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:47.400730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:47.400730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:47.400730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:47.400730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:47.400730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:47.400730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 379/760] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:47.405835 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bc40c-7f43-4176-997e-8922c85dc2a3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:47.417267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065b165-9bc3-40a0-9efb-b6b4d1631539 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:47.418955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:47.506854 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bc40c-7f43-4176-997e-8922c85dc2a3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:47.530645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f6f18-2b15-4fac-b58f-116d7f0ee89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:47.531321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f6f18-2b15-4fac-b58f-116d7f0ee89a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:47.531611 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f6f18-2b15-4fac-b58f-116d7f0ee89a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:47.531893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f6f18-2b15-4fac-b58f-116d7f0ee89a None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:47.532633 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f6f18-2b15-4fac-b58f-116d7f0ee89a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:47.532941 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f6f18-2b15-4fac-b58f-116d7f0ee89a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:47.534346 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f6f18-2b15-4fac-b58f-116d7f0ee89a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:47.542917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02207d0b-95e4-4273-80c2-0bc1ec591797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:47.543701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02207d0b-95e4-4273-80c2-0bc1ec591797 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:47.544086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02207d0b-95e4-4273-80c2-0bc1ec591797 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:47.544410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02207d0b-95e4-4273-80c2-0bc1ec591797 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:47.545246 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02207d0b-95e4-4273-80c2-0bc1ec591797 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:47.545550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02207d0b-95e4-4273-80c2-0bc1ec591797 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:47.547043 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02207d0b-95e4-4273-80c2-0bc1ec591797 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:47.559070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 380/761] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:47.560368 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 382/762] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:47.564606 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02207d0b-95e4-4273-80c2-0bc1ec591797 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:47.566020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f6f18-2b15-4fac-b58f-116d7f0ee89a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:47.612049 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:47.698364 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:47.728112 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02207d0b-95e4-4273-80c2-0bc1ec591797 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:47.749575 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f6f18-2b15-4fac-b58f-116d7f0ee89a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:47.784485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dab1e-a05d-421f-91d2-62754c9345cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:47.785291 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dab1e-a05d-421f-91d2-62754c9345cf None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:47.785578 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dab1e-a05d-421f-91d2-62754c9345cf None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:47.785859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dab1e-a05d-421f-91d2-62754c9345cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:47.799146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678dab1e-a05d-421f-91d2-62754c9345cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:47.800581 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678dab1e-a05d-421f-91d2-62754c9345cf None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:47.802439 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f2196-5b32-46c0-bdf1-d88472a82ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:47.803328 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f2196-5b32-46c0-bdf1-d88472a82ef5 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:47.803608 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f2196-5b32-46c0-bdf1-d88472a82ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:47.803884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f2196-5b32-46c0-bdf1-d88472a82ef5 None admin] PATH_INFO: `/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/1d5760a3f9f946978b1251d3e2aaa943/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:47.806994 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f2196-5b32-46c0-bdf1-d88472a82ef5 None admin] RBAC: Authorizing `identity:create_grant(project_id=eca8f481deb242789622ebb10aa2c5da, user_id=1d5760a3f9f946978b1251d3e2aaa943, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:47.808425 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f2196-5b32-46c0-bdf1-d88472a82ef5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:47.830615 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 381/763] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:48:47 2022] PUT /identity/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/1d5760a3f9f946978b1251d3e2aaa943/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 21:48:47.832797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-678dab1e-a05d-421f-91d2-62754c9345cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:47.832797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:47.832797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:47.832797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:47.832797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:47.832797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:47.832797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:47.832797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:47.832797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:47.832797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:47.832797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:47.832797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:47.832797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:47.832797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:47.832797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:47.833695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:47.833695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:47.833695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:47.833695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:47.833695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:47.833695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:47.833695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:47.833695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:47.833695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:47.833695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:47.833695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:47.833695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:47.833695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:47.833695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:47.833695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:47.833695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:47.833695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:47.834622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:47.834622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:47.834622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:47.834622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:47.834622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:47.834622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:47.834622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:47.834622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:47.838097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 383/764] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:47.841103 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f2196-5b32-46c0-bdf1-d88472a82ef5 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:47.997319 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f2196-5b32-46c0-bdf1-d88472a82ef5 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:48.042613 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:48.049125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e1fea-0e1d-48c2-af58-8bf8e02fb094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:48.049773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e1fea-0e1d-48c2-af58-8bf8e02fb094 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:48.050230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e1fea-0e1d-48c2-af58-8bf8e02fb094 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:48.050452 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e1fea-0e1d-48c2-af58-8bf8e02fb094 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:48.051231 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e1fea-0e1d-48c2-af58-8bf8e02fb094 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:48.051553 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e1fea-0e1d-48c2-af58-8bf8e02fb094 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:48.053235 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e1fea-0e1d-48c2-af58-8bf8e02fb094 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:48.066622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 382/765] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:48.072279 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dab1e-a05d-421f-91d2-62754c9345cf None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:48.184574 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:48.214291 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dab1e-a05d-421f-91d2-62754c9345cf None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:48.257484 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f8111-ad53-4e12-b88c-cdab9f75a4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:48.258112 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f8111-ad53-4e12-b88c-cdab9f75a4ec None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:48.258400 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f8111-ad53-4e12-b88c-cdab9f75a4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:48.258680 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f8111-ad53-4e12-b88c-cdab9f75a4ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:48.259559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f8111-ad53-4e12-b88c-cdab9f75a4ec None admin] RBAC: Adding query filter params (role.id=382652f08fc24ce39f91164181237006, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=4fc55e3a9107489a9b24385ac5379ca9) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:48.259872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f8111-ad53-4e12-b88c-cdab9f75a4ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:48.261304 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f8111-ad53-4e12-b88c-cdab9f75a4ec None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:48.274080 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 384/766] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:48:48 2022] GET /identity/v3/role_assignments?user.id=4fc55e3a9107489a9b24385ac5379ca9&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=382652f08fc24ce39f91164181237006 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:48.381312 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab324149-8c7c-46fa-b0ef-3698f95900be None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:48.382524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab324149-8c7c-46fa-b0ef-3698f95900be None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:48.383006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab324149-8c7c-46fa-b0ef-3698f95900be None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:48.384995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 383/767] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:48.391203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078b877-5939-4eca-bf1c-d2505d449b73 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:48.391836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078b877-5939-4eca-bf1c-d2505d449b73 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:48.392321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078b877-5939-4eca-bf1c-d2505d449b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:48.415671 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d078b877-5939-4eca-bf1c-d2505d449b73 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:48.417285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d078b877-5939-4eca-bf1c-d2505d449b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:48.505500 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 385/768] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:48:48.531118 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab324149-8c7c-46fa-b0ef-3698f95900be None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:48.662191 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab324149-8c7c-46fa-b0ef-3698f95900be None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:48.704526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621de6d-988e-40ad-b9ee-0023e6f2f6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:48.705327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621de6d-988e-40ad-b9ee-0023e6f2f6df None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:48.705601 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621de6d-988e-40ad-b9ee-0023e6f2f6df None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:48.705866 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621de6d-988e-40ad-b9ee-0023e6f2f6df None admin] PATH_INFO: `/v3/services/network` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:48.706540 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621de6d-988e-40ad-b9ee-0023e6f2f6df None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:48.707899 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621de6d-988e-40ad-b9ee-0023e6f2f6df None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:48.724307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-b621de6d-988e-40ad-b9ee-0023e6f2f6df None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 21:48:48.724307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:48.724307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:48:48.724307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:48:48.724307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:48:48.724307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:48:48.724307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:48:48.724307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:48.724307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 21:48:48.724307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:48.724307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:48:48.724307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:48.724307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:48.724307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:48.724307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:48.724307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:48.724307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:48.725631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:48.725631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:48.725631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:48.725631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:48.725631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:48.725631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:48.725631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:48:48.725631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:48:48.725631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:48:48.725631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:48:48.725631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:48.725631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:48.725631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:48.725631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:48.725631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:48.725631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:48.726524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:48.726524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:48.726524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:48.726524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:48.726524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:48.726524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:48.726524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:48.726524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:48.726524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:48.726524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:48.726524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:48:48.726524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:48.726524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 21:48:48.726524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:48.726524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 384/769] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:48 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:48.733951 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078b877-5939-4eca-bf1c-d2505d449b73 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:48.873658 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:48.898803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078b877-5939-4eca-bf1c-d2505d449b73 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:48.946603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb39997-d7f8-48ff-b3df-df593499a5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:48.947269 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb39997-d7f8-48ff-b3df-df593499a5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:48.947547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb39997-d7f8-48ff-b3df-df593499a5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:48.947822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb39997-d7f8-48ff-b3df-df593499a5b5 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:48.948523 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb39997-d7f8-48ff-b3df-df593499a5b5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:48.948825 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb39997-d7f8-48ff-b3df-df593499a5b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:48.950209 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb39997-d7f8-48ff-b3df-df593499a5b5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:48.957298 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 386/770] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 7 21:48:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:48.963567 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621de6d-988e-40ad-b9ee-0023e6f2f6df None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:49.061374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:49.129682 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621de6d-988e-40ad-b9ee-0023e6f2f6df None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:49.177362 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d560d3-8802-4cc4-8cd1-5942807408fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:49.178341 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d560d3-8802-4cc4-8cd1-5942807408fe None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:49.178773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d560d3-8802-4cc4-8cd1-5942807408fe None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:49.179202 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d560d3-8802-4cc4-8cd1-5942807408fe None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:49.180054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d560d3-8802-4cc4-8cd1-5942807408fe None admin] RBAC: Adding query filter params (type=network) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:49.180506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d560d3-8802-4cc4-8cd1-5942807408fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:49.182626 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d560d3-8802-4cc4-8cd1-5942807408fe None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:49.189494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 385/771] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 7 21:48:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:49.196148 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb39997-d7f8-48ff-b3df-df593499a5b5 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:49.356680 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb39997-d7f8-48ff-b3df-df593499a5b5 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:49.401609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3c517-d9be-4506-8481-946537f75e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:49.402218 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3c517-d9be-4506-8481-946537f75e03 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:49.402497 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3c517-d9be-4506-8481-946537f75e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:49.402770 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3c517-d9be-4506-8481-946537f75e03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:49.403555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3c517-d9be-4506-8481-946537f75e03 None admin] RBAC: Adding query filter params (interface=public, service_id=0476913ec6004fa0be0f1287905381d3, region_id=RegionOne) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:49.403917 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3c517-d9be-4506-8481-946537f75e03 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:49.405344 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3c517-d9be-4506-8481-946537f75e03 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:49.413382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 387/772] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jun 7 21:48:49 2022] GET /identity/v3/endpoints?service_id=0476913ec6004fa0be0f1287905381d3&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:49.419278 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d560d3-8802-4cc4-8cd1-5942807408fe None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:49.429558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa64d6-cb32-4f20-8d3d-4cc8411729c0 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:49.429842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa64d6-cb32-4f20-8d3d-4cc8411729c0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:49.430158 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa64d6-cb32-4f20-8d3d-4cc8411729c0 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:49.431852 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 388/773] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:48:49.443278 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38bb15-cdd0-417b-8bcd-a1baff3e74ba None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:49.443568 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38bb15-cdd0-417b-8bcd-a1baff3e74ba None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:49.443845 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38bb15-cdd0-417b-8bcd-a1baff3e74ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:49.449777 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:49.468912 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1d38bb15-cdd0-417b-8bcd-a1baff3e74ba None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:49.470221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1d38bb15-cdd0-417b-8bcd-a1baff3e74ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:49.542090 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d560d3-8802-4cc4-8cd1-5942807408fe None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:49.543481 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 389/774] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 21:48:49.549948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799aaab6-ec79-42dc-846e-a85c99b16262 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:49.550479 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799aaab6-ec79-42dc-846e-a85c99b16262 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:49.550965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799aaab6-ec79-42dc-846e-a85c99b16262 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:49.552696 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 390/775] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:49.558142 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3e453-c100-450a-873f-edd4cf42db5d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:49.558699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3e453-c100-450a-873f-edd4cf42db5d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:49.559177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3e453-c100-450a-873f-edd4cf42db5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:49.564270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:49.583292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a89bc1-62f2-4ffd-9297-bcfaf153cc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:49.584009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a89bc1-62f2-4ffd-9297-bcfaf153cc96 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:49.584290 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a89bc1-62f2-4ffd-9297-bcfaf153cc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:49.584613 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a89bc1-62f2-4ffd-9297-bcfaf153cc96 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:49.585084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d2e3e453-c100-450a-873f-edd4cf42db5d None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:49.585291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a89bc1-62f2-4ffd-9297-bcfaf153cc96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:49.586800 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a89bc1-62f2-4ffd-9297-bcfaf153cc96 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:49.587295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d2e3e453-c100-450a-873f-edd4cf42db5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:49.592910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 386/776] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 7 21:48:49 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:49.598839 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a89bc1-62f2-4ffd-9297-bcfaf153cc96 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:49.663388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 391/777] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 21:48:49.719592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3e453-c100-450a-873f-edd4cf42db5d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:49.752770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a89bc1-62f2-4ffd-9297-bcfaf153cc96 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:49.789482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c607a-7bc7-4d22-a137-e1f95c1485be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:49.790205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c607a-7bc7-4d22-a137-e1f95c1485be None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:49.790483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c607a-7bc7-4d22-a137-e1f95c1485be None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:49.790750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c607a-7bc7-4d22-a137-e1f95c1485be None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:49.791401 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c607a-7bc7-4d22-a137-e1f95c1485be None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:49.792773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c607a-7bc7-4d22-a137-e1f95c1485be None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:49.803209 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:49.805506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-9d7c607a-7bc7-4d22-a137-e1f95c1485be None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 21:48:49.805506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:49.805506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:48:49.805506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:48:49.805506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:48:49.805506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:48:49.805506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:48:49.805506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:49.805506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 21:48:49.805506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:49.805506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:48:49.805506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:49.805506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:49.805506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:49.805506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:49.805506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:49.806983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:49.806983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:49.806983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:49.806983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:49.806983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:49.806983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:49.806983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:49.806983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:48:49.806983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:48:49.806983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:48:49.806983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:48:49.806983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:49.806983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:49.806983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:49.806983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:49.806983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:49.808079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:49.808079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:49.808079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:49.808079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:49.808079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:49.808079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:49.808079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:49.808079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:49.808079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:49.808079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:49.808079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:49.808079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:48:49.808079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:49.808079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 21:48:49.808079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:49.808079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 387/778] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Jun 7 21:48:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:49.817960 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c607a-7bc7-4d22-a137-e1f95c1485be None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:49.865834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:49.911796 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3e453-c100-450a-873f-edd4cf42db5d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:49.947381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c607a-7bc7-4d22-a137-e1f95c1485be None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:49.954446 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5bc51-e7f5-4483-a39e-87c875a59e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:49.955895 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5bc51-e7f5-4483-a39e-87c875a59e31 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:49.956405 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5bc51-e7f5-4483-a39e-87c875a59e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:49.956935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5bc51-e7f5-4483-a39e-87c875a59e31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:49.971108 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5bc51-e7f5-4483-a39e-87c875a59e31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:49.981955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-37a5bc51-e7f5-4483-a39e-87c875a59e31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:49.981955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:49.981955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:49.981955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:49.981955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:49.981955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:49.981955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:49.981955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:49.981955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:49.981955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:49.981955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:49.981955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:49.981955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:49.981955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:49.981955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:49.981955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:49.982875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:49.982875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:49.982875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:49.982875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:49.982875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:49.982875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:49.982875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:49.982875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:49.982875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:49.982875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:49.982875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:49.982875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:49.982875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:49.982875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:49.982875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:49.982875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:49.983794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:49.983794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:49.983794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:49.983794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:49.983794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:49.983794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:49.983794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:49.983794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:49.983794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:49.983794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:49.983794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:49.983794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:49.984429 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4615e-bde7-40ab-8e61-e2e34600f337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:49.985542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4615e-bde7-40ab-8e61-e2e34600f337 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:49.985884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4615e-bde7-40ab-8e61-e2e34600f337 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:49.986277 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4615e-bde7-40ab-8e61-e2e34600f337 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:49.987200 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4615e-bde7-40ab-8e61-e2e34600f337 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:49.987351 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4615e-bde7-40ab-8e61-e2e34600f337 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:49.987529 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 392/779] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:48:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:49.988982 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4615e-bde7-40ab-8e61-e2e34600f337 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:49.993978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5bc51-e7f5-4483-a39e-87c875a59e31 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:50.005330 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 388/780] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jun 7 21:48:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:50.007960 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4615e-bde7-40ab-8e61-e2e34600f337 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:50.118446 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5bc51-e7f5-4483-a39e-87c875a59e31 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:50.127992 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4615e-bde7-40ab-8e61-e2e34600f337 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:50.139932 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:50.143580 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:50.169830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcf811-e8bb-4607-a051-eda803a95cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:50.170994 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcf811-e8bb-4607-a051-eda803a95cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:50.171297 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e541f-0f37-4ed6-a154-22d466e06bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:50.171683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcf811-e8bb-4607-a051-eda803a95cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:50.172102 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e541f-0f37-4ed6-a154-22d466e06bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:50.172307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcf811-e8bb-4607-a051-eda803a95cf8 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:50.172513 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e541f-0f37-4ed6-a154-22d466e06bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:50.172861 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e541f-0f37-4ed6-a154-22d466e06bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:50.173549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcf811-e8bb-4607-a051-eda803a95cf8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:50.173740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e541f-0f37-4ed6-a154-22d466e06bc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:50.174152 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e541f-0f37-4ed6-a154-22d466e06bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:50.174439 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcf811-e8bb-4607-a051-eda803a95cf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:50.175641 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e541f-0f37-4ed6-a154-22d466e06bc8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:50.176138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcf811-e8bb-4607-a051-eda803a95cf8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:50.182171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 389/781] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jun 7 21:48:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:50.188074 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcf811-e8bb-4607-a051-eda803a95cf8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:50.194808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 393/782] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:50.200182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e541f-0f37-4ed6-a154-22d466e06bc8 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:50.334266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcf811-e8bb-4607-a051-eda803a95cf8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:50.377813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e541f-0f37-4ed6-a154-22d466e06bc8 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:50.404728 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca05e1-bf56-41c3-9951-d849c0351563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:50.405411 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca05e1-bf56-41c3-9951-d849c0351563 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:50.405690 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca05e1-bf56-41c3-9951-d849c0351563 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:50.406003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca05e1-bf56-41c3-9951-d849c0351563 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:50.407109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca05e1-bf56-41c3-9951-d849c0351563 None admin] RBAC: Adding query filter params (interface=public, service_id=61bd594d600849c7bd6f12928bd9fba7, region_id=RegionOne) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:50.407419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca05e1-bf56-41c3-9951-d849c0351563 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:50.410705 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca05e1-bf56-41c3-9951-d849c0351563 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:50.431374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 390/783] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jun 7 21:48:50 2022] GET /identity/v3/endpoints?service_id=61bd594d600849c7bd6f12928bd9fba7&interface=public®ion_id=RegionOne => generated 194 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:50.437025 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca05e1-bf56-41c3-9951-d849c0351563 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:50.456139 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be5cde-8d5c-4384-bccc-9a18a2a6408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:50.456871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be5cde-8d5c-4384-bccc-9a18a2a6408f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:50.457155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be5cde-8d5c-4384-bccc-9a18a2a6408f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:50.457430 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be5cde-8d5c-4384-bccc-9a18a2a6408f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:50.482658 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be5cde-8d5c-4384-bccc-9a18a2a6408f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:50.484135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be5cde-8d5c-4384-bccc-9a18a2a6408f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:50.487267 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:50.520517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-02be5cde-8d5c-4384-bccc-9a18a2a6408f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:50.520517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:50.520517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:50.520517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:50.520517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:50.520517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:50.520517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:50.520517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:50.520517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:50.520517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:50.520517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:50.520517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:50.520517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:50.520517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:50.520517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:50.521464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:50.521464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:50.521464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:50.521464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:50.521464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:50.521464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:50.521464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:50.521464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:50.521464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:50.521464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:50.521464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:50.521464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:50.521464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:50.521464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:50.521464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:50.521464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:50.521464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:50.522360 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:50.522360 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:50.522360 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:50.522360 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:50.529525 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 394/784] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:50.542426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be5cde-8d5c-4384-bccc-9a18a2a6408f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:50.590512 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:50.616440 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca05e1-bf56-41c3-9951-d849c0351563 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:50.693305 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c3953-3255-488a-acb2-d88ab1501421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:50.694192 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c3953-3255-488a-acb2-d88ab1501421 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:50.694469 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c3953-3255-488a-acb2-d88ab1501421 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:50.694736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c3953-3255-488a-acb2-d88ab1501421 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:50.695423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c3953-3255-488a-acb2-d88ab1501421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:50.696871 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c3953-3255-488a-acb2-d88ab1501421 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:50.703560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be5cde-8d5c-4384-bccc-9a18a2a6408f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:50.705961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 391/785] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 7 21:48:50 2022] GET /identity/v3/services => generated 772 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:50.739369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83716c8-3d63-4381-8c93-6aaadb959e8a None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:50.739650 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83716c8-3d63-4381-8c93-6aaadb959e8a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:50.739848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83716c8-3d63-4381-8c93-6aaadb959e8a None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:50.741570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 392/786] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:48:50.747819 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb637fba-7f4e-4c8e-8e8b-943e288e4123 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:50.748101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb637fba-7f4e-4c8e-8e8b-943e288e4123 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:50.748387 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb637fba-7f4e-4c8e-8e8b-943e288e4123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:50.769073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0a533-1ebc-4fbe-a0bb-58538d3bd29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:50.769775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0a533-1ebc-4fbe-a0bb-58538d3bd29c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:50.770105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0a533-1ebc-4fbe-a0bb-58538d3bd29c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:50.770384 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0a533-1ebc-4fbe-a0bb-58538d3bd29c None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:50.771131 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0a533-1ebc-4fbe-a0bb-58538d3bd29c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:50.771443 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0a533-1ebc-4fbe-a0bb-58538d3bd29c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:50.772876 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0a533-1ebc-4fbe-a0bb-58538d3bd29c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:50.779173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-cb637fba-7f4e-4c8e-8e8b-943e288e4123 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:50.780786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-cb637fba-7f4e-4c8e-8e8b-943e288e4123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:50.787712 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 395/787] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:48:50.795053 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0a533-1ebc-4fbe-a0bb-58538d3bd29c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:50.918242 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:50.924853 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0a533-1ebc-4fbe-a0bb-58538d3bd29c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:50.966150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864093c-9c54-422a-8312-8a93edcedaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:50.966985 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864093c-9c54-422a-8312-8a93edcedaa3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:50.967268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864093c-9c54-422a-8312-8a93edcedaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:50.967548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864093c-9c54-422a-8312-8a93edcedaa3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:50.975803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864093c-9c54-422a-8312-8a93edcedaa3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:50.977253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864093c-9c54-422a-8312-8a93edcedaa3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:50.992330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e864093c-9c54-422a-8312-8a93edcedaa3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 21:48:50.992330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:50.992330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:50.992330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:50.992330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:50.992330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:50.992330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:50.992330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:50.992330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:50.992330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:50.992330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:50.992330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:50.992330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:50.992330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:50.992330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:50.992330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:50.993314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:50.994272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:50.994272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:50.994272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:50.994272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:50.994272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:50.994272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:50.994272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:50.994272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:50.994272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 21:48:50.994272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:50.998093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 396/788] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:48:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:51.000274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864093c-9c54-422a-8312-8a93edcedaa3 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:51.037954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 393/789] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:48:51.076988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb637fba-7f4e-4c8e-8e8b-943e288e4123 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:51.142307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:51.185351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864093c-9c54-422a-8312-8a93edcedaa3 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:51.221401 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b65746-3279-405c-84f5-a09988da9554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:51.222106 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b65746-3279-405c-84f5-a09988da9554 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:51.222393 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b65746-3279-405c-84f5-a09988da9554 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:51.222670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b65746-3279-405c-84f5-a09988da9554 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:51.224170 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b65746-3279-405c-84f5-a09988da9554 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:51.224170 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b65746-3279-405c-84f5-a09988da9554 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:51.225507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b65746-3279-405c-84f5-a09988da9554 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:51.244915 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 397/790] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jun 7 21:48:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:51.250280 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b65746-3279-405c-84f5-a09988da9554 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:51.270751 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:51.299335 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb637fba-7f4e-4c8e-8e8b-943e288e4123 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:51.390677 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cace452-feae-4d10-ab09-c27067513b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:51.391714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cace452-feae-4d10-ab09-c27067513b71 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:51.392247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cace452-feae-4d10-ab09-c27067513b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:51.392653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cace452-feae-4d10-ab09-c27067513b71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:51.413859 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cace452-feae-4d10-ab09-c27067513b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:51.422610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-5cace452-feae-4d10-ab09-c27067513b71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:51.422610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:51.422610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:51.422610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:51.422610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:51.422610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:51.422610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:51.422610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:51.422610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:51.422610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:51.422610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:51.422610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:51.422610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:51.422610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:51.422610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:51.422610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:51.423648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:51.423648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:51.423648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:51.423648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:51.423648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:51.423648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:51.423648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:51.423648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:51.423648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:51.423648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:51.423648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:51.423648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:51.423648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:51.423648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:51.423648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:51.423648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:51.424504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:51.424504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:51.424504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:51.424504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:51.424504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:51.424504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:51.424504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:51.424504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:51.424504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:51.424504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:51.424504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:51.424504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:51.425161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b65746-3279-405c-84f5-a09988da9554 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:51.427150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 394/791] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:48:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:51.428738 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405f925-3ecf-4b6c-b2d2-71d4817e56aa None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:51.429231 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405f925-3ecf-4b6c-b2d2-71d4817e56aa None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:51.429872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405f925-3ecf-4b6c-b2d2-71d4817e56aa None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:51.432501 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 395/792] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:51.433951 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405f925-3ecf-4b6c-b2d2-71d4817e56aa None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:51.465774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de8a58-ebc4-4355-ae61-d9e724321f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:51.467190 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de8a58-ebc4-4355-ae61-d9e724321f45 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:51.467469 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de8a58-ebc4-4355-ae61-d9e724321f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:51.467744 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de8a58-ebc4-4355-ae61-d9e724321f45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:51.481083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de8a58-ebc4-4355-ae61-d9e724321f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:51.483052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de8a58-ebc4-4355-ae61-d9e724321f45 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:51.507193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e0de8a58-ebc4-4355-ae61-d9e724321f45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:51.507193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:51.507193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:51.507193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:51.507193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:51.507193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:51.507193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:51.507193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:51.507193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:51.507193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:51.507193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:51.507193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:51.507193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:51.507193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:51.507193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:51.508084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:51.508084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:51.508084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:51.508084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:51.508084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:51.508084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:51.508084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:51.508084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:51.508084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:51.508084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:51.508084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:51.508084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:51.508084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:51.508084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:51.508084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:51.508084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:51.508084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:51.509039 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:51.509039 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:51.509039 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:51.509039 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:51.510014 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 398/793] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:51.511400 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7b9a2-26aa-477c-9f03-f128f7188006 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:51.511777 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7b9a2-26aa-477c-9f03-f128f7188006 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:51.512146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7b9a2-26aa-477c-9f03-f128f7188006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:51.539949 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:51.542918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-73b7b9a2-26aa-477c-9f03-f128f7188006 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:51.545103 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-73b7b9a2-26aa-477c-9f03-f128f7188006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:51.550619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405f925-3ecf-4b6c-b2d2-71d4817e56aa None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:51.585511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa1cc9-e780-436e-bdfc-863436be5861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:51.586366 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa1cc9-e780-436e-bdfc-863436be5861 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:51.586780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa1cc9-e780-436e-bdfc-863436be5861 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:51.587194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa1cc9-e780-436e-bdfc-863436be5861 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:51.588068 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa1cc9-e780-436e-bdfc-863436be5861 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:51.588466 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa1cc9-e780-436e-bdfc-863436be5861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:51.590034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa1cc9-e780-436e-bdfc-863436be5861 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:51.599530 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 396/794] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:51.600686 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa1cc9-e780-436e-bdfc-863436be5861 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:51.612621 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:51.620683 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 399/795] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:48:51.630066 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7b9a2-26aa-477c-9f03-f128f7188006 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:51.703956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa1cc9-e780-436e-bdfc-863436be5861 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:51.748149 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04073600-7825-4bb6-8125-41b33d99be90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:51.749333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04073600-7825-4bb6-8125-41b33d99be90 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:51.749763 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04073600-7825-4bb6-8125-41b33d99be90 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:51.750479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04073600-7825-4bb6-8125-41b33d99be90 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:51.751761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04073600-7825-4bb6-8125-41b33d99be90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:51.752504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04073600-7825-4bb6-8125-41b33d99be90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:51.754321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04073600-7825-4bb6-8125-41b33d99be90 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:51.761249 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7b9a2-26aa-477c-9f03-f128f7188006 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:51.770604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 397/796] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:51.772102 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04073600-7825-4bb6-8125-41b33d99be90 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:51.794284 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:51.807282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cf80e-3b59-44e2-9853-ee5603d79cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:51.808615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cf80e-3b59-44e2-9853-ee5603d79cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:51.809292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cf80e-3b59-44e2-9853-ee5603d79cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:51.810183 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cf80e-3b59-44e2-9853-ee5603d79cc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:51.824293 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cf80e-3b59-44e2-9853-ee5603d79cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:51.826713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cf80e-3b59-44e2-9853-ee5603d79cc6 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:51.851328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-dd5cf80e-3b59-44e2-9853-ee5603d79cc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:51.851328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:51.851328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:51.851328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:51.851328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:51.851328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:51.851328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:51.851328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:51.851328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:51.851328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:51.851328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:51.851328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:51.851328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:51.851328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:51.851328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:51.852255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:51.852255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:51.852255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:51.852255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:51.852255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:51.852255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:51.852255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:51.852255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:51.852255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:51.852255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:51.852255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:51.852255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:51.852255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:51.852255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:51.852255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:51.852255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:51.852255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:51.853668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:51.853668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:51.853668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:51.853668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:51.856003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 400/797] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:51.856447 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cf80e-3b59-44e2-9853-ee5603d79cc6 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:51.901197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04073600-7825-4bb6-8125-41b33d99be90 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:51.912184 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:51.951681 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ab447-f73c-4d81-a6f0-9bf3787f2c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:51.952781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ab447-f73c-4d81-a6f0-9bf3787f2c3d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:51.953785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ab447-f73c-4d81-a6f0-9bf3787f2c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:51.954260 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ab447-f73c-4d81-a6f0-9bf3787f2c3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:51.966011 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cf80e-3b59-44e2-9853-ee5603d79cc6 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:51.970389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ab447-f73c-4d81-a6f0-9bf3787f2c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:51.979134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-e36ab447-f73c-4d81-a6f0-9bf3787f2c3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:51.979134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:51.979134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:51.979134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:51.979134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:51.979134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:51.979134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:51.979134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:51.979134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:51.979134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:51.979134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:51.979134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:51.979134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:51.979134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:51.979134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:51.979134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:51.980060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:51.980060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:51.980060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:51.980060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:51.980060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:51.980060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:51.980060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:51.980060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:51.980060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:51.980060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:51.980060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:51.980060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:51.980060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:51.980060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:51.980060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:51.980060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:51.980885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:51.980885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:51.980885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:51.980885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:51.980885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:51.980885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:51.980885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:51.980885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:51.980885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:51.980885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:51.980885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:51.980885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:51.980885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 398/798] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:51.981571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ab447-f73c-4d81-a6f0-9bf3787f2c3d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:52.016688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba023fb-b88d-4257-8e44-7a2783441be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:52.017784 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba023fb-b88d-4257-8e44-7a2783441be0 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:52.018518 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba023fb-b88d-4257-8e44-7a2783441be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:52.018974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba023fb-b88d-4257-8e44-7a2783441be0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:52.029273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba023fb-b88d-4257-8e44-7a2783441be0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:52.031571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba023fb-b88d-4257-8e44-7a2783441be0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:52.052713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-8ba023fb-b88d-4257-8e44-7a2783441be0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:52.052713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:52.052713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:52.052713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:52.052713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:52.052713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:52.052713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:52.052713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:52.052713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:52.052713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:52.052713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:52.052713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:52.052713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:52.052713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:52.052713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:52.053679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:52.053679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:52.053679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:52.053679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:52.053679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:52.053679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:52.053679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:52.053679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:52.053679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:52.053679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:52.053679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:52.053679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:52.053679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:52.053679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:52.053679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:52.053679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:52.053679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:52.054699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:52.054699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:52.054699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:52.054699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:52.054699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:52.054699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:52.054699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:52.054699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:52.058531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 401/799] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:52.059960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba023fb-b88d-4257-8e44-7a2783441be0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:52.069065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:52.107509 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ab447-f73c-4d81-a6f0-9bf3787f2c3d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:52.154536 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecdc2c-9e4c-43f3-9a06-d924bdca26f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:52.155518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecdc2c-9e4c-43f3-9a06-d924bdca26f9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:52.155964 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecdc2c-9e4c-43f3-9a06-d924bdca26f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:52.156385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecdc2c-9e4c-43f3-9a06-d924bdca26f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:52.157247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecdc2c-9e4c-43f3-9a06-d924bdca26f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:52.157788 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecdc2c-9e4c-43f3-9a06-d924bdca26f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:52.159479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecdc2c-9e4c-43f3-9a06-d924bdca26f9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:52.174530 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 399/800] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:52.175622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecdc2c-9e4c-43f3-9a06-d924bdca26f9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:52.177658 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba023fb-b88d-4257-8e44-7a2783441be0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:52.188402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:52.217566 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794da82-1ae3-43ee-87c6-6d61da547b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:52.218339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794da82-1ae3-43ee-87c6-6d61da547b95 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:52.218625 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794da82-1ae3-43ee-87c6-6d61da547b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:52.218984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794da82-1ae3-43ee-87c6-6d61da547b95 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:52.219741 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794da82-1ae3-43ee-87c6-6d61da547b95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:52.220047 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794da82-1ae3-43ee-87c6-6d61da547b95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:52.221489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794da82-1ae3-43ee-87c6-6d61da547b95 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:52.231381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 402/801] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:52.232376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794da82-1ae3-43ee-87c6-6d61da547b95 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:52.287848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecdc2c-9e4c-43f3-9a06-d924bdca26f9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:52.324515 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93551f6a-7b43-4f1f-adc3-a2446dd67404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:52.325534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551f6a-7b43-4f1f-adc3-a2446dd67404 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:52.325995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551f6a-7b43-4f1f-adc3-a2446dd67404 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:52.326415 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551f6a-7b43-4f1f-adc3-a2446dd67404 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:52.327340 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93551f6a-7b43-4f1f-adc3-a2446dd67404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:52.327793 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93551f6a-7b43-4f1f-adc3-a2446dd67404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:52.329456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93551f6a-7b43-4f1f-adc3-a2446dd67404 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:52.331362 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:52.342802 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794da82-1ae3-43ee-87c6-6d61da547b95 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:52.343917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 400/802] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:52.344958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93551f6a-7b43-4f1f-adc3-a2446dd67404 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:52.395544 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cbbc6-421b-419f-a71f-97a3ea3a848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:52.396337 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cbbc6-421b-419f-a71f-97a3ea3a848e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:52.396615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cbbc6-421b-419f-a71f-97a3ea3a848e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:52.396892 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cbbc6-421b-419f-a71f-97a3ea3a848e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:52.404769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cbbc6-421b-419f-a71f-97a3ea3a848e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:52.406232 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cbbc6-421b-419f-a71f-97a3ea3a848e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:52.421436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-a35cbbc6-421b-419f-a71f-97a3ea3a848e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:48:52.421436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:52.421436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:52.421436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:52.421436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:52.421436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:52.421436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:52.421436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:52.421436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:52.421436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:52.421436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:52.421436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:52.421436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:52.421436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:52.421436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:52.421436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:52.422412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:52.428515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:52.428515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:52.428515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:52.428515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:52.428515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:52.428515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:52.428515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:52.428515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:52.428515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:48:52.428515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:52.428515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 403/803] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 7 21:48:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:52.428515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cbbc6-421b-419f-a71f-97a3ea3a848e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:52.461879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:52.465514 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93551f6a-7b43-4f1f-adc3-a2446dd67404 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:52.502544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741681e-018e-480e-a000-2f1d33babd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:52.503557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741681e-018e-480e-a000-2f1d33babd8b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:52.503989 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741681e-018e-480e-a000-2f1d33babd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:52.504441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741681e-018e-480e-a000-2f1d33babd8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:52.518956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741681e-018e-480e-a000-2f1d33babd8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:52.520409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741681e-018e-480e-a000-2f1d33babd8b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:52.534409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cbbc6-421b-419f-a71f-97a3ea3a848e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:52.537552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-8741681e-018e-480e-a000-2f1d33babd8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:52.537552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:52.537552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:52.537552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:52.537552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:52.537552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:52.537552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:52.537552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:52.537552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:52.537552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:52.537552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:52.537552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:52.537552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:52.537552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:52.537552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:52.538651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:52.538651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:52.538651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:52.538651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:52.538651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:52.538651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:52.538651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:52.538651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:52.538651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:52.538651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:52.538651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:52.538651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:52.538651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:52.538651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:52.538651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:52.538651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:52.538651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:52.545225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:52.545225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:52.545225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:52.545225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:52.545225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 401/804] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:52.545225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bf939-03f0-4748-bbe6-9e30e0c942db None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:52.545225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bf939-03f0-4748-bbe6-9e30e0c942db None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:52.545225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bf939-03f0-4748-bbe6-9e30e0c942db None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:52.545225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 402/805] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:52.545728 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bf939-03f0-4748-bbe6-9e30e0c942db None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:52.574098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f2495-68fa-4081-a2a6-62f1e17360cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:52.574986 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f2495-68fa-4081-a2a6-62f1e17360cd None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:52.575277 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f2495-68fa-4081-a2a6-62f1e17360cd None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:52.575551 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f2495-68fa-4081-a2a6-62f1e17360cd None admin] PATH_INFO: `/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/a4b69c708fbc470aae3e3954e21a1e88/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:52.577556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f2495-68fa-4081-a2a6-62f1e17360cd None admin] RBAC: Authorizing `identity:create_grant(project_id=eca8f481deb242789622ebb10aa2c5da, user_id=a4b69c708fbc470aae3e3954e21a1e88, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:52.579086 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f2495-68fa-4081-a2a6-62f1e17360cd None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:52.593121 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 404/806] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:48:52 2022] PUT /identity/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/a4b69c708fbc470aae3e3954e21a1e88/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:48:52.593941 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f2495-68fa-4081-a2a6-62f1e17360cd None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:52.606430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:52.669726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bf939-03f0-4748-bbe6-9e30e0c942db None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:52.709780 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:52.715812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa2253-318c-4303-a3f1-61aa0ee4aeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:52.716834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa2253-318c-4303-a3f1-61aa0ee4aeba None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:52.717969 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa2253-318c-4303-a3f1-61aa0ee4aeba None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:52.718413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa2253-318c-4303-a3f1-61aa0ee4aeba None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:52.719363 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa2253-318c-4303-a3f1-61aa0ee4aeba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:52.719767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa2253-318c-4303-a3f1-61aa0ee4aeba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:52.721447 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa2253-318c-4303-a3f1-61aa0ee4aeba None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:52.726199 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f2495-68fa-4081-a2a6-62f1e17360cd None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:52.743672 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 403/807] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 7 21:48:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:52.745553 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524959c-b52b-4e9e-9810-a4918d53271d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:52.745957 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524959c-b52b-4e9e-9810-a4918d53271d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:52.746338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524959c-b52b-4e9e-9810-a4918d53271d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:52.766002 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f524959c-b52b-4e9e-9810-a4918d53271d None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:52.767375 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f524959c-b52b-4e9e-9810-a4918d53271d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:52.771588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad27e40-b9af-4a56-affa-a30e8d903776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:52.772509 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad27e40-b9af-4a56-affa-a30e8d903776 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:52.772935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad27e40-b9af-4a56-affa-a30e8d903776 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:52.773381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad27e40-b9af-4a56-affa-a30e8d903776 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:52.774366 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad27e40-b9af-4a56-affa-a30e8d903776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:52.774820 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad27e40-b9af-4a56-affa-a30e8d903776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:52.776360 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad27e40-b9af-4a56-affa-a30e8d903776 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:52.793410 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 405/808] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:52.794710 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad27e40-b9af-4a56-affa-a30e8d903776 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:52.851851 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 404/809] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:48:52.852240 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524959c-b52b-4e9e-9810-a4918d53271d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:52.894484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:52.923905 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad27e40-b9af-4a56-affa-a30e8d903776 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:52.964157 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab31cd-ecb7-4375-b703-7a73052eb9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:52.965311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab31cd-ecb7-4375-b703-7a73052eb9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:52.965744 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab31cd-ecb7-4375-b703-7a73052eb9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:52.966194 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab31cd-ecb7-4375-b703-7a73052eb9e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:52.974181 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524959c-b52b-4e9e-9810-a4918d53271d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:52.987751 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:53.010351 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13edd1-a2b9-48f4-981a-94a7ef7ecb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:53.011163 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13edd1-a2b9-48f4-981a-94a7ef7ecb57 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:53.011437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13edd1-a2b9-48f4-981a-94a7ef7ecb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:53.011705 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13edd1-a2b9-48f4-981a-94a7ef7ecb57 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:53.019257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13edd1-a2b9-48f4-981a-94a7ef7ecb57 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:53.021048 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13edd1-a2b9-48f4-981a-94a7ef7ecb57 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:53.036323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-2e13edd1-a2b9-48f4-981a-94a7ef7ecb57 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 21:48:53.036323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:53.036323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:53.036323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:53.036323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:53.036323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:53.036323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:53.036323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:53.036323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:53.036323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:53.036323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:53.036323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:53.036323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:53.036323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:53.036323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:53.036323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:53.037577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:53.038848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:53.038848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:53.038848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:53.038848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:53.038848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:53.038848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:53.038848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:53.038848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:53.038848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 21:48:53.038848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:53.038848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 405/810] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 7 21:48:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:53.038848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13edd1-a2b9-48f4-981a-94a7ef7ecb57 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:53.048543 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab31cd-ecb7-4375-b703-7a73052eb9e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:53.050206 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab31cd-ecb7-4375-b703-7a73052eb9e2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:53.140155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:53.146974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13edd1-a2b9-48f4-981a-94a7ef7ecb57 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:53.175084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 406/811] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:48:53.176221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab31cd-ecb7-4375-b703-7a73052eb9e2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:53.194908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3910157-dc49-401a-9722-5a8486caf90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:53.197067 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3910157-dc49-401a-9722-5a8486caf90e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:53.197474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3910157-dc49-401a-9722-5a8486caf90e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:53.197854 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3910157-dc49-401a-9722-5a8486caf90e None admin] PATH_INFO: `/v3/services/network` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:53.198704 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3910157-dc49-401a-9722-5a8486caf90e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:53.200183 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3910157-dc49-401a-9722-5a8486caf90e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:53.217917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-a3910157-dc49-401a-9722-5a8486caf90e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 21:48:53.217917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:53.217917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:48:53.217917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:48:53.217917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:48:53.217917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:48:53.217917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:48:53.217917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:53.217917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 21:48:53.217917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:53.217917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:48:53.217917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:53.217917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:53.217917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:53.217917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:53.217917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:53.217917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:53.219015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:53.219015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:53.219015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:53.219015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:53.219015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:53.219015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:53.219015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:48:53.219015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:48:53.219015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:48:53.219015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:48:53.219015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:53.219015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:53.219015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:53.219015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:53.219015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:53.219015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:53.224848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:53.224848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:53.224848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:53.224848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:53.224848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:53.224848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:53.224848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:53.224848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:53.224848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:53.224848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:53.224848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:48:53.224848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:53.224848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 21:48:53.224848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:53.224848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 406/812] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:53 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:53.226001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3910157-dc49-401a-9722-5a8486caf90e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:53.240458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:53.296277 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab31cd-ecb7-4375-b703-7a73052eb9e2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:53.331993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea682b-82c5-4892-8b23-d90531e2cc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:53.332977 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea682b-82c5-4892-8b23-d90531e2cc9d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:53.333259 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea682b-82c5-4892-8b23-d90531e2cc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:53.333540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea682b-82c5-4892-8b23-d90531e2cc9d None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:53.334406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea682b-82c5-4892-8b23-d90531e2cc9d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:53.334717 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea682b-82c5-4892-8b23-d90531e2cc9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:53.336149 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea682b-82c5-4892-8b23-d90531e2cc9d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:53.337898 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3910157-dc49-401a-9722-5a8486caf90e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:53.358639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 407/813] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jun 7 21:48:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:53.359294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea682b-82c5-4892-8b23-d90531e2cc9d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:53.380706 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419253e-7c19-4a02-94a7-9ae124fd77cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:53.381501 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419253e-7c19-4a02-94a7-9ae124fd77cb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:53.381785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419253e-7c19-4a02-94a7-9ae124fd77cb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:53.382093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419253e-7c19-4a02-94a7-9ae124fd77cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:53.393685 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419253e-7c19-4a02-94a7-9ae124fd77cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:53.395154 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419253e-7c19-4a02-94a7-9ae124fd77cb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:53.412433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c419253e-7c19-4a02-94a7-9ae124fd77cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:53.412433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:53.412433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:53.412433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:53.412433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:53.412433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:53.412433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:53.412433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:53.412433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:53.412433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:53.412433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:53.412433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:53.412433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:53.412433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:53.412433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:53.413337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:53.413337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:53.413337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:53.413337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:53.413337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:53.413337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:53.413337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:53.413337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:53.413337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:53.413337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:53.413337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:53.413337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:53.413337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:53.413337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:53.413337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:53.413337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:53.413337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:53.414311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:53.414311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:53.414311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:53.414311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:53.414311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 407/814] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:53.415489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b2ff3-17fe-40b4-ad3b-c6644517fc01 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:53.415489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b2ff3-17fe-40b4-ad3b-c6644517fc01 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:53.415489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b2ff3-17fe-40b4-ad3b-c6644517fc01 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:53.416784 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 408/815] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:53.417286 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b2ff3-17fe-40b4-ad3b-c6644517fc01 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:53.431143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:53.482216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea682b-82c5-4892-8b23-d90531e2cc9d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:53.492306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:53.525560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28734f5-fd61-4b39-840b-566ca49c0e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:53.526247 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28734f5-fd61-4b39-840b-566ca49c0e9f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:53.526526 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28734f5-fd61-4b39-840b-566ca49c0e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:53.526652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b2ff3-17fe-40b4-ad3b-c6644517fc01 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:53.527096 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28734f5-fd61-4b39-840b-566ca49c0e9f None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:53.527484 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28734f5-fd61-4b39-840b-566ca49c0e9f None admin] RBAC: Adding query filter params (name=network) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:53.527791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28734f5-fd61-4b39-840b-566ca49c0e9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:53.529512 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28734f5-fd61-4b39-840b-566ca49c0e9f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:53.534099 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 408/816] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 7 21:48:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:53.534863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28734f5-fd61-4b39-840b-566ca49c0e9f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:53.567540 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e953f-79c0-4a83-b26f-34f2e2432cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:53.568327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e953f-79c0-4a83-b26f-34f2e2432cab None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:53.568608 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e953f-79c0-4a83-b26f-34f2e2432cab None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:53.568888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e953f-79c0-4a83-b26f-34f2e2432cab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:53.579863 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e953f-79c0-4a83-b26f-34f2e2432cab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:53.581320 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e953f-79c0-4a83-b26f-34f2e2432cab None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:53.600668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-6a9e953f-79c0-4a83-b26f-34f2e2432cab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:53.600668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:53.600668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:53.600668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:53.600668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:53.600668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:53.600668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:53.600668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:53.600668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:53.600668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:53.600668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:53.600668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:53.600668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:53.600668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:53.600668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:53.601691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:53.601691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:53.601691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:53.601691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:53.601691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:53.601691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:53.601691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:53.601691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:53.601691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:53.601691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:53.601691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:53.601691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:53.601691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:53.601691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:53.601691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:53.601691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:53.601691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:53.602698 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:53.602698 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:53.602698 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:53.602698 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:53.602698 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 409/817] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:53.603407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f617b-3833-4333-9b8a-72deae9444e5 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:53.603697 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f617b-3833-4333-9b8a-72deae9444e5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:53.603974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f617b-3833-4333-9b8a-72deae9444e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:53.623331 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b24f617b-3833-4333-9b8a-72deae9444e5 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:53.624510 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b24f617b-3833-4333-9b8a-72deae9444e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:53.642564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28734f5-fd61-4b39-840b-566ca49c0e9f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:53.676263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdaf21-fff1-4429-a119-41849569de90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:53.676907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdaf21-fff1-4429-a119-41849569de90 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:53.677187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdaf21-fff1-4429-a119-41849569de90 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:53.677455 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdaf21-fff1-4429-a119-41849569de90 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:53.678191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdaf21-fff1-4429-a119-41849569de90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:53.678496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdaf21-fff1-4429-a119-41849569de90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:53.679843 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdaf21-fff1-4429-a119-41849569de90 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:53.686374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:53.697005 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 409/818] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:53.697005 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdaf21-fff1-4429-a119-41849569de90 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:53.709976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 410/819] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:48:53.709976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f617b-3833-4333-9b8a-72deae9444e5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:53.724642 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:53.797804 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdaf21-fff1-4429-a119-41849569de90 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:53.820696 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f617b-3833-4333-9b8a-72deae9444e5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:53.833483 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95eb259-ca61-4897-a264-f139b0250a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:53.834165 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eb259-ca61-4897-a264-f139b0250a12 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:53.834445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eb259-ca61-4897-a264-f139b0250a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:53.834716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eb259-ca61-4897-a264-f139b0250a12 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:53.835409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95eb259-ca61-4897-a264-f139b0250a12 None admin] RBAC: Adding query filter params (type=network) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:53.835717 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95eb259-ca61-4897-a264-f139b0250a12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:53.837615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95eb259-ca61-4897-a264-f139b0250a12 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:53.847390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 410/820] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 7 21:48:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:53.847390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95eb259-ca61-4897-a264-f139b0250a12 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:53.857090 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50fda4-9063-4abd-8b5c-7d0457eccfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:53.857688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50fda4-9063-4abd-8b5c-7d0457eccfc3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:53.857996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50fda4-9063-4abd-8b5c-7d0457eccfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:53.858271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50fda4-9063-4abd-8b5c-7d0457eccfc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:53.859230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50fda4-9063-4abd-8b5c-7d0457eccfc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:53.859342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50fda4-9063-4abd-8b5c-7d0457eccfc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:53.860623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50fda4-9063-4abd-8b5c-7d0457eccfc3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:53.871912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 411/821] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:53.873559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50fda4-9063-4abd-8b5c-7d0457eccfc3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:53.930151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:53.957246 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:53.963854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95eb259-ca61-4897-a264-f139b0250a12 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:53.981388 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50fda4-9063-4abd-8b5c-7d0457eccfc3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:54.000831 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c316d-15bd-41ab-ac37-c23d86dd205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:54.001673 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c316d-15bd-41ab-ac37-c23d86dd205f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:54.001991 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c316d-15bd-41ab-ac37-c23d86dd205f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:54.002294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c316d-15bd-41ab-ac37-c23d86dd205f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:54.009599 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c316d-15bd-41ab-ac37-c23d86dd205f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:54.011006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c316d-15bd-41ab-ac37-c23d86dd205f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:54.020001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67e3d4-8fc3-47a3-a888-c6c41688e73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:54.020870 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67e3d4-8fc3-47a3-a888-c6c41688e73a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:54.021218 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67e3d4-8fc3-47a3-a888-c6c41688e73a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:54.021558 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67e3d4-8fc3-47a3-a888-c6c41688e73a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:54.022299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67e3d4-8fc3-47a3-a888-c6c41688e73a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:54.023706 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67e3d4-8fc3-47a3-a888-c6c41688e73a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:54.025421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-b29c316d-15bd-41ab-ac37-c23d86dd205f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:54.025421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:54.025421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:54.025421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:54.025421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:54.025421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:54.025421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:54.025421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:54.025421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:54.025421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:54.025421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:54.025421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:54.025421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:54.025421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:54.025421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:54.026302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:54.026302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:54.026302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:54.026302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:54.026302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:54.026302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:54.026302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:54.026302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:54.026302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:54.026302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:54.026302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:54.026302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:54.026302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:54.026302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:54.026302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:54.026302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:54.026302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:54.027200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:54.027200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:54.027200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:54.027200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:54.027200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:54.027200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:54.027200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:54.027200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:54.027200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 411/822] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:54.027671 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c316d-15bd-41ab-ac37-c23d86dd205f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:54.041716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-8f67e3d4-8fc3-47a3-a888-c6c41688e73a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 21:48:54.041716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:54.041716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:48:54.041716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:48:54.041716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:48:54.041716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:48:54.041716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:48:54.041716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:54.041716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 21:48:54.041716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:54.041716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:48:54.041716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:54.041716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:54.041716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:54.041716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:54.041716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:54.042904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:54.042904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:54.042904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:54.042904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:54.042904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:54.042904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:54.042904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:54.042904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:48:54.042904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:48:54.042904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:48:54.042904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:48:54.042904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:54.042904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:54.042904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:54.042904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:54.042904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:54.043913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:54.043913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:54.043913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:54.043913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:54.043913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:54.043913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:54.043913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:54.043913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:54.043913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:54.043913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:54.043913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:54.043913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:48:54.043913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:54.043913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 21:48:54.043913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:54.045190 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 412/823] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Jun 7 21:48:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:54.045835 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67e3d4-8fc3-47a3-a888-c6c41688e73a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:54.140305 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c316d-15bd-41ab-ac37-c23d86dd205f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:54.153858 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67e3d4-8fc3-47a3-a888-c6c41688e73a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:54.170982 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:54.174914 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3ffd2-abc2-4dd4-8097-787f5986a9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:54.175687 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ffd2-abc2-4dd4-8097-787f5986a9a0 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:54.175967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ffd2-abc2-4dd4-8097-787f5986a9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:54.176243 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ffd2-abc2-4dd4-8097-787f5986a9a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:54.176985 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3ffd2-abc2-4dd4-8097-787f5986a9a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:54.178942 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3ffd2-abc2-4dd4-8097-787f5986a9a0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:54.194142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168e1e8-a204-4f7b-970b-ce75347ab421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:54.195000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168e1e8-a204-4f7b-970b-ce75347ab421 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:54.195284 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168e1e8-a204-4f7b-970b-ce75347ab421 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:54.195672 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168e1e8-a204-4f7b-970b-ce75347ab421 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:54.209953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 412/824] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 7 21:48:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:48:54.209953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3ffd2-abc2-4dd4-8097-787f5986a9a0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:54.210239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168e1e8-a204-4f7b-970b-ce75347ab421 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:54.210239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168e1e8-a204-4f7b-970b-ce75347ab421 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:54.227419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-1168e1e8-a204-4f7b-970b-ce75347ab421 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:54.227419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:54.227419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:54.227419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:54.227419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:54.227419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:54.227419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:54.227419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:54.227419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:54.227419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:54.227419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:54.227419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:54.227419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:54.227419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:54.227419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:54.228531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:54.228531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:54.228531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:54.228531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:54.228531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:54.228531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:54.228531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:54.228531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:54.228531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:54.228531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:54.228531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:54.228531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:54.228531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:54.228531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:54.228531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:54.228531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:54.228531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:54.229621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:54.229621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:54.229621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:54.229621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:54.229621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:54.229621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:54.229621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:54.229621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:54.231285 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 413/825] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:54.231988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168e1e8-a204-4f7b-970b-ce75347ab421 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:54.235358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:54.357052 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168e1e8-a204-4f7b-970b-ce75347ab421 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:54.363746 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3ffd2-abc2-4dd4-8097-787f5986a9a0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:54.400173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afa7fa-ee74-45e9-8030-f93737137a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:54.400912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afa7fa-ee74-45e9-8030-f93737137a21 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:54.401307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afa7fa-ee74-45e9-8030-f93737137a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:54.401676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afa7fa-ee74-45e9-8030-f93737137a21 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:54.402522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afa7fa-ee74-45e9-8030-f93737137a21 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:54.402926 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afa7fa-ee74-45e9-8030-f93737137a21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:54.404414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afa7fa-ee74-45e9-8030-f93737137a21 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:54.409433 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c237c-dbee-4574-b03a-6a3b0c3f570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:54.410120 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 414/826] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jun 7 21:48:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:54.410265 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c237c-dbee-4574-b03a-6a3b0c3f570e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:54.410483 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c237c-dbee-4574-b03a-6a3b0c3f570e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:54.410770 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c237c-dbee-4574-b03a-6a3b0c3f570e None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:54.411418 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afa7fa-ee74-45e9-8030-f93737137a21 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:54.411628 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c237c-dbee-4574-b03a-6a3b0c3f570e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:54.411969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c237c-dbee-4574-b03a-6a3b0c3f570e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:54.413392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c237c-dbee-4574-b03a-6a3b0c3f570e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:54.429284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 413/827] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:54.430241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c237c-dbee-4574-b03a-6a3b0c3f570e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:54.464260 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:54.521089 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:54.543870 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afa7fa-ee74-45e9-8030-f93737137a21 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:54.556417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c237c-dbee-4574-b03a-6a3b0c3f570e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:54.584185 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69113a-98be-416d-8d12-f58e1bd68a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:54.584865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69113a-98be-416d-8d12-f58e1bd68a3e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:54.585149 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69113a-98be-416d-8d12-f58e1bd68a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:54.585418 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69113a-98be-416d-8d12-f58e1bd68a3e None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:54.586233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69113a-98be-416d-8d12-f58e1bd68a3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:54.586630 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69113a-98be-416d-8d12-f58e1bd68a3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:54.588550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69113a-98be-416d-8d12-f58e1bd68a3e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:54.593106 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b7575-c7f7-4d06-9168-04cd313758e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:54.593767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b7575-c7f7-4d06-9168-04cd313758e0 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:54.594088 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b7575-c7f7-4d06-9168-04cd313758e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:54.594361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b7575-c7f7-4d06-9168-04cd313758e0 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:54.595046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b7575-c7f7-4d06-9168-04cd313758e0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:54.595811 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b7575-c7f7-4d06-9168-04cd313758e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:54.597611 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b7575-c7f7-4d06-9168-04cd313758e0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:54.600594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 415/828] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:54.601329 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69113a-98be-416d-8d12-f58e1bd68a3e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:54.612268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 414/829] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jun 7 21:48:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:54.612268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b7575-c7f7-4d06-9168-04cd313758e0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:54.709154 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:54.713059 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69113a-98be-416d-8d12-f58e1bd68a3e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:54.721969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b7575-c7f7-4d06-9168-04cd313758e0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:54.748469 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c9c8a-172e-4793-8105-5856acc68182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:54.749109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c9c8a-172e-4793-8105-5856acc68182 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:54.749383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c9c8a-172e-4793-8105-5856acc68182 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:54.749656 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c9c8a-172e-4793-8105-5856acc68182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:54.750506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c9c8a-172e-4793-8105-5856acc68182 None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=1d5760a3f9f946978b1251d3e2aaa943) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:54.750820 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c9c8a-172e-4793-8105-5856acc68182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:54.752236 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c9c8a-172e-4793-8105-5856acc68182 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:54.753747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:54.758546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 416/830] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:48:54 2022] GET /identity/v3/role_assignments?user.id=1d5760a3f9f946978b1251d3e2aaa943&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=8f58ef9d28494d97a68de20b84355450 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:54.759812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c9c8a-172e-4793-8105-5856acc68182 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:54.772131 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7ce2e-830d-46f2-b0fc-b25ec3f804db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:54.773052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7ce2e-830d-46f2-b0fc-b25ec3f804db None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:54.773340 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7ce2e-830d-46f2-b0fc-b25ec3f804db None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:54.773619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7ce2e-830d-46f2-b0fc-b25ec3f804db None admin] PATH_INFO: `/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/4fc55e3a9107489a9b24385ac5379ca9/roles/382652f08fc24ce39f91164181237006` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:54.792015 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7ce2e-830d-46f2-b0fc-b25ec3f804db None admin] RBAC: Authorizing `identity:create_grant(project_id=eca8f481deb242789622ebb10aa2c5da, user_id=4fc55e3a9107489a9b24385ac5379ca9, role_id=382652f08fc24ce39f91164181237006)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:54.793501 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7ce2e-830d-46f2-b0fc-b25ec3f804db None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:54.817961 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 415/831] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:48:54 2022] PUT /identity/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/4fc55e3a9107489a9b24385ac5379ca9/roles/382652f08fc24ce39f91164181237006 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:48:54.901190 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c9c8a-172e-4793-8105-5856acc68182 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:54.943211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df79c89-54d4-43d7-9640-5b939a32290b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:54.943892 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df79c89-54d4-43d7-9640-5b939a32290b None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:54.944175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df79c89-54d4-43d7-9640-5b939a32290b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:54.944450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df79c89-54d4-43d7-9640-5b939a32290b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:54.945211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df79c89-54d4-43d7-9640-5b939a32290b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:54.947244 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df79c89-54d4-43d7-9640-5b939a32290b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:54.974200 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 417/832] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 7 21:48:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:48:54.974531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe39749-aef8-4bb7-8912-5fcf31c39f2b None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:54.974879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe39749-aef8-4bb7-8912-5fcf31c39f2b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:54.975166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe39749-aef8-4bb7-8912-5fcf31c39f2b None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:54.977163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 416/833] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:54.983813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4d252-7cb0-4073-b384-12e70a788606 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:54.984169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4d252-7cb0-4073-b384-12e70a788606 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:54.984394 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4d252-7cb0-4073-b384-12e70a788606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:55.004986 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-77f4d252-7cb0-4073-b384-12e70a788606 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:55.006285 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-77f4d252-7cb0-4073-b384-12e70a788606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:55.026848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:55.101260 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 418/834] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:48:55.125727 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe39749-aef8-4bb7-8912-5fcf31c39f2b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:55.236725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe39749-aef8-4bb7-8912-5fcf31c39f2b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:55.272127 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d2968-1c33-4816-99fa-229a90ba372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:55.272915 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d2968-1c33-4816-99fa-229a90ba372f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:55.273193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d2968-1c33-4816-99fa-229a90ba372f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:55.273462 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d2968-1c33-4816-99fa-229a90ba372f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:55.283773 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d2968-1c33-4816-99fa-229a90ba372f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:55.291896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-579d2968-1c33-4816-99fa-229a90ba372f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:55.291896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:55.291896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:55.291896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:55.291896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:55.291896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:55.291896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:55.291896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:55.291896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:55.291896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:55.291896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:55.291896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:55.291896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:55.291896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:55.291896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:55.291896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:55.292797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:55.292797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:55.292797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:55.292797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:55.292797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:55.292797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:55.292797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:55.292797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:55.292797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:55.292797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:55.292797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:55.292797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:55.292797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:55.292797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:55.292797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:55.292797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:55.293624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:55.293624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:55.293624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:55.293624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:55.293624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:55.293624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:55.293624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:55.293624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:55.293624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:55.293624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:55.293624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:48:55.293624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:55.293624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 417/835] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:48:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:55.299169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4d252-7cb0-4073-b384-12e70a788606 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:55.406621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4d252-7cb0-4073-b384-12e70a788606 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:55.443784 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1337a26-dffa-4055-92be-4c72544adb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:55.444820 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1337a26-dffa-4055-92be-4c72544adb17 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:55.445307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1337a26-dffa-4055-92be-4c72544adb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:55.445796 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1337a26-dffa-4055-92be-4c72544adb17 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:55.446800 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1337a26-dffa-4055-92be-4c72544adb17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:55.447297 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1337a26-dffa-4055-92be-4c72544adb17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:55.448854 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1337a26-dffa-4055-92be-4c72544adb17 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:55.457788 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 419/836] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:48:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:55.463124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d2968-1c33-4816-99fa-229a90ba372f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:55.507421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:55.567339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d2968-1c33-4816-99fa-229a90ba372f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:55.602262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9813f8a-ba51-4e22-a7dc-01bb91e79854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:55.603585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9813f8a-ba51-4e22-a7dc-01bb91e79854 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:55.603869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9813f8a-ba51-4e22-a7dc-01bb91e79854 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:55.604146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9813f8a-ba51-4e22-a7dc-01bb91e79854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:55.615163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9813f8a-ba51-4e22-a7dc-01bb91e79854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:55.616632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9813f8a-ba51-4e22-a7dc-01bb91e79854 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:55.634763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-d9813f8a-ba51-4e22-a7dc-01bb91e79854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:55.634763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:55.634763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:55.634763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:55.634763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:55.634763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:55.634763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:55.634763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:55.634763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:55.634763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:55.634763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:55.634763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:55.634763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:55.634763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:55.634763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:55.635684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:55.635684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:55.635684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:55.635684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:55.635684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:55.635684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:55.635684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:55.635684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:55.635684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:55.635684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:55.635684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:55.635684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:55.635684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:55.635684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:55.635684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:55.635684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:55.635684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:55.636555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:55.636555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:55.636555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:55.636555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:55.636555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 418/837] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:55.641952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1337a26-dffa-4055-92be-4c72544adb17 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:55.654296 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:55.747591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1337a26-dffa-4055-92be-4c72544adb17 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:55.782083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5cb20-15b4-4495-bc1c-77e8b19cf893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:55.783073 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5cb20-15b4-4495-bc1c-77e8b19cf893 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:55.783549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5cb20-15b4-4495-bc1c-77e8b19cf893 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:55.784018 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5cb20-15b4-4495-bc1c-77e8b19cf893 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:55.784918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5cb20-15b4-4495-bc1c-77e8b19cf893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:55.785415 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5cb20-15b4-4495-bc1c-77e8b19cf893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:55.787030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5cb20-15b4-4495-bc1c-77e8b19cf893 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:55.799586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 420/838] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:55.805984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9813f8a-ba51-4e22-a7dc-01bb91e79854 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:55.899898 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:55.906978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9813f8a-ba51-4e22-a7dc-01bb91e79854 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:55.942789 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a59ead-a3aa-45ab-b871-3f52f8bde733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:55.943579 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59ead-a3aa-45ab-b871-3f52f8bde733 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:55.943864 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59ead-a3aa-45ab-b871-3f52f8bde733 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:55.944140 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59ead-a3aa-45ab-b871-3f52f8bde733 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:55.951784 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a59ead-a3aa-45ab-b871-3f52f8bde733 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:55.953215 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a59ead-a3aa-45ab-b871-3f52f8bde733 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:55.967725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-99a59ead-a3aa-45ab-b871-3f52f8bde733 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 21:48:55.967725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:55.967725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:55.967725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:55.967725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:55.967725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:55.967725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:55.967725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:55.967725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:55.967725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:55.967725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:55.967725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:55.967725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:55.967725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:55.967725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:55.967725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:55.968664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:55.969600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:55.969600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:55.969600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:55.969600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:55.969600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:55.969600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:55.969600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:55.969600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:55.969600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 21:48:55.969600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:55.969600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 419/839] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:48:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:55.974832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5cb20-15b4-4495-bc1c-77e8b19cf893 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:56.042843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:56.080008 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5cb20-15b4-4495-bc1c-77e8b19cf893 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:56.116836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ba1f9-343e-4935-87d4-0fe3e01f0933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:56.117506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ba1f9-343e-4935-87d4-0fe3e01f0933 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:56.117791 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ba1f9-343e-4935-87d4-0fe3e01f0933 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:56.118148 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ba1f9-343e-4935-87d4-0fe3e01f0933 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:56.118986 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ba1f9-343e-4935-87d4-0fe3e01f0933 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:56.119295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ba1f9-343e-4935-87d4-0fe3e01f0933 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:56.120758 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ba1f9-343e-4935-87d4-0fe3e01f0933 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:56.139177 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 421/840] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jun 7 21:48:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:56.147033 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a59ead-a3aa-45ab-b871-3f52f8bde733 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:56.252112 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a59ead-a3aa-45ab-b871-3f52f8bde733 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:56.286382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4324e6-fdfc-4aa4-bedc-62fe3c7fb86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:56.287030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4324e6-fdfc-4aa4-bedc-62fe3c7fb86f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:56.287313 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4324e6-fdfc-4aa4-bedc-62fe3c7fb86f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:56.287592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4324e6-fdfc-4aa4-bedc-62fe3c7fb86f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:56.311874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:56.357907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4324e6-fdfc-4aa4-bedc-62fe3c7fb86f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:56.359395 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4324e6-fdfc-4aa4-bedc-62fe3c7fb86f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:56.462285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 420/841] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:56 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:48:56.464140 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ba1f9-343e-4935-87d4-0fe3e01f0933 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:56.567813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ba1f9-343e-4935-87d4-0fe3e01f0933 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:56.595014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:56.605546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91475d5c-7769-4282-b915-bf85cbea5d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:56.606689 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91475d5c-7769-4282-b915-bf85cbea5d28 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:56.607230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91475d5c-7769-4282-b915-bf85cbea5d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:56.607711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91475d5c-7769-4282-b915-bf85cbea5d28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:56.618967 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91475d5c-7769-4282-b915-bf85cbea5d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:56.620672 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91475d5c-7769-4282-b915-bf85cbea5d28 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:56.638448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-91475d5c-7769-4282-b915-bf85cbea5d28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:56.638448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:56.638448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:56.638448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:56.638448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:56.638448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:56.638448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:56.638448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:56.638448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:56.638448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:56.638448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:56.638448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:56.638448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:56.638448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:56.638448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:56.639343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:56.639343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:56.639343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:56.639343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:56.639343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:56.639343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:56.639343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:56.639343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:56.639343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:56.639343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:56.639343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:56.639343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:56.639343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:56.639343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:56.639343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:56.639343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:56.639343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:56.640213 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:56.640213 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:56.640213 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:56.640213 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:56.642425 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 422/842] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:56.649971 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4324e6-fdfc-4aa4-bedc-62fe3c7fb86f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:56.703901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:56.750497 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4324e6-fdfc-4aa4-bedc-62fe3c7fb86f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:56.785362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889eeefa-9139-4493-9206-0662fa47ecd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:56.786062 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889eeefa-9139-4493-9206-0662fa47ecd4 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:56.786348 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889eeefa-9139-4493-9206-0662fa47ecd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:56.786623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889eeefa-9139-4493-9206-0662fa47ecd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:56.787350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889eeefa-9139-4493-9206-0662fa47ecd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:56.787658 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889eeefa-9139-4493-9206-0662fa47ecd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:56.789029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889eeefa-9139-4493-9206-0662fa47ecd4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:56.805799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 421/843] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:56.807278 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91475d5c-7769-4282-b915-bf85cbea5d28 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:56.909635 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91475d5c-7769-4282-b915-bf85cbea5d28 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:56.944276 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfb502-8ab3-4eba-8c64-0a3f40f73bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:56.945134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfb502-8ab3-4eba-8c64-0a3f40f73bef None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:56.945417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfb502-8ab3-4eba-8c64-0a3f40f73bef None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:56.945741 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfb502-8ab3-4eba-8c64-0a3f40f73bef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:56.953429 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfb502-8ab3-4eba-8c64-0a3f40f73bef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:56.954910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfb502-8ab3-4eba-8c64-0a3f40f73bef None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:56.969162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-91dfb502-8ab3-4eba-8c64-0a3f40f73bef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:56.969162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:56.969162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:56.969162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:56.969162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:56.969162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:56.969162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:56.969162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:56.969162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:56.969162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:56.969162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:56.969162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:56.969162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:56.969162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:56.969162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:56.970158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:56.970158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:56.970158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:56.970158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:56.970158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:56.970158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:56.970158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:56.970158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:56.970158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:56.970158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:56.970158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:56.970158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:56.970158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:56.970158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:56.970158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:56.970158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:56.970158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:56.971065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:56.971065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:56.971065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:56.971065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:56.971065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:56.971065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:56.971065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:56.971065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:56.975807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 423/844] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:56.977808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889eeefa-9139-4493-9206-0662fa47ecd4 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:57.091097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889eeefa-9139-4493-9206-0662fa47ecd4 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:57.107452 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:57.128151 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73c072-8d08-4380-bc89-854bff95cd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:57.128816 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73c072-8d08-4380-bc89-854bff95cd76 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:57.129098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73c072-8d08-4380-bc89-854bff95cd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:57.129372 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73c072-8d08-4380-bc89-854bff95cd76 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:57.130180 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73c072-8d08-4380-bc89-854bff95cd76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:57.130491 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73c072-8d08-4380-bc89-854bff95cd76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:57.131946 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73c072-8d08-4380-bc89-854bff95cd76 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:57.145207 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 422/845] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:57.151004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfb502-8ab3-4eba-8c64-0a3f40f73bef None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:57.192626 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:57.259761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfb502-8ab3-4eba-8c64-0a3f40f73bef None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:57.294818 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c3686-3a22-4703-8ebb-e7d7c9a56cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:57.295758 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c3686-3a22-4703-8ebb-e7d7c9a56cda None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:57.296181 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c3686-3a22-4703-8ebb-e7d7c9a56cda None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:57.296596 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c3686-3a22-4703-8ebb-e7d7c9a56cda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:57.297557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c3686-3a22-4703-8ebb-e7d7c9a56cda None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=a4b69c708fbc470aae3e3954e21a1e88) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:57.298088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c3686-3a22-4703-8ebb-e7d7c9a56cda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:57.299665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c3686-3a22-4703-8ebb-e7d7c9a56cda None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:57.306864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 424/846] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:48:57 2022] GET /identity/v3/role_assignments?user.id=a4b69c708fbc470aae3e3954e21a1e88&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=8f58ef9d28494d97a68de20b84355450 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:57.346314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0d914-0fbc-41bb-ab0a-32c0a1cfb2d7 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:57.346843 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0d914-0fbc-41bb-ab0a-32c0a1cfb2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:57.346843 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0d914-0fbc-41bb-ab0a-32c0a1cfb2d7 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:57.349225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd22b8-a2d8-4fbe-a209-722bee4c6ac8 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:57.349694 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd22b8-a2d8-4fbe-a209-722bee4c6ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:57.350147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd22b8-a2d8-4fbe-a209-722bee4c6ac8 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:57.352316 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 425/847] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:57.354701 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 423/848] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:57.358376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7815972-43bf-4891-a1d2-fc2623d1352f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:57.358911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7815972-43bf-4891-a1d2-fc2623d1352f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:57.359346 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7815972-43bf-4891-a1d2-fc2623d1352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:57.360009 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f249e8-8eec-4a55-9b77-b7900e4d806c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:57.361645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f249e8-8eec-4a55-9b77-b7900e4d806c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:57.362647 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f249e8-8eec-4a55-9b77-b7900e4d806c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:57.382562 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b7815972-43bf-4891-a1d2-fc2623d1352f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:57.383863 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b7815972-43bf-4891-a1d2-fc2623d1352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:57.389399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-05f249e8-8eec-4a55-9b77-b7900e4d806c None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:57.391017 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-05f249e8-8eec-4a55-9b77-b7900e4d806c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:57.460887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 426/849] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:48:57.467759 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b9d5e-970f-4ede-9eec-41a1f1bd0dc5 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:57.468183 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b9d5e-970f-4ede-9eec-41a1f1bd0dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:57.468554 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b9d5e-970f-4ede-9eec-41a1f1bd0dc5 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:57.469490 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 424/850] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 21:48:57.476874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0041f67-5dfa-4440-882b-a6bb67a5bb12 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:57.477197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 427/851] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:57 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:48:57.477737 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0041f67-5dfa-4440-882b-a6bb67a5bb12 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:57.478285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0041f67-5dfa-4440-882b-a6bb67a5bb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:57.487143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b9d5e-970f-4ede-9eec-41a1f1bd0dc5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:57.501690 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e0041f67-5dfa-4440-882b-a6bb67a5bb12 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:57.502926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e0041f67-5dfa-4440-882b-a6bb67a5bb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:57.523406 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:57.574928 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 425/852] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:48:57.576094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0041f67-5dfa-4440-882b-a6bb67a5bb12 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:57.612844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:57.613516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b9d5e-970f-4ede-9eec-41a1f1bd0dc5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:57.657698 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0ca72-1c33-43a5-8e1f-8658b02abb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:57.658542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0ca72-1c33-43a5-8e1f-8658b02abb93 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:57.658826 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0ca72-1c33-43a5-8e1f-8658b02abb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:57.659099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0ca72-1c33-43a5-8e1f-8658b02abb93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:57.672400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0ca72-1c33-43a5-8e1f-8658b02abb93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:48:57.683355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-9fb0ca72-1c33-43a5-8e1f-8658b02abb93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:57.683355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:57.683355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:57.683355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:57.683355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:57.683355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:57.683355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:57.683355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:57.683355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:57.683355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:57.683355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:57.683355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:57.683355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:48:57.683355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:48:57.683355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:48:57.683355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:48:57.684282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:48:57.684282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:48:57.684282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:48:57.684282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:48:57.684282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:57.684282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:57.684282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:57.684282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:57.684282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:57.684282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:57.684282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:57.684282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:57.684282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:57.684282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:57.684282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:57.684282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:57.690435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:57.690435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:57.690435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:57.690435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:57.690435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:48:57.690435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:48:57.690435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:48:57.690435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:48:57.690435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:48:57.690435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:48:57.690435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:48:57.690435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:57.691101 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0041f67-5dfa-4440-882b-a6bb67a5bb12 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:57.691258 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 428/853] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:48:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:57.691258 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0ca72-1c33-43a5-8e1f-8658b02abb93 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:57.720416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0ed48-17a8-446a-8888-b91405f42bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:57.721136 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0ed48-17a8-446a-8888-b91405f42bfe None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:57.721423 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0ed48-17a8-446a-8888-b91405f42bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:57.721701 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0ed48-17a8-446a-8888-b91405f42bfe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:57.722397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0ed48-17a8-446a-8888-b91405f42bfe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:57.723760 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0ed48-17a8-446a-8888-b91405f42bfe None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:57.736598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e3f0ed48-17a8-446a-8888-b91405f42bfe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 21:48:57.736598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:57.736598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:48:57.736598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:48:57.736598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:48:57.736598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:48:57.736598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:48:57.736598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:57.736598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 21:48:57.736598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:57.736598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:48:57.736598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:57.736598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:57.736598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:57.736598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:57.736598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:57.736598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:57.737587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:57.737587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:57.737587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:57.737587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:57.737587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:57.737587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:57.737587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:48:57.737587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:48:57.737587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:48:57.737587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:48:57.737587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:57.737587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:57.737587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:57.737587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:57.737587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:57.737587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:57.738810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:57.738810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:57.738810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:57.738810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:57.738810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:57.738810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:57.738810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:57.738810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:57.738810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:57.738810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:57.738810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:48:57.738810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:57.738810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 21:48:57.738810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:57.738810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 426/854] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:48:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:57.739601 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0ed48-17a8-446a-8888-b91405f42bfe None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:57.797402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:57.808722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0ca72-1c33-43a5-8e1f-8658b02abb93 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:57.837305 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:57.842442 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0ed48-17a8-446a-8888-b91405f42bfe None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:57.847617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdf8dd-a670-4cc7-83a8-e882dedbdff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:57.848428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdf8dd-a670-4cc7-83a8-e882dedbdff9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:57.848711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdf8dd-a670-4cc7-83a8-e882dedbdff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:57.848986 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdf8dd-a670-4cc7-83a8-e882dedbdff9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:57.849647 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fdf8dd-a670-4cc7-83a8-e882dedbdff9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:57.851313 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fdf8dd-a670-4cc7-83a8-e882dedbdff9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:57.863539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-e6fdf8dd-a670-4cc7-83a8-e882dedbdff9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 21:48:57.863539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:57.863539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:48:57.863539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:48:57.863539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:48:57.863539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:48:57.863539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:48:57.863539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:57.863539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 21:48:57.863539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:57.863539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:48:57.863539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:57.863539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:57.863539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:57.863539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:57.863539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:57.864467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:57.864467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:57.864467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:57.864467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:57.864467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:57.864467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:57.864467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:57.864467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:48:57.864467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:48:57.864467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:48:57.864467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:48:57.864467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:57.864467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:57.864467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:57.864467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:57.864467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:57.865288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:57.865288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:57.865288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:57.865288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:57.865288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:57.865288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:57.865288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:57.865288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:57.865288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:57.865288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:57.865288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:57.865288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:48:57.865288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:57.865288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 21:48:57.865288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:57.865288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 429/855] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Jun 7 21:48:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:57.866171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdf8dd-a670-4cc7-83a8-e882dedbdff9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:57.882092 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54347c70-8d78-4701-a5a0-c6ba7520133e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:57.882786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54347c70-8d78-4701-a5a0-c6ba7520133e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:57.883064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54347c70-8d78-4701-a5a0-c6ba7520133e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:57.883336 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54347c70-8d78-4701-a5a0-c6ba7520133e None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:57.884598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54347c70-8d78-4701-a5a0-c6ba7520133e None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:57.884898 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54347c70-8d78-4701-a5a0-c6ba7520133e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:57.886296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54347c70-8d78-4701-a5a0-c6ba7520133e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:57.898577 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 427/856] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:48:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:57.898577 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54347c70-8d78-4701-a5a0-c6ba7520133e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:57.973001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdf8dd-a670-4cc7-83a8-e882dedbdff9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:58.009882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95031232-5cba-4e48-8996-d9b8b8171457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:58.010171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95031232-5cba-4e48-8996-d9b8b8171457 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:58.010357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54347c70-8d78-4701-a5a0-c6ba7520133e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:58.010464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95031232-5cba-4e48-8996-d9b8b8171457 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:58.010646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95031232-5cba-4e48-8996-d9b8b8171457 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:58.011344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95031232-5cba-4e48-8996-d9b8b8171457 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:58.011647 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95031232-5cba-4e48-8996-d9b8b8171457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:58.013012 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95031232-5cba-4e48-8996-d9b8b8171457 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:58.017441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 430/857] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:48:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:58.018247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95031232-5cba-4e48-8996-d9b8b8171457 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:58.044550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:58.052162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3059f-805f-4fb9-971c-73fd267ff2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:58.052818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3059f-805f-4fb9-971c-73fd267ff2da None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:58.053095 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3059f-805f-4fb9-971c-73fd267ff2da None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:58.053362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3059f-805f-4fb9-971c-73fd267ff2da None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:58.054084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3059f-805f-4fb9-971c-73fd267ff2da None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:58.054396 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3059f-805f-4fb9-971c-73fd267ff2da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:58.055799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3059f-805f-4fb9-971c-73fd267ff2da None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:58.060389 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 428/858] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 7 21:48:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:58.063173 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3059f-805f-4fb9-971c-73fd267ff2da None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:58.089901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:58.133410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95031232-5cba-4e48-8996-d9b8b8171457 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:58.169674 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b903fd-f567-4a3e-aeda-261c3237c905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:58.170516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b903fd-f567-4a3e-aeda-261c3237c905 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:58.170797 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b903fd-f567-4a3e-aeda-261c3237c905 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:58.171068 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b903fd-f567-4a3e-aeda-261c3237c905 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:58.171168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3059f-805f-4fb9-971c-73fd267ff2da None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:58.182459 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b903fd-f567-4a3e-aeda-261c3237c905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:58.183887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b903fd-f567-4a3e-aeda-261c3237c905 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:58.200751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c3b903fd-f567-4a3e-aeda-261c3237c905 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:58.200751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:58.200751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:58.200751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:58.200751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:58.200751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:58.200751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:58.200751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:58.200751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:58.200751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:58.200751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:58.200751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:58.200751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:58.200751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:58.200751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:58.201816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:58.201816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:58.201816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:58.201816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:58.201816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:58.201816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:58.201816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:58.201816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:58.201816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:58.201816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:58.201816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:58.201816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:58.201816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:58.201816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:58.201816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:58.201816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:58.201816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:58.202774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:58.202774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:58.202774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:58.202774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:58.202774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 431/859] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:58.202774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b903fd-f567-4a3e-aeda-261c3237c905 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:58.209768 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889c843-9ae4-4b25-a824-826ee7f7d20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:58.210109 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889c843-9ae4-4b25-a824-826ee7f7d20c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:58.210391 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889c843-9ae4-4b25-a824-826ee7f7d20c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:58.210661 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889c843-9ae4-4b25-a824-826ee7f7d20c None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:58.212832 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889c843-9ae4-4b25-a824-826ee7f7d20c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:58.213137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889c843-9ae4-4b25-a824-826ee7f7d20c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:58.214530 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889c843-9ae4-4b25-a824-826ee7f7d20c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:58.219318 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 429/860] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:48:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:58.219929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889c843-9ae4-4b25-a824-826ee7f7d20c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:58.296299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:58.344837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:58.346014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b903fd-f567-4a3e-aeda-261c3237c905 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:58.361399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889c843-9ae4-4b25-a824-826ee7f7d20c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:58.404253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6a8af-3131-49f7-a366-b95db5911795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:58.404476 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6d541-7878-463a-bec6-0ede89061703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:58.405243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6d541-7878-463a-bec6-0ede89061703 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:58.405416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6a8af-3131-49f7-a366-b95db5911795 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:58.405711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6d541-7878-463a-bec6-0ede89061703 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:58.406045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6a8af-3131-49f7-a366-b95db5911795 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:58.406203 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6d541-7878-463a-bec6-0ede89061703 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:58.406586 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6a8af-3131-49f7-a366-b95db5911795 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:58.407115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6d541-7878-463a-bec6-0ede89061703 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:58.407568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6d541-7878-463a-bec6-0ede89061703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:58.407754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6a8af-3131-49f7-a366-b95db5911795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:58.408186 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6a8af-3131-49f7-a366-b95db5911795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:58.409228 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6d541-7878-463a-bec6-0ede89061703 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:58.409845 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6a8af-3131-49f7-a366-b95db5911795 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:58.420065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 432/861] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 7 21:48:58 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:58.427285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 430/862] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:58.432932 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6d541-7878-463a-bec6-0ede89061703 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:58.554279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6d541-7878-463a-bec6-0ede89061703 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:58.592126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0fa81-d1da-4495-80dc-85a5444e6640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:58.592965 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0fa81-d1da-4495-80dc-85a5444e6640 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:58.593243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0fa81-d1da-4495-80dc-85a5444e6640 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:58.593516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0fa81-d1da-4495-80dc-85a5444e6640 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:58.596915 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:58.608375 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0fa81-d1da-4495-80dc-85a5444e6640 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:58.609885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0fa81-d1da-4495-80dc-85a5444e6640 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:58.627165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-b9a0fa81-d1da-4495-80dc-85a5444e6640 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 21:48:58.627165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:58.627165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:58.627165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:58.627165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:58.627165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:58.627165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:58.627165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:58.627165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:58.627165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:58.627165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:58.627165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:58.627165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:48:58.627165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:48:58.627165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:48:58.627165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:58.628165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:58.629109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:58.629109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:58.629109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:48:58.629109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:48:58.629109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:48:58.629109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:48:58.629109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:48:58.629109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:48:58.629109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 21:48:58.629109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:58.629109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 433/863] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 7 21:48:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:58.636458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6a8af-3131-49f7-a366-b95db5911795 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:58.751910 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6a8af-3131-49f7-a366-b95db5911795 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:58.787644 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d436d4-41ad-4682-bd27-ee67fdb0b4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:58.788316 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d436d4-41ad-4682-bd27-ee67fdb0b4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:58.788597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d436d4-41ad-4682-bd27-ee67fdb0b4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:58.788875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d436d4-41ad-4682-bd27-ee67fdb0b4e2 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:58.789708 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d436d4-41ad-4682-bd27-ee67fdb0b4e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:58.790105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d436d4-41ad-4682-bd27-ee67fdb0b4e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:58.791559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d436d4-41ad-4682-bd27-ee67fdb0b4e2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:58.810124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 431/864] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jun 7 21:48:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:58.815692 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0fa81-d1da-4495-80dc-85a5444e6640 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:58.917163 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0fa81-d1da-4495-80dc-85a5444e6640 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:58.951111 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3706c8-7bbf-424e-b267-005e6ae5c747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:58.952096 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3706c8-7bbf-424e-b267-005e6ae5c747 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:58.952573 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3706c8-7bbf-424e-b267-005e6ae5c747 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:58.953038 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3706c8-7bbf-424e-b267-005e6ae5c747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:59.020378 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:59.027388 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3706c8-7bbf-424e-b267-005e6ae5c747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:59.028906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3706c8-7bbf-424e-b267-005e6ae5c747 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:59.130825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 434/865] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:48:58 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:48:59.137018 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d436d4-41ad-4682-bd27-ee67fdb0b4e2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:59.151274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:59.247432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d436d4-41ad-4682-bd27-ee67fdb0b4e2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:59.289018 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252b10d-2a81-434b-95bc-20e2451e5894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:59.290280 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252b10d-2a81-434b-95bc-20e2451e5894 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:59.290791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252b10d-2a81-434b-95bc-20e2451e5894 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:59.291286 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252b10d-2a81-434b-95bc-20e2451e5894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:59.302802 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252b10d-2a81-434b-95bc-20e2451e5894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:59.304582 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252b10d-2a81-434b-95bc-20e2451e5894 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:59.323382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-f252b10d-2a81-434b-95bc-20e2451e5894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:59.323382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:59.323382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:59.323382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:59.323382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:59.323382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:59.323382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:59.323382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:59.323382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:59.323382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:59.323382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:59.323382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:59.323382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:48:59.323382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:48:59.323382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:48:59.324282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:48:59.324282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:59.324282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:59.324282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:59.324282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:59.324282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:59.324282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:59.324282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:59.324282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:59.324282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:59.324282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:59.324282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:59.324282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:59.324282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:59.324282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:59.324282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:59.324282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:59.325158 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:48:59.325158 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:48:59.325158 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:48:59.325158 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:59.327364 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 432/866] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:48:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:59.333061 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3706c8-7bbf-424e-b267-005e6ae5c747 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:59.438171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3706c8-7bbf-424e-b267-005e6ae5c747 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:59.442303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:59.474253 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69362534-8f99-46be-aeee-f26bf6843649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:59.474913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69362534-8f99-46be-aeee-f26bf6843649 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:59.475189 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69362534-8f99-46be-aeee-f26bf6843649 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:59.475717 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69362534-8f99-46be-aeee-f26bf6843649 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:59.476431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69362534-8f99-46be-aeee-f26bf6843649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:59.476732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69362534-8f99-46be-aeee-f26bf6843649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:59.478683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69362534-8f99-46be-aeee-f26bf6843649 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:59.490734 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 435/867] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:59.496258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252b10d-2a81-434b-95bc-20e2451e5894 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:59.557755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:59.603285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252b10d-2a81-434b-95bc-20e2451e5894 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:59.604871 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f431d8-e687-4535-8a5c-9fca26be614f None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:59.605156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f431d8-e687-4535-8a5c-9fca26be614f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:59.605427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f431d8-e687-4535-8a5c-9fca26be614f None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:59.607337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 436/868] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:48:59.614550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bd088-9e87-42f9-b9df-56762c44a5bb None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:59.614957 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bd088-9e87-42f9-b9df-56762c44a5bb None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:59.615332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bd088-9e87-42f9-b9df-56762c44a5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:59.635186 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-132bd088-9e87-42f9-b9df-56762c44a5bb None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:48:59.636757 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-132bd088-9e87-42f9-b9df-56762c44a5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:48:59.647893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8686248-fe12-41a8-b724-0455ddadfab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:59.649017 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8686248-fe12-41a8-b724-0455ddadfab8 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:59.649329 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8686248-fe12-41a8-b724-0455ddadfab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:59.649608 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8686248-fe12-41a8-b724-0455ddadfab8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:59.658767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8686248-fe12-41a8-b724-0455ddadfab8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:59.660239 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8686248-fe12-41a8-b724-0455ddadfab8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:59.681019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-d8686248-fe12-41a8-b724-0455ddadfab8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:59.681019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:59.681019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:59.681019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:59.681019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:59.681019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:59.681019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:59.681019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:59.681019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:59.681019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:59.681019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:59.681019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:59.681019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:48:59.681019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:48:59.681019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:48:59.682046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:48:59.682046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:59.682046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:59.682046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:59.682046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:59.682046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:59.682046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:59.682046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:59.682046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:59.682046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:59.682046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:59.682046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:59.682046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:59.682046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:59.682046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:59.682046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:59.682046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:59.682965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:48:59.682965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:48:59.682965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:48:59.682965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:48:59.682965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:48:59.682965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:48:59.682965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:48:59.682965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:48:59.687357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 433/869] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:48:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:48:59.688244 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8686248-fe12-41a8-b724-0455ddadfab8 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:59.716239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 437/870] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:48:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:48:59.742273 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bd088-9e87-42f9-b9df-56762c44a5bb None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:59.815010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8686248-fe12-41a8-b724-0455ddadfab8 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:59.836096 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:59.837062 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:48:59.856577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bd088-9e87-42f9-b9df-56762c44a5bb None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:48:59.858168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000e527-d2f0-46d8-a533-32f37738152b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:59.858989 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000e527-d2f0-46d8-a533-32f37738152b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:59.859274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000e527-d2f0-46d8-a533-32f37738152b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:59.859549 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000e527-d2f0-46d8-a533-32f37738152b None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:59.861104 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000e527-d2f0-46d8-a533-32f37738152b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:48:59.861421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000e527-d2f0-46d8-a533-32f37738152b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:59.862937 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000e527-d2f0-46d8-a533-32f37738152b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:59.877961 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 434/871] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:48:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:48:59.884239 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000e527-d2f0-46d8-a533-32f37738152b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:48:59.903459 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9052833-afee-41b1-8666-6ce6d75e49bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:48:59.904417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9052833-afee-41b1-8666-6ce6d75e49bd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:48:59.904705 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9052833-afee-41b1-8666-6ce6d75e49bd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:48:59.905033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9052833-afee-41b1-8666-6ce6d75e49bd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:48:59.905778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9052833-afee-41b1-8666-6ce6d75e49bd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:48:59.907121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9052833-afee-41b1-8666-6ce6d75e49bd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:48:59.926675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-a9052833-afee-41b1-8666-6ce6d75e49bd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 21:48:59.926675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:59.926675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:48:59.926675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:48:59.926675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:48:59.926675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:48:59.926675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:48:59.926675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:59.926675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 21:48:59.926675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:59.926675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:48:59.926675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:59.926675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:48:59.926675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:48:59.926675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:48:59.926675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:48:59.926675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:48:59.927663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:48:59.927663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:48:59.927663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:48:59.927663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:48:59.927663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:48:59.927663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:48:59.927663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:48:59.927663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:48:59.927663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:48:59.927663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:48:59.927663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:48:59.927663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:48:59.927663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:48:59.927663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:48:59.927663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:48:59.927663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:48:59.928559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:48:59.928559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:48:59.928559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:48:59.928559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:48:59.928559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:48:59.928559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:48:59.928559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:48:59.928559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:48:59.928559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:48:59.928559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:48:59.928559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:48:59.928559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:48:59.928559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 21:48:59.928559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:48:59.937314 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 438/872] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 7 21:48:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:48:59.938777 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9052833-afee-41b1-8666-6ce6d75e49bd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:00.000685 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000e527-d2f0-46d8-a533-32f37738152b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:00.037240 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55491df-352b-4abb-ab64-87a6928a08e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:00.037899 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55491df-352b-4abb-ab64-87a6928a08e4 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:00.038222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55491df-352b-4abb-ab64-87a6928a08e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:00.038502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55491df-352b-4abb-ab64-87a6928a08e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:00.039334 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55491df-352b-4abb-ab64-87a6928a08e4 None admin] RBAC: Adding query filter params (role.id=382652f08fc24ce39f91164181237006, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=4fc55e3a9107489a9b24385ac5379ca9) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:00.039647 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55491df-352b-4abb-ab64-87a6928a08e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:00.041606 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55491df-352b-4abb-ab64-87a6928a08e4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:00.054119 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 435/873] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:48:59 2022] GET /identity/v3/role_assignments?user.id=4fc55e3a9107489a9b24385ac5379ca9&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=382652f08fc24ce39f91164181237006 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:00.073389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9052833-afee-41b1-8666-6ce6d75e49bd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:00.114595 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b93f64-8ca3-4378-a72e-9be0f654e758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:00.115666 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b93f64-8ca3-4378-a72e-9be0f654e758 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:00.116143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b93f64-8ca3-4378-a72e-9be0f654e758 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:00.116641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b93f64-8ca3-4378-a72e-9be0f654e758 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:00.117581 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b93f64-8ca3-4378-a72e-9be0f654e758 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:00.118187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b93f64-8ca3-4378-a72e-9be0f654e758 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:00.119819 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b93f64-8ca3-4378-a72e-9be0f654e758 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:00.126238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 439/874] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 7 21:48:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:00.131918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55491df-352b-4abb-ab64-87a6928a08e4 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:00.181699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:00.252343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55491df-352b-4abb-ab64-87a6928a08e4 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:00.292405 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466cc17-3151-4f9e-898d-937a69acdbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:00.293067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466cc17-3151-4f9e-898d-937a69acdbff None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:00.293350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466cc17-3151-4f9e-898d-937a69acdbff None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:00.293626 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466cc17-3151-4f9e-898d-937a69acdbff None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:00.294362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466cc17-3151-4f9e-898d-937a69acdbff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:00.294672 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466cc17-3151-4f9e-898d-937a69acdbff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:00.296053 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466cc17-3151-4f9e-898d-937a69acdbff None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:00.302078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 436/875] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 7 21:49:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:00.579262 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db8eaa-9453-4f39-8640-c1133d1a66fa None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:00.579562 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db8eaa-9453-4f39-8640-c1133d1a66fa None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:00.579832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db8eaa-9453-4f39-8640-c1133d1a66fa None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:00.581607 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 440/876] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:00.587485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42601125-a1bb-416a-bb0c-0830acea6f83 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:00.587974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42601125-a1bb-416a-bb0c-0830acea6f83 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:00.588057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42601125-a1bb-416a-bb0c-0830acea6f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:00.606173 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-42601125-a1bb-416a-bb0c-0830acea6f83 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:00.607362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-42601125-a1bb-416a-bb0c-0830acea6f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:00.682591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 437/877] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:00.705597 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db8eaa-9453-4f39-8640-c1133d1a66fa None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:00.722920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:00.814742 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db8eaa-9453-4f39-8640-c1133d1a66fa None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:00.838912 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1038557-b9a6-4486-b276-c67b938b062a None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:00.839522 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1038557-b9a6-4486-b276-c67b938b062a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:00.840129 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1038557-b9a6-4486-b276-c67b938b062a None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:00.842602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 438/878] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:49:00.848023 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dfc7e-4de0-4318-8c4c-b40d88ad8af2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:00.848578 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dfc7e-4de0-4318-8c4c-b40d88ad8af2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:00.849053 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dfc7e-4de0-4318-8c4c-b40d88ad8af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:00.855998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93906a-53d6-4acc-98dd-5d6fa8ac23ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:00.856722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93906a-53d6-4acc-98dd-5d6fa8ac23ac None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:00.857014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93906a-53d6-4acc-98dd-5d6fa8ac23ac None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:00.857329 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93906a-53d6-4acc-98dd-5d6fa8ac23ac None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:00.858362 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93906a-53d6-4acc-98dd-5d6fa8ac23ac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:00.859578 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93906a-53d6-4acc-98dd-5d6fa8ac23ac None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:00.869441 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-663dfc7e-4de0-4318-8c4c-b40d88ad8af2 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:00.871060 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-663dfc7e-4de0-4318-8c4c-b40d88ad8af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:00.876243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 441/879] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 7 21:49:00 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:49:00.915312 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:00.958921 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 439/880] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:00 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:00.983827 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93906a-53d6-4acc-98dd-5d6fa8ac23ac None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:01.073654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:01.101945 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93906a-53d6-4acc-98dd-5d6fa8ac23ac None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:01.142258 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea0afa-15d9-42a0-8696-5975d09ade7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:01.142993 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea0afa-15d9-42a0-8696-5975d09ade7b None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:01.143273 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea0afa-15d9-42a0-8696-5975d09ade7b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:01.143534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea0afa-15d9-42a0-8696-5975d09ade7b None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:01.144316 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea0afa-15d9-42a0-8696-5975d09ade7b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:01.145680 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea0afa-15d9-42a0-8696-5975d09ade7b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:01.159444 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 442/881] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 7 21:49:00 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:49:02.469309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f02d4-8c03-4b3a-b4fe-292279e0d1d9 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:02.470306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f02d4-8c03-4b3a-b4fe-292279e0d1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:02.470806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f02d4-8c03-4b3a-b4fe-292279e0d1d9 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:02.472645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 440/882] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:02.479029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45881b-d321-4b2a-961e-58a69e251cbb None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:02.479835 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45881b-d321-4b2a-961e-58a69e251cbb None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:02.480322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45881b-d321-4b2a-961e-58a69e251cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:02.497440 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-6d45881b-d321-4b2a-961e-58a69e251cbb None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:02.498929 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6d45881b-d321-4b2a-961e-58a69e251cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:02.572694 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 443/883] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:02.596660 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f02d4-8c03-4b3a-b4fe-292279e0d1d9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:02.601865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30730c50-77a0-417c-87a7-2772fa7d8afd None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:02.602255 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30730c50-77a0-417c-87a7-2772fa7d8afd None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:02.602549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30730c50-77a0-417c-87a7-2772fa7d8afd None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:02.604147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 444/884] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:02.608951 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bcbbc-b73a-4a0e-b257-d77e55b7a120 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:02.609245 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bcbbc-b73a-4a0e-b257-d77e55b7a120 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:02.609523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bcbbc-b73a-4a0e-b257-d77e55b7a120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:02.626597 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-612bcbbc-b73a-4a0e-b257-d77e55b7a120 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:02.627708 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-612bcbbc-b73a-4a0e-b257-d77e55b7a120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:02.686961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:02.701693 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 445/885] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 21:49:02.706782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f02d4-8c03-4b3a-b4fe-292279e0d1d9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:02.725134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bcbbc-b73a-4a0e-b257-d77e55b7a120 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:02.744588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa5c92-bb81-49ce-b07b-a52cfeeeefee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:02.745700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa5c92-bb81-49ce-b07b-a52cfeeeefee None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:02.746179 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa5c92-bb81-49ce-b07b-a52cfeeeefee None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:02.746614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa5c92-bb81-49ce-b07b-a52cfeeeefee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:02.758053 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa5c92-bb81-49ce-b07b-a52cfeeeefee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:49:02.767420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-cfaa5c92-bb81-49ce-b07b-a52cfeeeefee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 21:49:02.767420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:02.767420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:02.767420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:02.767420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:02.767420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:02.767420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:02.767420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:02.767420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:02.767420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:02.767420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:02.767420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:02.767420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:49:02.767420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:49:02.767420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:49:02.767420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:49:02.768499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:49:02.768499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:49:02.768499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:49:02.768499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:49:02.768499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:02.768499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:02.768499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:02.768499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:02.768499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:02.768499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:02.768499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:02.768499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:02.768499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:02.768499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:02.768499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:02.768499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:02.769379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:02.769379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:02.769379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:02.769379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:02.769379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:49:02.769379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:49:02.769379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:49:02.769379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:49:02.769379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:49:02.769379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:49:02.769379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 21:49:02.769379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:02.772275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 441/886] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jun 7 21:49:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:02.777864 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa5c92-bb81-49ce-b07b-a52cfeeeefee None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:02.804813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:02.849042 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bcbbc-b73a-4a0e-b257-d77e55b7a120 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:02.886688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac1bc2-1432-4f00-a267-1f213f4488fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:02.887649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac1bc2-1432-4f00-a267-1f213f4488fd None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:02.888110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac1bc2-1432-4f00-a267-1f213f4488fd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:02.888570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac1bc2-1432-4f00-a267-1f213f4488fd None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:02.889493 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac1bc2-1432-4f00-a267-1f213f4488fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:02.891114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac1bc2-1432-4f00-a267-1f213f4488fd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:02.898761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa5c92-bb81-49ce-b07b-a52cfeeeefee None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:02.913098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 446/887] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 7 21:49:02 2022] POST /identity/v3/services => generated 241 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 21:49:02.953696 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b7ddc-89e6-414a-a582-ec19b6aa3219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:02.954718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b7ddc-89e6-414a-a582-ec19b6aa3219 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:02.955174 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b7ddc-89e6-414a-a582-ec19b6aa3219 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:02.955611 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b7ddc-89e6-414a-a582-ec19b6aa3219 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:02.956571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b7ddc-89e6-414a-a582-ec19b6aa3219 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:02.957102 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b7ddc-89e6-414a-a582-ec19b6aa3219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:02.958821 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b7ddc-89e6-414a-a582-ec19b6aa3219 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:02.970422 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 442/888] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jun 7 21:49:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:02.977266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac1bc2-1432-4f00-a267-1f213f4488fd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:03.038211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:03.097886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac1bc2-1432-4f00-a267-1f213f4488fd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:03.138809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcc234-86de-451b-a270-06dfd07b1aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:03.139867 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcc234-86de-451b-a270-06dfd07b1aad None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:03.140143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcc234-86de-451b-a270-06dfd07b1aad None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:03.140412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcc234-86de-451b-a270-06dfd07b1aad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:03.151766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcc234-86de-451b-a270-06dfd07b1aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:03.153378 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcc234-86de-451b-a270-06dfd07b1aad None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:03.173912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-ffdcc234-86de-451b-a270-06dfd07b1aad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:03.173912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:03.173912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:03.173912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:03.173912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:03.173912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:03.173912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:03.173912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:03.173912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:03.173912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:03.173912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:03.173912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:03.173912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:49:03.173912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:49:03.173912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:49:03.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:49:03.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:03.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:03.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:03.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:03.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:03.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:03.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:03.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:03.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:03.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:03.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:03.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:03.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:03.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:03.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:03.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:03.175862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:49:03.175862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:49:03.175862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:03.175862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:03.175862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 447/889] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:03.181991 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b7ddc-89e6-414a-a582-ec19b6aa3219 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:03.267496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:03.288289 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b7ddc-89e6-414a-a582-ec19b6aa3219 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:03.324376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2cd87-e52a-4629-b20e-ccc129dc3419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:03.325045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2cd87-e52a-4629-b20e-ccc129dc3419 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:03.325327 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2cd87-e52a-4629-b20e-ccc129dc3419 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:03.325600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2cd87-e52a-4629-b20e-ccc129dc3419 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:03.326345 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2cd87-e52a-4629-b20e-ccc129dc3419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:03.326648 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2cd87-e52a-4629-b20e-ccc129dc3419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:03.328014 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2cd87-e52a-4629-b20e-ccc129dc3419 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:03.339953 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a41ed-e000-424e-8c4f-5be9f2ee9f7f None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:03.340274 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a41ed-e000-424e-8c4f-5be9f2ee9f7f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:03.340839 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a41ed-e000-424e-8c4f-5be9f2ee9f7f None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:03.342452 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 448/890] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:03.343426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 443/891] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:03.354791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2cd87-e52a-4629-b20e-ccc129dc3419 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:03.355298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443ea69-5981-485c-8418-7f7c3385324e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:03.355687 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443ea69-5981-485c-8418-7f7c3385324e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:03.356171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443ea69-5981-485c-8418-7f7c3385324e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:03.382855 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3443ea69-5981-485c-8418-7f7c3385324e None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:03.384594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3443ea69-5981-485c-8418-7f7c3385324e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:03.462226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 449/892] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:03.480868 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443ea69-5981-485c-8418-7f7c3385324e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:03.488501 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2cd87-e52a-4629-b20e-ccc129dc3419 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:03.515119 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:03.526422 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d118e6-7c09-4ba7-b05f-074223809096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:03.527314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d118e6-7c09-4ba7-b05f-074223809096 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:03.527597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d118e6-7c09-4ba7-b05f-074223809096 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:03.527872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d118e6-7c09-4ba7-b05f-074223809096 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:03.536808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d118e6-7c09-4ba7-b05f-074223809096 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:03.538292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d118e6-7c09-4ba7-b05f-074223809096 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:03.542484 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:03.561071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-80d118e6-7c09-4ba7-b05f-074223809096 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 21:49:03.561071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:03.561071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:03.561071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:03.561071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:03.561071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:03.561071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:03.561071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:03.561071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:03.561071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:03.561071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:03.561071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:03.561071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:49:03.561071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:49:03.561071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:49:03.561071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:03.562322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:03.563282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:03.563282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:03.563282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:49:03.563282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:49:03.563282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:49:03.563282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:49:03.563282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:49:03.563282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:49:03.563282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 21:49:03.563282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:03.564472 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 444/893] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 7 21:49:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:03.565765 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade33cfb-cf01-4dff-8194-31332e95a64e None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:03.566084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade33cfb-cf01-4dff-8194-31332e95a64e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:03.566360 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade33cfb-cf01-4dff-8194-31332e95a64e None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:03.572250 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 445/894] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:03.572250 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade33cfb-cf01-4dff-8194-31332e95a64e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:03.594476 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443ea69-5981-485c-8418-7f7c3385324e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:03.629810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218417b4-7525-4201-ba81-bd6aba39b5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:03.630639 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218417b4-7525-4201-ba81-bd6aba39b5bd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:03.630921 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218417b4-7525-4201-ba81-bd6aba39b5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:03.631189 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218417b4-7525-4201-ba81-bd6aba39b5bd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:03.631833 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218417b4-7525-4201-ba81-bd6aba39b5bd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:03.633196 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218417b4-7525-4201-ba81-bd6aba39b5bd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:03.645386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-218417b4-7525-4201-ba81-bd6aba39b5bd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 21:49:03.645386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:03.645386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:49:03.645386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:49:03.645386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:49:03.645386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:49:03.645386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:49:03.645386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:03.645386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 21:49:03.645386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:03.645386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:49:03.645386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:03.645386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:03.645386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:03.645386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:03.645386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:03.645386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:03.646646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:03.646646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:03.646646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:03.646646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:03.646646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:03.646646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:03.646646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:49:03.646646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:49:03.646646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:49:03.646646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:49:03.646646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:03.646646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:03.646646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:03.646646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:03.646646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:03.646646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:03.647532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:03.647532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:03.647532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:03.647532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:03.647532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:03.647532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:03.647532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:03.647532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:03.647532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:03.647532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:03.647532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:49:03.647532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:03.647532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 21:49:03.647532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:03.651567 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 450/895] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:49:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:03.652926 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0904f84-882b-4c72-8b07-6a5e85e287e7 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:03.653215 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0904f84-882b-4c72-8b07-6a5e85e287e7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:03.653482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0904f84-882b-4c72-8b07-6a5e85e287e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:03.670095 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-a0904f84-882b-4c72-8b07-6a5e85e287e7 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:03.671268 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a0904f84-882b-4c72-8b07-6a5e85e287e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:03.683423 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade33cfb-cf01-4dff-8194-31332e95a64e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:03.719647 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c0d8c-ccea-41e2-9712-c6f9c2c931ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:03.720233 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c0d8c-ccea-41e2-9712-c6f9c2c931ad None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:03.720510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c0d8c-ccea-41e2-9712-c6f9c2c931ad None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:03.720807 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c0d8c-ccea-41e2-9712-c6f9c2c931ad None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:03.721643 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c0d8c-ccea-41e2-9712-c6f9c2c931ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:03.721978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c0d8c-ccea-41e2-9712-c6f9c2c931ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:03.723414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c0d8c-ccea-41e2-9712-c6f9c2c931ad None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:03.748771 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 451/896] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:03.748771 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0904f84-882b-4c72-8b07-6a5e85e287e7 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:03.760725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 446/897] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jun 7 21:49:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:03.762259 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c0d8c-ccea-41e2-9712-c6f9c2c931ad None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:03.779627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:03.823251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:03.865098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0904f84-882b-4c72-8b07-6a5e85e287e7 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:03.866377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c0d8c-ccea-41e2-9712-c6f9c2c931ad None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:03.900694 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5c56b-29d9-4571-abc8-b47b01fe10ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:03.901342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5c56b-29d9-4571-abc8-b47b01fe10ef None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:03.901619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5c56b-29d9-4571-abc8-b47b01fe10ef None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:03.901719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed7102-8862-498c-aab8-07c28af96faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:03.901961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5c56b-29d9-4571-abc8-b47b01fe10ef None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:03.902278 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed7102-8862-498c-aab8-07c28af96faf None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:03.902567 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed7102-8862-498c-aab8-07c28af96faf None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:03.902670 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5c56b-29d9-4571-abc8-b47b01fe10ef None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:03.902843 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed7102-8862-498c-aab8-07c28af96faf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:03.902943 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5c56b-29d9-4571-abc8-b47b01fe10ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:03.904292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5c56b-29d9-4571-abc8-b47b01fe10ef None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:03.911854 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 452/898] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:49:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:03.912866 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5c56b-29d9-4571-abc8-b47b01fe10ef None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:03.979544 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed7102-8862-498c-aab8-07c28af96faf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:03.981383 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed7102-8862-498c-aab8-07c28af96faf None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:04.001874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:04.016207 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5c56b-29d9-4571-abc8-b47b01fe10ef None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:04.044685 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:04.057072 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df9bb8-d83d-4d38-a0fa-f1205a7ab7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:04.057887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df9bb8-d83d-4d38-a0fa-f1205a7ab7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:04.058192 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df9bb8-d83d-4d38-a0fa-f1205a7ab7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:04.058465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df9bb8-d83d-4d38-a0fa-f1205a7ab7f7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:04.059109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df9bb8-d83d-4d38-a0fa-f1205a7ab7f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:04.060487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df9bb8-d83d-4d38-a0fa-f1205a7ab7f7 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:04.073497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c4df9bb8-d83d-4d38-a0fa-f1205a7ab7f7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 21:49:04.073497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:04.073497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:49:04.073497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:49:04.073497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:49:04.073497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:49:04.073497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:49:04.073497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:04.073497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 21:49:04.073497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:04.073497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:49:04.073497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:04.073497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:04.073497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:04.073497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:04.073497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:04.074620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:04.074620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:04.074620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:04.074620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:04.074620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:04.074620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:04.074620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:04.074620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:49:04.074620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:49:04.074620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:49:04.074620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:49:04.074620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:04.074620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:04.074620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:04.074620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:04.074620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:04.075463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:04.075463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:04.075463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:04.075463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:04.075463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:04.075463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:04.075463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:04.075463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:04.075463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:04.075463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:04.075463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:04.075463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:49:04.075463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:04.075463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 21:49:04.075463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:04.075463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 453/899] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Jun 7 21:49:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:04.076331 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df9bb8-d83d-4d38-a0fa-f1205a7ab7f7 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:04.097818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 447/900] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:49:03 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:49:04.103598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed7102-8862-498c-aab8-07c28af96faf None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:04.188333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df9bb8-d83d-4d38-a0fa-f1205a7ab7f7 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:04.207228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed7102-8862-498c-aab8-07c28af96faf None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:04.224043 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88740b74-5b37-485b-885e-e3bc4a100d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:04.224999 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88740b74-5b37-485b-885e-e3bc4a100d71 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:04.225700 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88740b74-5b37-485b-885e-e3bc4a100d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:04.226163 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88740b74-5b37-485b-885e-e3bc4a100d71 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:04.227011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88740b74-5b37-485b-885e-e3bc4a100d71 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:04.227987 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88740b74-5b37-485b-885e-e3bc4a100d71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:04.229502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88740b74-5b37-485b-885e-e3bc4a100d71 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:04.234636 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 454/901] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:49:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:04.235382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88740b74-5b37-485b-885e-e3bc4a100d71 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:04.248639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14241d1f-1994-43dc-a40c-9c7defe0948e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:04.249551 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14241d1f-1994-43dc-a40c-9c7defe0948e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:04.250006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14241d1f-1994-43dc-a40c-9c7defe0948e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:04.250436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14241d1f-1994-43dc-a40c-9c7defe0948e None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:04.251294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14241d1f-1994-43dc-a40c-9c7defe0948e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:04.251739 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14241d1f-1994-43dc-a40c-9c7defe0948e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:04.253311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14241d1f-1994-43dc-a40c-9c7defe0948e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:04.255865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:04.264451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 448/902] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 7 21:49:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:04.264451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14241d1f-1994-43dc-a40c-9c7defe0948e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:04.290739 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:04.351479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88740b74-5b37-485b-885e-e3bc4a100d71 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:04.375149 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14241d1f-1994-43dc-a40c-9c7defe0948e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:04.393443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b9867-0cb8-4dfd-aa0a-bf8b12af6254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:04.394257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b9867-0cb8-4dfd-aa0a-bf8b12af6254 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:04.394537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b9867-0cb8-4dfd-aa0a-bf8b12af6254 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:04.394808 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b9867-0cb8-4dfd-aa0a-bf8b12af6254 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:04.406027 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b9867-0cb8-4dfd-aa0a-bf8b12af6254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:04.407445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b9867-0cb8-4dfd-aa0a-bf8b12af6254 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:04.411135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a2b29-53f7-4a80-9ca2-5128586e97c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:04.411816 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a2b29-53f7-4a80-9ca2-5128586e97c2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:04.412093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a2b29-53f7-4a80-9ca2-5128586e97c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:04.412365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a2b29-53f7-4a80-9ca2-5128586e97c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:04.413146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a2b29-53f7-4a80-9ca2-5128586e97c2 None admin] RBAC: Adding query filter params (interface=public, service_id=fb5872e4f90c449bb1447f3dff6dc5cf, region_id=RegionOne) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:04.413838 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a2b29-53f7-4a80-9ca2-5128586e97c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:04.415663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a2b29-53f7-4a80-9ca2-5128586e97c2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:04.420906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 449/903] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jun 7 21:49:04 2022] GET /identity/v3/endpoints?service_id=fb5872e4f90c449bb1447f3dff6dc5cf&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:04.422827 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a2b29-53f7-4a80-9ca2-5128586e97c2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:04.424171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-703b9867-0cb8-4dfd-aa0a-bf8b12af6254 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:04.424171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:04.424171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:04.424171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:04.424171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:04.424171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:04.424171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:04.424171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:04.424171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:04.424171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:04.424171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:04.424171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:04.424171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:49:04.424171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:49:04.424171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:49:04.425041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:49:04.425041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:04.425041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:04.425041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:04.425041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:04.425041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:04.425041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:04.425041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:04.425041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:04.425041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:04.425041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:04.425041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:04.425041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:04.425041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:04.425041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:04.425041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:04.425041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:04.426336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:49:04.426336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:49:04.426336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:04.426336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:04.429813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 455/904] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:04.431167 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b9867-0cb8-4dfd-aa0a-bf8b12af6254 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:04.502756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:04.517815 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:04.534780 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a2b29-53f7-4a80-9ca2-5128586e97c2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:04.536180 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b9867-0cb8-4dfd-aa0a-bf8b12af6254 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:04.570178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab080582-f9e4-4d4e-ae59-cdf05e25e3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:04.570702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412e607-6e52-4c34-bf95-d82d51e95cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:04.570856 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab080582-f9e4-4d4e-ae59-cdf05e25e3fe None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:04.571156 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab080582-f9e4-4d4e-ae59-cdf05e25e3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:04.571406 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412e607-6e52-4c34-bf95-d82d51e95cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:04.571511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab080582-f9e4-4d4e-ae59-cdf05e25e3fe None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:04.571684 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412e607-6e52-4c34-bf95-d82d51e95cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:04.571956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412e607-6e52-4c34-bf95-d82d51e95cd0 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:04.572129 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab080582-f9e4-4d4e-ae59-cdf05e25e3fe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:04.572408 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab080582-f9e4-4d4e-ae59-cdf05e25e3fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:04.572621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412e607-6e52-4c34-bf95-d82d51e95cd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:04.573774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab080582-f9e4-4d4e-ae59-cdf05e25e3fe None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:04.573985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412e607-6e52-4c34-bf95-d82d51e95cd0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:04.583873 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 450/905] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 7 21:49:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:04.583873 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab080582-f9e4-4d4e-ae59-cdf05e25e3fe None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:04.584111 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 456/906] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 7 21:49:04 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 21:49:04.592256 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412e607-6e52-4c34-bf95-d82d51e95cd0 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:04.715499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412e607-6e52-4c34-bf95-d82d51e95cd0 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:04.717430 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab080582-f9e4-4d4e-ae59-cdf05e25e3fe None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:04.754956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf746f-097d-4868-8ecb-11f696f2daf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:04.755420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf746f-097d-4868-8ecb-11f696f2daf1 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:04.755699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf746f-097d-4868-8ecb-11f696f2daf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:04.755973 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf746f-097d-4868-8ecb-11f696f2daf1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:04.756776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf746f-097d-4868-8ecb-11f696f2daf1 None admin] RBAC: Adding query filter params (interface=public, service_id=ba1de12ba7334f9cb08ef99b3798c8e6, region_id=RegionOne) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:04.757171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf746f-097d-4868-8ecb-11f696f2daf1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:04.759280 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf746f-097d-4868-8ecb-11f696f2daf1 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:04.761218 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:04.767111 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43798d3-f68a-4198-9e84-c8d174c8c2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:04.768159 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43798d3-f68a-4198-9e84-c8d174c8c2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:04.768648 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43798d3-f68a-4198-9e84-c8d174c8c2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:04.769127 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43798d3-f68a-4198-9e84-c8d174c8c2e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:04.770212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43798d3-f68a-4198-9e84-c8d174c8c2e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:04.770733 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43798d3-f68a-4198-9e84-c8d174c8c2e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:04.772079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 457/907] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jun 7 21:49:04 2022] GET /identity/v3/endpoints?service_id=ba1de12ba7334f9cb08ef99b3798c8e6&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:04.772629 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43798d3-f68a-4198-9e84-c8d174c8c2e5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:04.772995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf746f-097d-4868-8ecb-11f696f2daf1 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:04.788552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 451/908] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:04.794935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43798d3-f68a-4198-9e84-c8d174c8c2e5 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:04.811803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:04.916853 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43798d3-f68a-4198-9e84-c8d174c8c2e5 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:04.920052 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf746f-097d-4868-8ecb-11f696f2daf1 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:04.955047 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce23f2b-89ac-4381-b5c4-808dabc44ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:04.955839 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce23f2b-89ac-4381-b5c4-808dabc44ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:04.956116 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce23f2b-89ac-4381-b5c4-808dabc44ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:04.956387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce23f2b-89ac-4381-b5c4-808dabc44ee8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:04.957641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e19a7-0694-4124-81da-d76a238c420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:04.958544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e19a7-0694-4124-81da-d76a238c420a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:04.959019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e19a7-0694-4124-81da-d76a238c420a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:04.959497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e19a7-0694-4124-81da-d76a238c420a None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:04.960359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e19a7-0694-4124-81da-d76a238c420a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:04.961992 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e19a7-0694-4124-81da-d76a238c420a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:04.963455 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce23f2b-89ac-4381-b5c4-808dabc44ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:04.964882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce23f2b-89ac-4381-b5c4-808dabc44ee8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:04.969297 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 458/909] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 7 21:49:04 2022] GET /identity/v3/services => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 21:49:04.986595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-1ce23f2b-89ac-4381-b5c4-808dabc44ee8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:49:04.986595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:04.986595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:04.986595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:04.986595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:04.986595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:04.986595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:04.986595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:04.986595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:04.986595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:04.986595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:04.986595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:04.986595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:49:04.986595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:49:04.986595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:49:04.987560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:49:04.987560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:04.987560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:04.987560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:04.987560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:04.987560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:04.987560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:04.987560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:04.987560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:04.987560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:04.987560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:04.987560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:04.987560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:04.987560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:04.987560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:04.987560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:04.987560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:04.988445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:49:04.988445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:49:04.988445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:49:04.988445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:49:04.988445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:49:04.988445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:49:04.988445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:49:04.988445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:04.991195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 452/910] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:49:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:04.997589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e19a7-0694-4124-81da-d76a238c420a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:05.069187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:05.116479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e19a7-0694-4124-81da-d76a238c420a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:05.154913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31e4c7-4480-4237-a2cd-6a3484fd6e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:05.155587 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31e4c7-4480-4237-a2cd-6a3484fd6e7a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:05.155867 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31e4c7-4480-4237-a2cd-6a3484fd6e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:05.156136 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31e4c7-4480-4237-a2cd-6a3484fd6e7a None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:05.156923 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31e4c7-4480-4237-a2cd-6a3484fd6e7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:05.157223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31e4c7-4480-4237-a2cd-6a3484fd6e7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:05.158703 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31e4c7-4480-4237-a2cd-6a3484fd6e7a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:05.172509 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 459/911] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:49:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:05.178499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce23f2b-89ac-4381-b5c4-808dabc44ee8 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:05.251941 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:05.256606 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72bdcf-5a69-42f3-b08e-a90c2f43625f None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:05.257187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72bdcf-5a69-42f3-b08e-a90c2f43625f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:05.257670 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72bdcf-5a69-42f3-b08e-a90c2f43625f None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:05.259671 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 460/912] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:05.265678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6be76e-ea58-4b03-beb5-88f768e65779 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:05.266252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6be76e-ea58-4b03-beb5-88f768e65779 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:05.266912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6be76e-ea58-4b03-beb5-88f768e65779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:05.288078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce23f2b-89ac-4381-b5c4-808dabc44ee8 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:05.289336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4a6be76e-ea58-4b03-beb5-88f768e65779 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:05.291935 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4a6be76e-ea58-4b03-beb5-88f768e65779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:05.330705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7faf34-0a5d-44c7-8220-b9d06a745561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:05.331281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7faf34-0a5d-44c7-8220-b9d06a745561 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:05.331558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7faf34-0a5d-44c7-8220-b9d06a745561 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:05.331832 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7faf34-0a5d-44c7-8220-b9d06a745561 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:05.333085 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7faf34-0a5d-44c7-8220-b9d06a745561 None admin] RBAC: Adding query filter params (role.id=7dadc9b4653f4b31856163d4e2cc6469, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=4fc55e3a9107489a9b24385ac5379ca9) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:05.333539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7faf34-0a5d-44c7-8220-b9d06a745561 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:05.335143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7faf34-0a5d-44c7-8220-b9d06a745561 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:05.343236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 453/913] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:49:05 2022] GET /identity/v3/role_assignments?user.id=4fc55e3a9107489a9b24385ac5379ca9&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=7dadc9b4653f4b31856163d4e2cc6469 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:05.391484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 461/914] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:05.416356 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7faf34-0a5d-44c7-8220-b9d06a745561 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:05.532658 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7faf34-0a5d-44c7-8220-b9d06a745561 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:05.569519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc018d-2684-45c7-8d1f-0f0904151e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:05.570725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc018d-2684-45c7-8d1f-0f0904151e76 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:05.572104 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc018d-2684-45c7-8d1f-0f0904151e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:05.572600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc018d-2684-45c7-8d1f-0f0904151e76 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:05.573482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc018d-2684-45c7-8d1f-0f0904151e76 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:05.575081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc018d-2684-45c7-8d1f-0f0904151e76 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:05.577074 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:05.589417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-d0fc018d-2684-45c7-8d1f-0f0904151e76 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 21:49:05.589417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:05.589417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:49:05.589417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:49:05.589417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:49:05.589417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:49:05.589417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:49:05.589417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:05.589417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 21:49:05.589417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:05.589417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:49:05.589417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:05.589417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:05.589417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:05.589417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:05.589417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:05.589417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:05.590427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:05.590427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:05.590427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:05.590427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:05.590427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:05.590427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:05.590427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:49:05.590427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:49:05.590427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:49:05.590427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:49:05.590427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:05.590427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:05.590427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:05.590427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:05.590427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:05.590427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:05.591268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:05.591268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:05.591268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:05.591268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:05.591268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:05.591268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:05.591268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:05.591268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:05.591268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:05.591268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:05.591268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:49:05.591268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:05.591268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 21:49:05.591268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:05.598132 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 454/915] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 7 21:49:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:05.600298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6be76e-ea58-4b03-beb5-88f768e65779 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:05.658428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:05.704194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6be76e-ea58-4b03-beb5-88f768e65779 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:05.742321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ad34f-a359-4d1c-b9e4-6c6f483a5101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:05.743441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ad34f-a359-4d1c-b9e4-6c6f483a5101 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:05.743927 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ad34f-a359-4d1c-b9e4-6c6f483a5101 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:05.744402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ad34f-a359-4d1c-b9e4-6c6f483a5101 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:05.745318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ad34f-a359-4d1c-b9e4-6c6f483a5101 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:05.745844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ad34f-a359-4d1c-b9e4-6c6f483a5101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:05.747438 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ad34f-a359-4d1c-b9e4-6c6f483a5101 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:05.752913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 462/916] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 7 21:49:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:05.759347 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc018d-2684-45c7-8d1f-0f0904151e76 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:05.868374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc018d-2684-45c7-8d1f-0f0904151e76 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:05.904725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043adbc-1411-4c55-87b9-3deeffe20040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:05.905769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043adbc-1411-4c55-87b9-3deeffe20040 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:05.906293 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043adbc-1411-4c55-87b9-3deeffe20040 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:05.906787 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043adbc-1411-4c55-87b9-3deeffe20040 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:05.907690 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043adbc-1411-4c55-87b9-3deeffe20040 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:05.908212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043adbc-1411-4c55-87b9-3deeffe20040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:05.909788 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043adbc-1411-4c55-87b9-3deeffe20040 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:05.915419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 455/917] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 7 21:49:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:05.921491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ad34f-a359-4d1c-b9e4-6c6f483a5101 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:06.032042 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ad34f-a359-4d1c-b9e4-6c6f483a5101 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:06.050386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:06.069454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0e6c3-04bc-4a25-a359-8767790cb2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:06.070545 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0e6c3-04bc-4a25-a359-8767790cb2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:06.071066 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0e6c3-04bc-4a25-a359-8767790cb2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:06.071543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0e6c3-04bc-4a25-a359-8767790cb2e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:06.072568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0e6c3-04bc-4a25-a359-8767790cb2e8 None admin] RBAC: Adding query filter params (interface=public, service_id=8fb9ea331413468e980057e03466aa5e, region_id=RegionOne) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:06.073095 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0e6c3-04bc-4a25-a359-8767790cb2e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:06.074755 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0e6c3-04bc-4a25-a359-8767790cb2e8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:06.080734 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 463/918] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jun 7 21:49:05 2022] GET /identity/v3/endpoints?service_id=8fb9ea331413468e980057e03466aa5e&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:06.086415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043adbc-1411-4c55-87b9-3deeffe20040 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:06.153769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:06.197311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043adbc-1411-4c55-87b9-3deeffe20040 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:06.232652 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f4913-2525-42d3-8baa-649614bde2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:06.233703 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f4913-2525-42d3-8baa-649614bde2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:06.234275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f4913-2525-42d3-8baa-649614bde2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:06.234794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f4913-2525-42d3-8baa-649614bde2c3 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:06.235689 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f4913-2525-42d3-8baa-649614bde2c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:06.237253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f4913-2525-42d3-8baa-649614bde2c3 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:06.243985 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 456/919] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 7 21:49:06 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 21:49:06.862555 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b8293-85c6-4d8d-8cd0-ff87af4307c7 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:06.863077 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b8293-85c6-4d8d-8cd0-ff87af4307c7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:06.863184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b8293-85c6-4d8d-8cd0-ff87af4307c7 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:06.864719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 464/920] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:06.870771 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce4703-92fd-46a5-81d2-5d54cd6515cd None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:06.871170 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce4703-92fd-46a5-81d2-5d54cd6515cd None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:06.871351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce4703-92fd-46a5-81d2-5d54cd6515cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:06.887935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-26ce4703-92fd-46a5-81d2-5d54cd6515cd None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:06.889128 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-26ce4703-92fd-46a5-81d2-5d54cd6515cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:06.962107 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 457/921] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:06.980425 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b8293-85c6-4d8d-8cd0-ff87af4307c7 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:07.086933 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b8293-85c6-4d8d-8cd0-ff87af4307c7 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:07.123333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560a604-d0b0-4aa7-8666-100cc55a9c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:07.124484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a604-d0b0-4aa7-8666-100cc55a9c82 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:07.124980 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a604-d0b0-4aa7-8666-100cc55a9c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:07.125476 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a604-d0b0-4aa7-8666-100cc55a9c82 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:07.126353 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560a604-d0b0-4aa7-8666-100cc55a9c82 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:07.127934 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560a604-d0b0-4aa7-8666-100cc55a9c82 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:07.140511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-e560a604-d0b0-4aa7-8666-100cc55a9c82 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 21:49:07.140511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:07.140511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:49:07.140511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:49:07.140511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:49:07.140511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:49:07.140511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:49:07.140511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:07.140511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 21:49:07.140511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:07.140511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:49:07.140511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:07.140511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:07.140511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:07.140511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:07.140511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:07.140511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:07.141507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:07.141507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:07.141507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:07.141507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:07.141507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:07.141507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:07.141507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:49:07.141507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:49:07.141507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:49:07.141507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:49:07.141507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:07.141507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:07.141507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:07.141507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:07.141507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:07.141507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:07.142392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:07.142392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:07.142392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:07.142392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:07.142392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:07.142392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:07.142392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:07.142392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:07.142392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:07.142392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:07.142392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:49:07.142392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:07.142392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 21:49:07.142392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:07.145191 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 465/922] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:49:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:07.158165 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce4703-92fd-46a5-81d2-5d54cd6515cd None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:07.215781 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:07.259946 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce4703-92fd-46a5-81d2-5d54cd6515cd None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:07.299256 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff4cf0-a1ae-4b26-891e-4f6604591890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:07.300355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff4cf0-a1ae-4b26-891e-4f6604591890 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:07.300839 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff4cf0-a1ae-4b26-891e-4f6604591890 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:07.301308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff4cf0-a1ae-4b26-891e-4f6604591890 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:07.302305 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff4cf0-a1ae-4b26-891e-4f6604591890 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:07.302812 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff4cf0-a1ae-4b26-891e-4f6604591890 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:07.304403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff4cf0-a1ae-4b26-891e-4f6604591890 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:07.310377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d6f6b-0bcd-4f2d-99bb-1694723a72ef None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:07.310605 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d6f6b-0bcd-4f2d-99bb-1694723a72ef None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:07.310815 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d6f6b-0bcd-4f2d-99bb-1694723a72ef None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:07.311000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 458/923] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:49:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:07.315946 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 466/924] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:07.316183 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff4cf0-a1ae-4b26-891e-4f6604591890 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:07.317619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892092f-f1c7-4c91-b445-4a98d886afb5 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:07.318096 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892092f-f1c7-4c91-b445-4a98d886afb5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:07.318554 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892092f-f1c7-4c91-b445-4a98d886afb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:07.336952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b892092f-f1c7-4c91-b445-4a98d886afb5 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:07.338626 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b892092f-f1c7-4c91-b445-4a98d886afb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:07.388923 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:07.430076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 467/925] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:07.453714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892092f-f1c7-4c91-b445-4a98d886afb5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:07.458176 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff4cf0-a1ae-4b26-891e-4f6604591890 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:07.481503 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:07.497266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f246f-f4f3-41b6-8d1b-116a1d704254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:07.498058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f246f-f4f3-41b6-8d1b-116a1d704254 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:07.498428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f246f-f4f3-41b6-8d1b-116a1d704254 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:07.499111 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f246f-f4f3-41b6-8d1b-116a1d704254 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:07.499602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f246f-f4f3-41b6-8d1b-116a1d704254 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:07.499991 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f246f-f4f3-41b6-8d1b-116a1d704254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:07.501698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f246f-f4f3-41b6-8d1b-116a1d704254 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:07.511759 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 459/926] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 7 21:49:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:07.513323 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f246f-f4f3-41b6-8d1b-116a1d704254 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:07.574419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892092f-f1c7-4c91-b445-4a98d886afb5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:07.619501 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dde10-3d55-4c6a-a567-905c8036476f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:07.619717 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f246f-f4f3-41b6-8d1b-116a1d704254 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:07.620315 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dde10-3d55-4c6a-a567-905c8036476f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:07.620596 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dde10-3d55-4c6a-a567-905c8036476f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:07.621045 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dde10-3d55-4c6a-a567-905c8036476f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:07.622141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18dde10-3d55-4c6a-a567-905c8036476f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:07.623548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18dde10-3d55-4c6a-a567-905c8036476f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:07.636430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-d18dde10-3d55-4c6a-a567-905c8036476f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 21:49:07.636430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:07.636430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:49:07.636430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:49:07.636430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:49:07.636430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:49:07.636430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:49:07.636430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:07.636430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 21:49:07.636430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:07.636430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:49:07.636430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:07.636430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:07.636430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:07.636430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:07.636430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:07.637356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:07.637356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:07.637356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:07.637356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:07.637356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:07.637356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:07.637356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:07.637356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:49:07.637356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:49:07.637356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:49:07.637356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:49:07.637356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:07.637356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:07.637356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:07.637356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:07.637356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:07.638711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:07.638711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:07.638711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:07.638711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:07.638711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:07.638711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:07.638711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:07.638711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:07.638711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:07.638711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:07.638711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:07.638711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:49:07.638711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:07.638711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 21:49:07.638711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:07.638711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 468/927] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Jun 7 21:49:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:07.639596 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24515c8c-6a89-4fe9-8130-b26dc0002ac3 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:07.639596 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24515c8c-6a89-4fe9-8130-b26dc0002ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:07.639596 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24515c8c-6a89-4fe9-8130-b26dc0002ac3 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:07.640769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 469/928] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:07.645604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24515c8c-6a89-4fe9-8130-b26dc0002ac3 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:07.666076 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd93dd5-777a-4674-beec-1d7bde5f1f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:07.667069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd93dd5-777a-4674-beec-1d7bde5f1f34 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:07.667347 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd93dd5-777a-4674-beec-1d7bde5f1f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:07.667617 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd93dd5-777a-4674-beec-1d7bde5f1f34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:07.668348 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd93dd5-777a-4674-beec-1d7bde5f1f34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:07.669701 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd93dd5-777a-4674-beec-1d7bde5f1f34 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:07.688890 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 460/929] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 7 21:49:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:49:07.690143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab7007-fc17-4d08-a6ab-bbbf15c62e05 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:07.690433 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab7007-fc17-4d08-a6ab-bbbf15c62e05 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:07.690705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab7007-fc17-4d08-a6ab-bbbf15c62e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:07.693675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:07.719019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-49ab7007-fc17-4d08-a6ab-bbbf15c62e05 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:07.720620 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-49ab7007-fc17-4d08-a6ab-bbbf15c62e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:07.774851 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:07.783663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24515c8c-6a89-4fe9-8130-b26dc0002ac3 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:07.818348 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 461/930] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:07.827068 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329fbba-1987-4d1a-9954-978ca20b89f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:07.827980 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329fbba-1987-4d1a-9954-978ca20b89f2 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:07.828439 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329fbba-1987-4d1a-9954-978ca20b89f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:07.828903 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329fbba-1987-4d1a-9954-978ca20b89f2 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:07.829770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329fbba-1987-4d1a-9954-978ca20b89f2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:07.830250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329fbba-1987-4d1a-9954-978ca20b89f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:07.831813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329fbba-1987-4d1a-9954-978ca20b89f2 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:07.840299 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab7007-fc17-4d08-a6ab-bbbf15c62e05 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:07.842379 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 470/931] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 7 21:49:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:07.847699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329fbba-1987-4d1a-9954-978ca20b89f2 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:07.957653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab7007-fc17-4d08-a6ab-bbbf15c62e05 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:07.966390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:07.971502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329fbba-1987-4d1a-9954-978ca20b89f2 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:08.003359 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8078ad-2f28-445e-9904-706198604a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:08.004184 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8078ad-2f28-445e-9904-706198604a8a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:08.004459 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8078ad-2f28-445e-9904-706198604a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:08.004725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8078ad-2f28-445e-9904-706198604a8a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:08.019058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8078ad-2f28-445e-9904-706198604a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:49:08.024592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93142fed-4a06-4f6c-b73b-33b543d1c6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:08.025402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142fed-4a06-4f6c-b73b-33b543d1c6ac None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:08.025757 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142fed-4a06-4f6c-b73b-33b543d1c6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:08.026124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142fed-4a06-4f6c-b73b-33b543d1c6ac None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:08.026895 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93142fed-4a06-4f6c-b73b-33b543d1c6ac None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:08.027266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93142fed-4a06-4f6c-b73b-33b543d1c6ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:08.029083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93142fed-4a06-4f6c-b73b-33b543d1c6ac None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:08.030022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-cd8078ad-2f28-445e-9904-706198604a8a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 21:49:08.030022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:08.030022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:08.030022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:08.030022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:08.030022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:08.030022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:08.030022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:08.030022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:08.030022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:08.030022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:08.030022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:08.030022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:49:08.030022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:49:08.030022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:49:08.030022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:49:08.030918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:49:08.030918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:49:08.030918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:49:08.030918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:49:08.030918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:08.030918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:08.030918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:08.030918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:08.030918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:08.030918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:08.030918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:08.030918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:08.030918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:08.030918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:08.030918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:08.030918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:08.031743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:08.031743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:08.031743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:08.031743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:08.031743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:49:08.031743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:49:08.031743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:49:08.031743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:49:08.031743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:49:08.031743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:49:08.031743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 21:49:08.031743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:08.034427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 462/932] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jun 7 21:49:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:08.038489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 471/933] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 7 21:49:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:08.043854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8078ad-2f28-445e-9904-706198604a8a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:08.045068 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93142fed-4a06-4f6c-b73b-33b543d1c6ac None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:08.088284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:08.174651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93142fed-4a06-4f6c-b73b-33b543d1c6ac None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:08.174879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8078ad-2f28-445e-9904-706198604a8a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:08.211310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f3437-ef31-4b4b-bf86-4ad0362ef82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:08.212004 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f3437-ef31-4b4b-bf86-4ad0362ef82b None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:08.212389 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f3437-ef31-4b4b-bf86-4ad0362ef82b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:08.212692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f3437-ef31-4b4b-bf86-4ad0362ef82b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:08.213506 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f3437-ef31-4b4b-bf86-4ad0362ef82b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:08.215323 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f3437-ef31-4b4b-bf86-4ad0362ef82b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:08.221341 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0107b1-2c44-4587-97b2-081018a30273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:08.222326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0107b1-2c44-4587-97b2-081018a30273 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:08.223059 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0107b1-2c44-4587-97b2-081018a30273 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:08.223520 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0107b1-2c44-4587-97b2-081018a30273 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:08.225257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0107b1-2c44-4587-97b2-081018a30273 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:08.225848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0107b1-2c44-4587-97b2-081018a30273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:08.228017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0107b1-2c44-4587-97b2-081018a30273 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:08.238518 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 463/934] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 7 21:49:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:49:08.242150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 472/935] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jun 7 21:49:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:08.251695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f3437-ef31-4b4b-bf86-4ad0362ef82b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:08.418382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:08.439462 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f3437-ef31-4b4b-bf86-4ad0362ef82b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:08.497008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419564a-236c-4b68-9960-abdfd03081f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:08.497705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419564a-236c-4b68-9960-abdfd03081f1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:08.498012 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419564a-236c-4b68-9960-abdfd03081f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:08.498281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419564a-236c-4b68-9960-abdfd03081f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:08.510763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419564a-236c-4b68-9960-abdfd03081f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:08.512214 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419564a-236c-4b68-9960-abdfd03081f1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:08.531162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-6419564a-236c-4b68-9960-abdfd03081f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:08.531162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:08.531162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:08.531162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:08.531162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:08.531162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:08.531162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:08.531162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:08.531162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:08.531162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:08.531162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:08.531162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:08.531162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:49:08.531162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:49:08.531162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:49:08.532205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:49:08.532205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:08.532205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:08.532205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:08.532205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:08.532205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:08.532205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:08.532205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:08.532205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:08.532205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:08.532205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:08.532205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:08.532205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:08.532205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:08.532205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:08.532205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:08.532205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:08.533083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:49:08.533083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:49:08.533083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:08.533083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:08.537002 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 464/936] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:08.543033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0107b1-2c44-4587-97b2-081018a30273 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:08.571456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:08.652076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0107b1-2c44-4587-97b2-081018a30273 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:08.676399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da3f4f-e442-4458-b582-238414297b83 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:08.676973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da3f4f-e442-4458-b582-238414297b83 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:08.677459 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da3f4f-e442-4458-b582-238414297b83 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:08.679070 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 465/937] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:08.685125 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816864e0-9e56-408a-b85c-f4e5ee23805f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:08.685382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816864e0-9e56-408a-b85c-f4e5ee23805f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:08.685660 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816864e0-9e56-408a-b85c-f4e5ee23805f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:08.693823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b0180-f52e-4f92-860c-1d93d3d30f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:08.694843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b0180-f52e-4f92-860c-1d93d3d30f4f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:08.695392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b0180-f52e-4f92-860c-1d93d3d30f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:08.695914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b0180-f52e-4f92-860c-1d93d3d30f4f None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:08.697258 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b0180-f52e-4f92-860c-1d93d3d30f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:08.697770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b0180-f52e-4f92-860c-1d93d3d30f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:08.699686 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b0180-f52e-4f92-860c-1d93d3d30f4f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:08.702660 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-816864e0-9e56-408a-b85c-f4e5ee23805f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:08.703500 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-816864e0-9e56-408a-b85c-f4e5ee23805f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:08.721236 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 473/938] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:08.722892 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b0180-f52e-4f92-860c-1d93d3d30f4f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:08.782094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 466/939] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 21:49:08.799718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816864e0-9e56-408a-b85c-f4e5ee23805f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:08.824731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:08.845148 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b0180-f52e-4f92-860c-1d93d3d30f4f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:08.863946 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:08.896645 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf0959-2730-4878-aa3d-cf07482b8c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:08.898322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf0959-2730-4878-aa3d-cf07482b8c9a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:08.898708 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf0959-2730-4878-aa3d-cf07482b8c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:08.899406 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf0959-2730-4878-aa3d-cf07482b8c9a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:08.905789 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816864e0-9e56-408a-b85c-f4e5ee23805f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:08.909528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf0959-2730-4878-aa3d-cf07482b8c9a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:08.911136 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf0959-2730-4878-aa3d-cf07482b8c9a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:08.932212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-eebf0959-2730-4878-aa3d-cf07482b8c9a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 21:49:08.932212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:08.932212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:08.932212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:08.932212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:08.932212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:08.932212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:08.932212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:08.932212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:08.932212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:08.932212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:08.932212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:08.932212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:49:08.932212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:49:08.932212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:49:08.932212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:08.933369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:08.934443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:08.934443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:08.934443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:49:08.934443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:49:08.934443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:49:08.934443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:49:08.934443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:49:08.934443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:49:08.934443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 21:49:08.934443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:08.938021 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 474/940] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 7 21:49:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:08.942825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf0959-2730-4878-aa3d-cf07482b8c9a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:08.948817 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced29e0-179a-47e6-a127-4072548b271e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:08.949626 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced29e0-179a-47e6-a127-4072548b271e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:08.949902 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced29e0-179a-47e6-a127-4072548b271e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:08.950199 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced29e0-179a-47e6-a127-4072548b271e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:08.950857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced29e0-179a-47e6-a127-4072548b271e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:08.952255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced29e0-179a-47e6-a127-4072548b271e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:08.965370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-7ced29e0-179a-47e6-a127-4072548b271e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 21:49:08.965370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:08.965370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:49:08.965370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:49:08.965370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:49:08.965370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:49:08.965370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:49:08.965370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:08.965370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 21:49:08.965370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:08.965370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:49:08.965370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:08.965370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:08.965370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:08.965370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:08.965370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:08.965370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:08.966920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:08.966920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:08.966920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:08.966920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:08.966920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:08.966920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:08.966920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:49:08.966920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:49:08.966920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:49:08.966920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:49:08.966920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:08.966920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:08.966920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:08.966920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:08.966920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:08.966920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:08.968253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:08.968253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:08.968253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:08.968253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:08.968253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:08.968253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:08.968253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:08.968253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:08.968253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:08.968253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:08.968253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:49:08.968253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:08.968253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 21:49:08.968253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:08.971729 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 467/941] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 7 21:49:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:08.972637 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced29e0-179a-47e6-a127-4072548b271e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:09.081391 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf0959-2730-4878-aa3d-cf07482b8c9a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:09.087608 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced29e0-179a-47e6-a127-4072548b271e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:09.118750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c329d0f-41f3-4350-a321-a068ca02db5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:09.119418 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c329d0f-41f3-4350-a321-a068ca02db5b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:09.119696 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c329d0f-41f3-4350-a321-a068ca02db5b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:09.119965 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c329d0f-41f3-4350-a321-a068ca02db5b None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:09.120793 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c329d0f-41f3-4350-a321-a068ca02db5b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:09.121155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c329d0f-41f3-4350-a321-a068ca02db5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:09.122744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c329d0f-41f3-4350-a321-a068ca02db5b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:09.126323 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:09.138551 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9fcd4-f4fd-441d-a0e5-dedc7f49ca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:09.139845 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9fcd4-f4fd-441d-a0e5-dedc7f49ca9d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:09.140332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9fcd4-f4fd-441d-a0e5-dedc7f49ca9d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:09.140810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9fcd4-f4fd-441d-a0e5-dedc7f49ca9d None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:09.145857 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 475/942] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jun 7 21:49:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:09.146004 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9fcd4-f4fd-441d-a0e5-dedc7f49ca9d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:09.146004 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9fcd4-f4fd-441d-a0e5-dedc7f49ca9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:09.146004 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9fcd4-f4fd-441d-a0e5-dedc7f49ca9d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:09.147760 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c329d0f-41f3-4350-a321-a068ca02db5b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:09.150765 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:09.154400 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 468/943] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 7 21:49:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:09.163008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9fcd4-f4fd-441d-a0e5-dedc7f49ca9d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:09.256878 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c329d0f-41f3-4350-a321-a068ca02db5b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:09.280666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9fcd4-f4fd-441d-a0e5-dedc7f49ca9d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:09.294208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a2de1-d1b3-4d7b-a1f0-f44697d428ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:09.294996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a2de1-d1b3-4d7b-a1f0-f44697d428ff None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:09.295277 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a2de1-d1b3-4d7b-a1f0-f44697d428ff None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:09.295549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a2de1-d1b3-4d7b-a1f0-f44697d428ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:09.306442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a2de1-d1b3-4d7b-a1f0-f44697d428ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:09.307872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a2de1-d1b3-4d7b-a1f0-f44697d428ff None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:09.321763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ae91a-99fd-441c-bbde-9ab1a0fe34a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:09.322442 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ae91a-99fd-441c-bbde-9ab1a0fe34a2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:09.322721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ae91a-99fd-441c-bbde-9ab1a0fe34a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:09.322990 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ae91a-99fd-441c-bbde-9ab1a0fe34a2 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:09.323681 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ae91a-99fd-441c-bbde-9ab1a0fe34a2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:09.323984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ae91a-99fd-441c-bbde-9ab1a0fe34a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:09.325312 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ae91a-99fd-441c-bbde-9ab1a0fe34a2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:09.325862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-fc3a2de1-d1b3-4d7b-a1f0-f44697d428ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:09.325862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:09.325862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:09.325862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:09.325862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:09.325862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:09.325862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:09.325862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:09.325862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:09.325862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:09.325862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:09.325862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:09.325862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:49:09.325862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:49:09.325862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:49:09.326722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:49:09.326722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:09.326722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:09.326722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:09.326722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:09.326722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:09.326722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:09.326722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:09.326722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:09.326722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:09.326722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:09.326722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:09.326722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:09.326722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:09.326722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:09.326722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:09.326722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:09.327752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:49:09.327752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:49:09.327752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:09.327752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:09.327752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 476/944] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:09.330258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 469/945] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 7 21:49:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:09.335740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ae91a-99fd-441c-bbde-9ab1a0fe34a2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:09.335863 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a2de1-d1b3-4d7b-a1f0-f44697d428ff None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:09.415888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:09.419282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:09.480431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a2de1-d1b3-4d7b-a1f0-f44697d428ff None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:09.482760 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ae91a-99fd-441c-bbde-9ab1a0fe34a2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:09.520685 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc615af0-cae6-49dc-99c1-cd7872a9d2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:09.521342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc615af0-cae6-49dc-99c1-cd7872a9d2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:09.521619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc615af0-cae6-49dc-99c1-cd7872a9d2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:09.521891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc615af0-cae6-49dc-99c1-cd7872a9d2c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:09.522634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc615af0-cae6-49dc-99c1-cd7872a9d2c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:09.522936 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc615af0-cae6-49dc-99c1-cd7872a9d2c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:09.524843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc615af0-cae6-49dc-99c1-cd7872a9d2c5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:09.534884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf069e9-945c-4d4e-8d28-d6e7ccbb4bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:09.535863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf069e9-945c-4d4e-8d28-d6e7ccbb4bef None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:09.536342 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf069e9-945c-4d4e-8d28-d6e7ccbb4bef None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:09.536824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf069e9-945c-4d4e-8d28-d6e7ccbb4bef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:09.537247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 477/946] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:09.537945 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf069e9-945c-4d4e-8d28-d6e7ccbb4bef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:09.539373 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf069e9-945c-4d4e-8d28-d6e7ccbb4bef None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:09.542477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc615af0-cae6-49dc-99c1-cd7872a9d2c5 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:09.569954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 470/947] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 7 21:49:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:49:09.666187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc615af0-cae6-49dc-99c1-cd7872a9d2c5 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:09.683301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:09.714015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43445dd4-c652-40f4-b6b8-eaf8ae5cba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:09.714914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43445dd4-c652-40f4-b6b8-eaf8ae5cba85 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:09.715263 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43445dd4-c652-40f4-b6b8-eaf8ae5cba85 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:09.715601 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43445dd4-c652-40f4-b6b8-eaf8ae5cba85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:09.723241 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43445dd4-c652-40f4-b6b8-eaf8ae5cba85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:09.724813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43445dd4-c652-40f4-b6b8-eaf8ae5cba85 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:09.741271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-43445dd4-c652-40f4-b6b8-eaf8ae5cba85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:49:09.741271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:09.741271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:09.741271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:09.741271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:09.741271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:09.741271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:09.741271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:09.741271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:09.741271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:09.741271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:09.741271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:09.741271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:49:09.741271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:49:09.741271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:49:09.742431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:49:09.742431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:09.742431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:09.742431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:09.742431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:09.742431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:09.742431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:09.742431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:09.742431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:09.742431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:09.742431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:09.742431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:09.742431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:09.742431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:09.742431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:09.742431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:09.742431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:09.743412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:49:09.743412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:49:09.743412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:49:09.743412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:49:09.743412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:49:09.743412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:49:09.743412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:49:09.743412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:09.748156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 478/948] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:49:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:09.749627 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf069e9-945c-4d4e-8d28-d6e7ccbb4bef None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:09.861609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf069e9-945c-4d4e-8d28-d6e7ccbb4bef None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:09.874750 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:09.897138 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408be46-70a5-48d5-8b46-a2757b298fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:09.897808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408be46-70a5-48d5-8b46-a2757b298fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:09.898127 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408be46-70a5-48d5-8b46-a2757b298fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:09.898400 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408be46-70a5-48d5-8b46-a2757b298fe1 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:09.899804 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408be46-70a5-48d5-8b46-a2757b298fe1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:09.900159 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408be46-70a5-48d5-8b46-a2757b298fe1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:09.902012 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408be46-70a5-48d5-8b46-a2757b298fe1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:09.919005 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 471/949] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:49:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:09.920909 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43445dd4-c652-40f4-b6b8-eaf8ae5cba85 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:10.025150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43445dd4-c652-40f4-b6b8-eaf8ae5cba85 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:10.064265 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5f079-1309-4a6d-9a4e-d40b6a828e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:10.065155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5f079-1309-4a6d-9a4e-d40b6a828e68 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:10.065436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5f079-1309-4a6d-9a4e-d40b6a828e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:10.065711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5f079-1309-4a6d-9a4e-d40b6a828e68 None admin] PATH_INFO: `/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/4fc55e3a9107489a9b24385ac5379ca9/roles/7dadc9b4653f4b31856163d4e2cc6469` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:10.067974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5f079-1309-4a6d-9a4e-d40b6a828e68 None admin] RBAC: Authorizing `identity:create_grant(project_id=eca8f481deb242789622ebb10aa2c5da, user_id=4fc55e3a9107489a9b24385ac5379ca9, role_id=7dadc9b4653f4b31856163d4e2cc6469)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:10.069409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5f079-1309-4a6d-9a4e-d40b6a828e68 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:10.085469 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 479/950] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:49:09 2022] PUT /identity/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/4fc55e3a9107489a9b24385ac5379ca9/roles/7dadc9b4653f4b31856163d4e2cc6469 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:49:10.166479 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888aa13d-1a0f-4626-b076-f1e8d4079230 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:10.167001 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888aa13d-1a0f-4626-b076-f1e8d4079230 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:10.167001 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888aa13d-1a0f-4626-b076-f1e8d4079230 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:10.168712 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 472/951] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:10.174585 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969777f-399f-4c75-be8d-27fc093a231f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:10.174838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969777f-399f-4c75-be8d-27fc093a231f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:10.175262 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969777f-399f-4c75-be8d-27fc093a231f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:10.196478 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-2969777f-399f-4c75-be8d-27fc093a231f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:10.197890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2969777f-399f-4c75-be8d-27fc093a231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:10.228487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:10.283243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 480/952] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:10.308073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888aa13d-1a0f-4626-b076-f1e8d4079230 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:10.426552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888aa13d-1a0f-4626-b076-f1e8d4079230 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:10.463686 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d268f-119a-4e6d-9128-57273a2ffdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:10.464345 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d268f-119a-4e6d-9128-57273a2ffdcd None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:10.464628 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d268f-119a-4e6d-9128-57273a2ffdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:10.464905 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d268f-119a-4e6d-9128-57273a2ffdcd None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:10.465685 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d268f-119a-4e6d-9128-57273a2ffdcd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:10.467222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d268f-119a-4e6d-9128-57273a2ffdcd None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:10.468666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: WARNING keystone.server.flask.common [None req-772d268f-119a-4e6d-9128-57273a2ffdcd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 07 21:49:10.487818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.sql.core [None req-772d268f-119a-4e6d-9128-57273a2ffdcd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 07 21:49:10.487818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 07 21:49:10.487818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [parameters: {'id': '7778fbd7107f4dcdb1c2ccd8a61bb544', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 07 21:49:10.487818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80404) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 07 21:49:10.496667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-772d268f-119a-4e6d-9128-57273a2ffdcd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7778fbd7107f4dcdb1c2ccd8a61bb544.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7778fbd7107f4dcdb1c2ccd8a61bb544. Jun 07 21:49:10.496667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:10.496667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 21:49:10.496667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 21:49:10.496667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 21:49:10.496667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 21:49:10.496667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 21:49:10.496667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 21:49:10.496667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 21:49:10.496667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application conn.query(q) Jun 07 21:49:10.496667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 21:49:10.496667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 21:49:10.496667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result.read() Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 07 21:49:10.497492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 07 21:49:10.498757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 21:49:10.498757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application next(self.gen) Jun 07 21:49:10.498757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 07 21:49:10.498757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application yield resource Jun 07 21:49:10.498757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 21:49:10.498757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application next(self.gen) Jun 07 21:49:10.498757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 07 21:49:10.498757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.session.rollback() Jun 07 21:49:10.498757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 07 21:49:10.498757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.force_reraise() Jun 07 21:49:10.498757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 07 21:49:10.498757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise self.value Jun 07 21:49:10.498757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 07 21:49:10.498757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 07 21:49:10.498757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 07 21:49:10.498757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application session.commit() Jun 07 21:49:10.498757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 07 21:49:10.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 07 21:49:10.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 07 21:49:10.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._prepare_impl() Jun 07 21:49:10.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 07 21:49:10.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.session.flush() Jun 07 21:49:10.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 07 21:49:10.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._flush(objects) Jun 07 21:49:10.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 07 21:49:10.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 07 21:49:10.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 07 21:49:10.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application compat.raise_( Jun 07 21:49:10.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 21:49:10.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception Jun 07 21:49:10.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 07 21:49:10.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application flush_context.execute() Jun 07 21:49:10.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 07 21:49:10.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rec.execute(self) Jun 07 21:49:10.502229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 07 21:49:10.502229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 07 21:49:10.502229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 07 21:49:10.502229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 07 21:49:10.502229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 07 21:49:10.502229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 07 21:49:10.502229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 07 21:49:10.502229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 07 21:49:10.502229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 07 21:49:10.502229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 07 21:49:10.502229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 07 21:49:10.502229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 07 21:49:10.502229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 07 21:49:10.502229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 07 21:49:10.502229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 07 21:49:10.506973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 07 21:49:10.506973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 21:49:10.506973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception Jun 07 21:49:10.506973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 21:49:10.506973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 21:49:10.506973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 21:49:10.506973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 21:49:10.506973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 21:49:10.506973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 21:49:10.506973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 21:49:10.506973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application conn.query(q) Jun 07 21:49:10.506973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 21:49:10.506973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 21:49:10.506973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 21:49:10.506973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result.read() Jun 07 21:49:10.506973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 21:49:10.506973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 21:49:10.508849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 21:49:10.508849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 21:49:10.508849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 21:49:10.508849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 21:49:10.508849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 21:49:10.508849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 21:49:10.508849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 07 21:49:10.508849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 07 21:49:10.508849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [parameters: {'id': '7778fbd7107f4dcdb1c2ccd8a61bb544', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 07 21:49:10.508849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 07 21:49:10.508849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:10.508849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:49:10.508849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:10.508849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:10.508849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 07 21:49:10.510507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 07 21:49:10.510507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 07 21:49:10.510507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 07 21:49:10.510507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 07 21:49:10.510507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:10.510507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:49:10.510507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:10.510507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:10.510507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:10.510507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:10.510507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:10.510507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:10.510507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:10.510507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:10.510507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:10.510507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:10.510507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:10.512556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:10.512556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 07 21:49:10.512556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 07 21:49:10.512556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:10.512556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:10.512556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 07 21:49:10.512556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 07 21:49:10.512556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7778fbd7107f4dcdb1c2ccd8a61bb544. Jun 07 21:49:10.512556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:10.512556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 473/953] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Jun 7 21:49:10 2022] POST /identity/v3/projects => generated 262 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:10.513688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969777f-399f-4c75-be8d-27fc093a231f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:10.614289 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969777f-399f-4c75-be8d-27fc093a231f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:10.648872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fb100-2f66-4540-a02d-beb7bc08fa50 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:10.649201 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fb100-2f66-4540-a02d-beb7bc08fa50 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:10.649776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fb100-2f66-4540-a02d-beb7bc08fa50 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:10.653450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc968a-22e7-49e3-9db0-5c86bac62115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:10.654293 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc968a-22e7-49e3-9db0-5c86bac62115 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:10.654414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 474/954] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:49:10.654549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc968a-22e7-49e3-9db0-5c86bac62115 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:10.654818 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc968a-22e7-49e3-9db0-5c86bac62115 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:10.660570 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eae3c9-aba2-48fe-b2f5-f23abf7efb4f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:10.660862 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eae3c9-aba2-48fe-b2f5-f23abf7efb4f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:10.661139 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eae3c9-aba2-48fe-b2f5-f23abf7efb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:10.665609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc968a-22e7-49e3-9db0-5c86bac62115 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:10.667116 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc968a-22e7-49e3-9db0-5c86bac62115 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:10.681026 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-25eae3c9-aba2-48fe-b2f5-f23abf7efb4f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:10.682491 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-25eae3c9-aba2-48fe-b2f5-f23abf7efb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:10.684535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-fdfc968a-22e7-49e3-9db0-5c86bac62115 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:49:10.684535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:10.684535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:10.684535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:10.684535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:10.684535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:10.684535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:10.684535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:10.684535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:10.684535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:10.684535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:10.684535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:10.684535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:49:10.684535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:49:10.684535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:49:10.685381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:49:10.685381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:10.685381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:10.685381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:10.685381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:10.685381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:10.685381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:10.685381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:10.685381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:10.685381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:10.685381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:10.685381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:10.685381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:10.685381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:10.685381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:10.685381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:10.685381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:10.686427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:49:10.686427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:49:10.686427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:49:10.686427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:49:10.686427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:49:10.686427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:49:10.686427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:49:10.686427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:10.686945 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 481/955] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:49:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:10.693159 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc968a-22e7-49e3-9db0-5c86bac62115 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:10.709027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:10.727935 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:10.759808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 475/956] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:10.781911 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eae3c9-aba2-48fe-b2f5-f23abf7efb4f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:10.834440 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc968a-22e7-49e3-9db0-5c86bac62115 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:10.877329 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179b275-fd28-4c7c-9416-70cc6f80ccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:10.878023 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b275-fd28-4c7c-9416-70cc6f80ccb2 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:10.878338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b275-fd28-4c7c-9416-70cc6f80ccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:10.878914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b275-fd28-4c7c-9416-70cc6f80ccb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:10.879968 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179b275-fd28-4c7c-9416-70cc6f80ccb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:10.880285 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179b275-fd28-4c7c-9416-70cc6f80ccb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:10.881886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179b275-fd28-4c7c-9416-70cc6f80ccb2 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:10.904066 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eae3c9-aba2-48fe-b2f5-f23abf7efb4f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:10.906006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 482/957] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 7 21:49:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:10.948132 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705437ad-c916-43e9-b2e4-b2ef76129567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:10.949312 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705437ad-c916-43e9-b2e4-b2ef76129567 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:10.949825 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705437ad-c916-43e9-b2e4-b2ef76129567 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:10.950324 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705437ad-c916-43e9-b2e4-b2ef76129567 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:10.951185 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705437ad-c916-43e9-b2e4-b2ef76129567 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:10.952955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705437ad-c916-43e9-b2e4-b2ef76129567 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:10.966814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-705437ad-c916-43e9-b2e4-b2ef76129567 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 21:49:10.966814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:10.966814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:49:10.966814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:49:10.966814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:49:10.966814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:49:10.966814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:49:10.966814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:10.966814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 21:49:10.966814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:10.966814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:49:10.966814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:10.966814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:10.966814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:10.966814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:10.966814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:10.966814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:10.967929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:10.967929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:10.967929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:10.967929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:10.967929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:10.967929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:10.967929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:49:10.967929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:49:10.967929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:49:10.967929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:49:10.967929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:10.967929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:10.967929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:10.967929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:10.967929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:10.967929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:10.968850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:10.968850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:10.968850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:10.968850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:10.968850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:10.968850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:10.968850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:10.968850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:10.968850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:10.968850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:10.968850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:49:10.968850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:10.968850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 21:49:10.968850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:10.971912 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 476/958] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:49:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:10.979866 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179b275-fd28-4c7c-9416-70cc6f80ccb2 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:11.074742 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:11.098004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179b275-fd28-4c7c-9416-70cc6f80ccb2 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:11.134308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc288f54-0e0d-4082-be4e-d99cf4d7dc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:11.135355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc288f54-0e0d-4082-be4e-d99cf4d7dc91 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:11.135833 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc288f54-0e0d-4082-be4e-d99cf4d7dc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:11.136317 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc288f54-0e0d-4082-be4e-d99cf4d7dc91 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:11.137206 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc288f54-0e0d-4082-be4e-d99cf4d7dc91 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:11.137702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc288f54-0e0d-4082-be4e-d99cf4d7dc91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:11.139294 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc288f54-0e0d-4082-be4e-d99cf4d7dc91 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:11.144725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 483/959] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 7 21:49:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:11.151087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705437ad-c916-43e9-b2e4-b2ef76129567 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:11.177115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:11.257017 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705437ad-c916-43e9-b2e4-b2ef76129567 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:11.293796 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a7db0-9d41-4b10-9c54-3542d4e03b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:11.294881 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a7db0-9d41-4b10-9c54-3542d4e03b9b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:11.295362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a7db0-9d41-4b10-9c54-3542d4e03b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:11.295859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a7db0-9d41-4b10-9c54-3542d4e03b9b None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:11.296771 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a7db0-9d41-4b10-9c54-3542d4e03b9b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:11.297267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a7db0-9d41-4b10-9c54-3542d4e03b9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:11.298955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a7db0-9d41-4b10-9c54-3542d4e03b9b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:11.304659 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 477/960] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 7 21:49:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:11.923715 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d09320-bf4f-4370-b5f4-4640e0cf8da9 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:11.924051 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d09320-bf4f-4370-b5f4-4640e0cf8da9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:11.924268 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d09320-bf4f-4370-b5f4-4640e0cf8da9 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:11.925843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 484/961] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:11.931348 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded71ac-7b00-47df-b7ac-bbe33b97d1ff None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:11.931634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded71ac-7b00-47df-b7ac-bbe33b97d1ff None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:11.931911 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded71ac-7b00-47df-b7ac-bbe33b97d1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:11.949257 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1ded71ac-7b00-47df-b7ac-bbe33b97d1ff None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:11.950454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1ded71ac-7b00-47df-b7ac-bbe33b97d1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:12.020978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 478/962] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 21:49:12.043322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d09320-bf4f-4370-b5f4-4640e0cf8da9 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:12.154767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d09320-bf4f-4370-b5f4-4640e0cf8da9 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:12.192477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe9278-d0b3-41be-8499-bcecbd792ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:12.193667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe9278-d0b3-41be-8499-bcecbd792ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:12.194264 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe9278-d0b3-41be-8499-bcecbd792ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:12.194744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe9278-d0b3-41be-8499-bcecbd792ae5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:12.195593 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe9278-d0b3-41be-8499-bcecbd792ae5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:12.197678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe9278-d0b3-41be-8499-bcecbd792ae5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:12.210214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-63fe9278-d0b3-41be-8499-bcecbd792ae5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 21:49:12.210214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:12.210214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:49:12.210214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:49:12.210214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:49:12.210214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:49:12.210214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:49:12.210214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:12.210214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 21:49:12.210214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:12.210214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:49:12.210214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:12.210214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:12.210214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:12.210214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:12.210214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:12.210214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:12.211482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:12.211482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:12.211482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:12.211482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:12.211482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:12.211482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:12.211482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:49:12.211482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:49:12.211482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:49:12.211482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:49:12.211482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:12.211482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:12.211482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:12.211482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:12.211482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:12.211482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:12.212873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:12.212873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:12.212873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:12.212873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:12.212873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:12.212873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:12.212873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:12.212873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:12.212873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:12.212873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:12.212873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:49:12.212873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:12.212873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 21:49:12.212873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:12.215758 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 485/963] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 7 21:49:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:12.225983 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded71ac-7b00-47df-b7ac-bbe33b97d1ff None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:12.239196 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:12.326466 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded71ac-7b00-47df-b7ac-bbe33b97d1ff None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:12.372571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3deb4-7e07-4e08-89e8-adea05bffacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:12.373253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3deb4-7e07-4e08-89e8-adea05bffacc None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:12.373538 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3deb4-7e07-4e08-89e8-adea05bffacc None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:12.373812 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3deb4-7e07-4e08-89e8-adea05bffacc None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:12.374569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3deb4-7e07-4e08-89e8-adea05bffacc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:12.374877 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3deb4-7e07-4e08-89e8-adea05bffacc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:12.376273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3deb4-7e07-4e08-89e8-adea05bffacc None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:12.381803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 479/964] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 7 21:49:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:12.387669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe9278-d0b3-41be-8499-bcecbd792ae5 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:12.399706 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:12.438947 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac14ac-1fff-4027-a55f-4fe2d482b44b None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:12.439251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac14ac-1fff-4027-a55f-4fe2d482b44b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:12.439529 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac14ac-1fff-4027-a55f-4fe2d482b44b None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:12.441277 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 480/965] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:49:12.447650 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf1557-e49d-4b15-937f-127040986fae None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:12.447883 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf1557-e49d-4b15-937f-127040986fae None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:12.448166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf1557-e49d-4b15-937f-127040986fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:12.470405 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1adf1557-e49d-4b15-937f-127040986fae None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:12.472101 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1adf1557-e49d-4b15-937f-127040986fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:12.500405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe9278-d0b3-41be-8499-bcecbd792ae5 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:12.537991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85681ac1-5f52-4986-8ea4-9821ca2eecad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:12.538982 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85681ac1-5f52-4986-8ea4-9821ca2eecad None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:12.539402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85681ac1-5f52-4986-8ea4-9821ca2eecad None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:12.539963 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85681ac1-5f52-4986-8ea4-9821ca2eecad None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:12.540811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85681ac1-5f52-4986-8ea4-9821ca2eecad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:12.541258 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85681ac1-5f52-4986-8ea4-9821ca2eecad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:12.542888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85681ac1-5f52-4986-8ea4-9821ca2eecad None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:12.548709 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 486/966] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 7 21:49:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:12.554643 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85681ac1-5f52-4986-8ea4-9821ca2eecad None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:12.561990 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 481/967] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:12.586916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf1557-e49d-4b15-937f-127040986fae None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:12.598795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:12.657664 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:12.694057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85681ac1-5f52-4986-8ea4-9821ca2eecad None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:12.708291 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf1557-e49d-4b15-937f-127040986fae None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:12.731835 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87df99-b6d7-48e5-9f93-d3bec9eafb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:12.732785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87df99-b6d7-48e5-9f93-d3bec9eafb77 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:12.733345 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87df99-b6d7-48e5-9f93-d3bec9eafb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:12.733829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87df99-b6d7-48e5-9f93-d3bec9eafb77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:12.734844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87df99-b6d7-48e5-9f93-d3bec9eafb77 None admin] RBAC: Adding query filter params (interface=admin, service_id=8fb9ea331413468e980057e03466aa5e, region_id=RegionOne) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:12.735371 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87df99-b6d7-48e5-9f93-d3bec9eafb77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:12.737124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87df99-b6d7-48e5-9f93-d3bec9eafb77 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:12.747280 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 487/968] 10.222.0.18 () {56 vars in 1249 bytes} [Tue Jun 7 21:49:12 2022] GET /identity/v3/endpoints?service_id=8fb9ea331413468e980057e03466aa5e&interface=admin®ion_id=RegionOne => generated 193 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:12.748811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87df99-b6d7-48e5-9f93-d3bec9eafb77 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:12.749774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef284ec7-0923-40ad-9847-6aaa419e148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:12.750994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef284ec7-0923-40ad-9847-6aaa419e148b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:12.751273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef284ec7-0923-40ad-9847-6aaa419e148b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:12.751546 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef284ec7-0923-40ad-9847-6aaa419e148b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:12.768617 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef284ec7-0923-40ad-9847-6aaa419e148b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:49:12.778758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-ef284ec7-0923-40ad-9847-6aaa419e148b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 21:49:12.778758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:12.778758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:12.778758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:12.778758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:12.778758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:12.778758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:12.778758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:12.778758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:12.778758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:12.778758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:12.778758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:12.778758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:49:12.778758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:49:12.778758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:49:12.778758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:49:12.779786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:49:12.779786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:49:12.779786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:49:12.779786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:49:12.779786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:12.779786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:12.779786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:12.779786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:12.779786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:12.779786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:12.779786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:12.779786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:12.779786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:12.779786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:12.779786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:12.779786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:12.780651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:12.780651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:12.780651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:12.780651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:12.780651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:49:12.780651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:49:12.780651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:49:12.780651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:49:12.780651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:49:12.780651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:49:12.780651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 21:49:12.780651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:12.784988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 482/969] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jun 7 21:49:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:12.786542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef284ec7-0923-40ad-9847-6aaa419e148b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:12.864473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:12.874280 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87df99-b6d7-48e5-9f93-d3bec9eafb77 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:12.900852 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef284ec7-0923-40ad-9847-6aaa419e148b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:12.917357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd194cb-e0ae-480f-8432-b425df6db6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:12.918328 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd194cb-e0ae-480f-8432-b425df6db6bb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:12.918615 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd194cb-e0ae-480f-8432-b425df6db6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:12.918889 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd194cb-e0ae-480f-8432-b425df6db6bb None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:12.919569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd194cb-e0ae-480f-8432-b425df6db6bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:12.921413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd194cb-e0ae-480f-8432-b425df6db6bb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:12.923297 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:12.933972 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 488/970] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 7 21:49:12 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 21:49:12.941476 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f47383-40c0-4265-87d2-728da9afc49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:12.942200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f47383-40c0-4265-87d2-728da9afc49d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:12.942485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f47383-40c0-4265-87d2-728da9afc49d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:12.942763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f47383-40c0-4265-87d2-728da9afc49d None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:12.943530 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f47383-40c0-4265-87d2-728da9afc49d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:12.943839 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f47383-40c0-4265-87d2-728da9afc49d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:12.945250 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f47383-40c0-4265-87d2-728da9afc49d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:12.960423 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 483/971] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jun 7 21:49:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:12.962011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd194cb-e0ae-480f-8432-b425df6db6bb None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:13.082141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd194cb-e0ae-480f-8432-b425df6db6bb None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:13.122307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e2bee-d476-43ec-89dc-1b5d0c199235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:13.123528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e2bee-d476-43ec-89dc-1b5d0c199235 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:13.124016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e2bee-d476-43ec-89dc-1b5d0c199235 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:13.124482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e2bee-d476-43ec-89dc-1b5d0c199235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:13.137956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e2bee-d476-43ec-89dc-1b5d0c199235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:13.139851 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e2bee-d476-43ec-89dc-1b5d0c199235 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:13.159036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-d62e2bee-d476-43ec-89dc-1b5d0c199235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:13.159036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:13.159036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:13.159036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:13.159036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:13.159036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:13.159036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:13.159036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:13.159036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:13.159036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:13.159036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:13.159036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:13.159036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:49:13.159036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:49:13.159036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:49:13.160390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:49:13.160390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:13.160390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:13.160390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:13.160390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:13.160390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:13.160390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:13.160390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:13.160390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:13.160390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:13.160390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:13.160390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:13.160390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:13.160390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:13.160390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:13.160390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:13.160390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:13.161276 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:49:13.161276 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:49:13.161276 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:13.161276 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:13.163447 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 489/972] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:13.169258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f47383-40c0-4265-87d2-728da9afc49d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:13.281737 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f47383-40c0-4265-87d2-728da9afc49d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:13.317197 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:13.323095 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70aada-a0d8-44ce-b249-a31e0ff0b68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:13.323766 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70aada-a0d8-44ce-b249-a31e0ff0b68d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:13.324050 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70aada-a0d8-44ce-b249-a31e0ff0b68d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:13.324325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70aada-a0d8-44ce-b249-a31e0ff0b68d None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:13.325051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70aada-a0d8-44ce-b249-a31e0ff0b68d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:13.325358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70aada-a0d8-44ce-b249-a31e0ff0b68d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:13.326759 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70aada-a0d8-44ce-b249-a31e0ff0b68d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:13.340374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 484/973] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:13.345738 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e2bee-d476-43ec-89dc-1b5d0c199235 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:13.396619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994fb21-a497-49e3-a402-973f4017665c None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:13.396934 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994fb21-a497-49e3-a402-973f4017665c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:13.397187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994fb21-a497-49e3-a402-973f4017665c None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:13.398929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 485/974] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:13.404103 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d4ac6-85e5-4210-8c1c-c51001a39f5d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:13.404506 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d4ac6-85e5-4210-8c1c-c51001a39f5d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:13.404791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d4ac6-85e5-4210-8c1c-c51001a39f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:13.415098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:13.423810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-627d4ac6-85e5-4210-8c1c-c51001a39f5d None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:13.426215 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-627d4ac6-85e5-4210-8c1c-c51001a39f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:13.464619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e2bee-d476-43ec-89dc-1b5d0c199235 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:13.505955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b766d-3586-4930-80f1-a01ca56ff209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:13.505955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b766d-3586-4930-80f1-a01ca56ff209 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:13.505955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b766d-3586-4930-80f1-a01ca56ff209 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:13.505955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b766d-3586-4930-80f1-a01ca56ff209 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:13.506386 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 486/975] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 21:49:13.514950 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b766d-3586-4930-80f1-a01ca56ff209 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:13.516413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b766d-3586-4930-80f1-a01ca56ff209 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:13.525872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d4ac6-85e5-4210-8c1c-c51001a39f5d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:13.543069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-251b766d-3586-4930-80f1-a01ca56ff209 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 21:49:13.543069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:13.543069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:13.543069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:13.543069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:13.543069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:13.543069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:13.543069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:13.543069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:13.543069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:13.543069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:13.543069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:13.543069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:49:13.543069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:49:13.543069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:49:13.543069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:13.544081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:13.545035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:13.545035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:13.545035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:49:13.545035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:49:13.545035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:49:13.545035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:49:13.545035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:49:13.545035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:49:13.545035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 21:49:13.545035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:13.547990 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 490/976] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 7 21:49:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:13.557973 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b766d-3586-4930-80f1-a01ca56ff209 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:13.649831 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d4ac6-85e5-4210-8c1c-c51001a39f5d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:13.659729 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b766d-3586-4930-80f1-a01ca56ff209 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:13.673786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:13.675110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:13.687281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71860a5-de53-44e9-9192-876b9796ba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:13.687947 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71860a5-de53-44e9-9192-876b9796ba79 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:13.688226 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71860a5-de53-44e9-9192-876b9796ba79 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:13.688496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71860a5-de53-44e9-9192-876b9796ba79 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:13.689203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71860a5-de53-44e9-9192-876b9796ba79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:13.690651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71860a5-de53-44e9-9192-876b9796ba79 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:13.698902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e764e4-c50a-43cc-b052-b7396766c181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:13.700262 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e764e4-c50a-43cc-b052-b7396766c181 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:13.701116 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e764e4-c50a-43cc-b052-b7396766c181 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:13.701625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e764e4-c50a-43cc-b052-b7396766c181 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:13.702879 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e764e4-c50a-43cc-b052-b7396766c181 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:13.703191 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e764e4-c50a-43cc-b052-b7396766c181 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:13.704153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.sql.core [None req-f71860a5-de53-44e9-9192-876b9796ba79 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 07 21:49:13.704153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 07 21:49:13.704153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [parameters: {'user_id': 'b9a73cdc0014428ab3ba86feef29bd51', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 07 21:49:13.704153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80404) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 07 21:49:13.704628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e764e4-c50a-43cc-b052-b7396766c181 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:13.711454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-f71860a5-de53-44e9-9192-876b9796ba79 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 07 21:49:13.711454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:13.711454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 21:49:13.711454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 21:49:13.711454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 21:49:13.711454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 21:49:13.711454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 21:49:13.711454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 21:49:13.711454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 21:49:13.711454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application conn.query(q) Jun 07 21:49:13.711454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 21:49:13.711454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 21:49:13.711454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 21:49:13.711454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result.read() Jun 07 21:49:13.711454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 21:49:13.712350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application next(self.gen) Jun 07 21:49:13.713321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 07 21:49:13.713321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application yield resource Jun 07 21:49:13.713321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 21:49:13.713321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application next(self.gen) Jun 07 21:49:13.713321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 07 21:49:13.713321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.session.rollback() Jun 07 21:49:13.713321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 07 21:49:13.713321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.force_reraise() Jun 07 21:49:13.713321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 07 21:49:13.713321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise self.value Jun 07 21:49:13.713321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 07 21:49:13.713321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 07 21:49:13.713321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 07 21:49:13.713321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application session.commit() Jun 07 21:49:13.713321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 07 21:49:13.713321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 07 21:49:13.713321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 07 21:49:13.714957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._prepare_impl() Jun 07 21:49:13.714957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 07 21:49:13.714957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.session.flush() Jun 07 21:49:13.714957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 07 21:49:13.714957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._flush(objects) Jun 07 21:49:13.714957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 07 21:49:13.714957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 07 21:49:13.714957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 07 21:49:13.714957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application compat.raise_( Jun 07 21:49:13.714957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 21:49:13.714957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception Jun 07 21:49:13.714957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 07 21:49:13.714957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application flush_context.execute() Jun 07 21:49:13.714957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 07 21:49:13.714957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rec.execute(self) Jun 07 21:49:13.714957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 07 21:49:13.714957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 07 21:49:13.715869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 07 21:49:13.715869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 07 21:49:13.715869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 07 21:49:13.715869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 07 21:49:13.715869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 07 21:49:13.715869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 07 21:49:13.715869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 07 21:49:13.715869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 07 21:49:13.715869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 07 21:49:13.715869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 07 21:49:13.715869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 07 21:49:13.715869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 07 21:49:13.715869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 07 21:49:13.715869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 07 21:49:13.715869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 21:49:13.715869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception Jun 07 21:49:13.717473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 21:49:13.717473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 21:49:13.717473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 21:49:13.717473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 21:49:13.717473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 21:49:13.717473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 21:49:13.717473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 21:49:13.717473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application conn.query(q) Jun 07 21:49:13.717473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 21:49:13.717473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 21:49:13.717473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 21:49:13.717473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application result.read() Jun 07 21:49:13.717473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 21:49:13.717473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 21:49:13.717473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 21:49:13.717473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 21:49:13.720808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 21:49:13.720808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 21:49:13.720808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 21:49:13.720808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 21:49:13.720808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 07 21:49:13.720808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 07 21:49:13.720808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b9a73cdc0014428ab3ba86feef29bd51', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 07 21:49:13.720808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 07 21:49:13.720808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:13.720808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:49:13.720808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:13.720808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:13.720808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:13.720808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:13.720808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:13.722822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:13.722822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:13.722822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:13.722822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:13.722822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:13.722822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:13.722822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:13.722822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 07 21:49:13.722822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 07 21:49:13.722822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:13.722822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:13.722822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:49:13.722822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:49:13.722822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:49:13.722822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:49:13.722822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 07 21:49:13.722822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 07 21:49:13.724602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 07 21:49:13.724602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 07 21:49:13.724602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 07 21:49:13.724602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 07 21:49:13.724602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 07 21:49:13.724602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:13.724602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 487/977] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jun 7 21:49:13 2022] POST /identity/v3/users => generated 160 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:13.724602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3260cc-d2b5-44f7-b84d-f9ced05e7631 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:13.724602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3260cc-d2b5-44f7-b84d-f9ced05e7631 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:13.724602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3260cc-d2b5-44f7-b84d-f9ced05e7631 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:13.725251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 488/978] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:13.725251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3260cc-d2b5-44f7-b84d-f9ced05e7631 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:13.734315 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 491/979] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jun 7 21:49:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:13.734315 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021f715-333c-451a-ad72-900d70cee7fa None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:13.734315 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021f715-333c-451a-ad72-900d70cee7fa None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:13.734315 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021f715-333c-451a-ad72-900d70cee7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:13.751789 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e021f715-333c-451a-ad72-900d70cee7fa None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:13.753652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e021f715-333c-451a-ad72-900d70cee7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:13.831176 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 492/980] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:13.832042 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021f715-333c-451a-ad72-900d70cee7fa None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:13.838669 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3260cc-d2b5-44f7-b84d-f9ced05e7631 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:13.875624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7328dd-9088-4e82-960c-db5a4a658b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:13.876522 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7328dd-9088-4e82-960c-db5a4a658b36 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:13.876865 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7328dd-9088-4e82-960c-db5a4a658b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:13.877233 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7328dd-9088-4e82-960c-db5a4a658b36 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:13.884982 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7328dd-9088-4e82-960c-db5a4a658b36 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:13.886808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7328dd-9088-4e82-960c-db5a4a658b36 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:13.901799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-4e7328dd-9088-4e82-960c-db5a4a658b36 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 21:49:13.901799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:13.901799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:13.901799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:13.901799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:13.901799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:13.901799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:13.901799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:13.901799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:13.901799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:13.901799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:13.901799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:13.901799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:49:13.901799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:49:13.901799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:49:13.901799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:13.902943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:13.904064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:13.904064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:13.904064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:49:13.904064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:49:13.904064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:49:13.904064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:49:13.904064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:49:13.904064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:49:13.904064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 21:49:13.904064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:13.908678 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 489/981] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:49:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:13.909287 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7328dd-9088-4e82-960c-db5a4a658b36 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:13.947216 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:13.950612 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021f715-333c-451a-ad72-900d70cee7fa None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:13.956325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:13.989721 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b2ace-ce1d-4d05-ae80-f885bac353a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:13.990465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b2ace-ce1d-4d05-ae80-f885bac353a7 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:13.990918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b2ace-ce1d-4d05-ae80-f885bac353a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:13.991245 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b2ace-ce1d-4d05-ae80-f885bac353a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:14.015003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7328dd-9088-4e82-960c-db5a4a658b36 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:14.052668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57002ac2-dddc-4cb0-b2c2-85d777a1d1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:14.053465 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57002ac2-dddc-4cb0-b2c2-85d777a1d1fc None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:14.053837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57002ac2-dddc-4cb0-b2c2-85d777a1d1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:14.054236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57002ac2-dddc-4cb0-b2c2-85d777a1d1fc None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:14.055558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57002ac2-dddc-4cb0-b2c2-85d777a1d1fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:14.057006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57002ac2-dddc-4cb0-b2c2-85d777a1d1fc None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:14.066796 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b2ace-ce1d-4d05-ae80-f885bac353a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:14.068262 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b2ace-ce1d-4d05-ae80-f885bac353a7 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:14.071647 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 490/982] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 7 21:49:13 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:49:14.072364 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57002ac2-dddc-4cb0-b2c2-85d777a1d1fc None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:14.212353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:14.214508 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:14.221980 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 493/983] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:49:13 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:49:14.227474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b2ace-ce1d-4d05-ae80-f885bac353a7 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:14.230705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57002ac2-dddc-4cb0-b2c2-85d777a1d1fc None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:14.280195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41f906-7946-40c3-ac34-0a548615be88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:14.280882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41f906-7946-40c3-ac34-0a548615be88 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:14.281166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41f906-7946-40c3-ac34-0a548615be88 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:14.281440 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41f906-7946-40c3-ac34-0a548615be88 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:14.282325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41f906-7946-40c3-ac34-0a548615be88 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:14.282873 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41f906-7946-40c3-ac34-0a548615be88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:14.284061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41f906-7946-40c3-ac34-0a548615be88 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:14.332296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 491/984] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 7 21:49:14 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:14.381332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b2ace-ce1d-4d05-ae80-f885bac353a7 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:14.421202 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6624a0-914e-4646-bb6e-fcac368d2f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:14.422042 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6624a0-914e-4646-bb6e-fcac368d2f99 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:14.422379 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6624a0-914e-4646-bb6e-fcac368d2f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:14.422656 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6624a0-914e-4646-bb6e-fcac368d2f99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:14.434576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6624a0-914e-4646-bb6e-fcac368d2f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:14.436056 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6624a0-914e-4646-bb6e-fcac368d2f99 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:14.455882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-db6624a0-914e-4646-bb6e-fcac368d2f99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:14.455882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:14.455882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:14.455882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:14.455882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:14.455882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:14.455882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:14.455882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:14.455882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:14.455882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:14.455882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:14.455882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:14.455882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:49:14.455882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:49:14.455882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:49:14.456862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:49:14.456862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:14.456862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:14.456862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:14.456862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:14.456862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:14.456862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:14.456862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:14.456862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:14.456862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:14.456862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:14.456862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:14.456862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:14.456862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:14.456862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:14.456862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:14.456862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:14.457769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:49:14.457769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:49:14.457769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:14.457769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:14.457769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 494/985] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:14.464476 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41f906-7946-40c3-ac34-0a548615be88 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:14.575155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41f906-7946-40c3-ac34-0a548615be88 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:14.617067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f55f0e-3290-4d75-8eac-0dd9463b1d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:14.618297 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f55f0e-3290-4d75-8eac-0dd9463b1d43 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:14.618584 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f55f0e-3290-4d75-8eac-0dd9463b1d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:14.618847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f55f0e-3290-4d75-8eac-0dd9463b1d43 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:14.619573 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f55f0e-3290-4d75-8eac-0dd9463b1d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:14.619875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f55f0e-3290-4d75-8eac-0dd9463b1d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:14.621251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f55f0e-3290-4d75-8eac-0dd9463b1d43 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:14.633816 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 492/986] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:14.639519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6624a0-914e-4646-bb6e-fcac368d2f99 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:14.696750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:14.745587 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6624a0-914e-4646-bb6e-fcac368d2f99 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:14.779629 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb08ad-3c92-40e4-9e0a-2660c80d56e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:14.780408 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb08ad-3c92-40e4-9e0a-2660c80d56e3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:14.780682 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb08ad-3c92-40e4-9e0a-2660c80d56e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:14.780949 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb08ad-3c92-40e4-9e0a-2660c80d56e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:14.787697 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb08ad-3c92-40e4-9e0a-2660c80d56e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:14.789125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb08ad-3c92-40e4-9e0a-2660c80d56e3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:14.803210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-02eb08ad-3c92-40e4-9e0a-2660c80d56e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:49:14.803210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:14.803210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:14.803210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:14.803210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:14.803210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:14.803210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:14.803210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:14.803210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:14.803210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:14.803210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:14.803210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:14.803210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:49:14.803210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:49:14.803210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:49:14.804121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:49:14.804121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:14.804121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:14.804121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:14.804121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:14.804121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:14.804121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:14.804121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:14.804121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:14.804121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:14.804121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:14.804121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:14.804121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:14.804121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:14.804121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:14.804121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:14.804121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:14.805093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:49:14.805093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:49:14.805093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:49:14.805093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:49:14.805093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:49:14.805093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:49:14.805093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:49:14.805093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:14.805093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 495/987] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:49:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:14.810298 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f55f0e-3290-4d75-8eac-0dd9463b1d43 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:14.830240 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:14.913311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f55f0e-3290-4d75-8eac-0dd9463b1d43 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:14.949647 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490a9a1-cc0a-40f6-9889-66f6d44aba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:14.950355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490a9a1-cc0a-40f6-9889-66f6d44aba72 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:14.950634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490a9a1-cc0a-40f6-9889-66f6d44aba72 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:14.950907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490a9a1-cc0a-40f6-9889-66f6d44aba72 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:14.951705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490a9a1-cc0a-40f6-9889-66f6d44aba72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:14.952018 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490a9a1-cc0a-40f6-9889-66f6d44aba72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:14.953470 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490a9a1-cc0a-40f6-9889-66f6d44aba72 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:14.972191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 493/988] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:49:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:14.973494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb08ad-3c92-40e4-9e0a-2660c80d56e3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:15.072610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb08ad-3c92-40e4-9e0a-2660c80d56e3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:15.085069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:15.108163 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787cd3d-7aae-4062-9ed3-1b8fa2f906c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:15.108820 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787cd3d-7aae-4062-9ed3-1b8fa2f906c7 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:15.109104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787cd3d-7aae-4062-9ed3-1b8fa2f906c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:15.109380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787cd3d-7aae-4062-9ed3-1b8fa2f906c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:15.110235 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787cd3d-7aae-4062-9ed3-1b8fa2f906c7 None admin] RBAC: Adding query filter params (role.id=7dadc9b4653f4b31856163d4e2cc6469, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=4fc55e3a9107489a9b24385ac5379ca9) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:15.110549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787cd3d-7aae-4062-9ed3-1b8fa2f906c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:15.111979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787cd3d-7aae-4062-9ed3-1b8fa2f906c7 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:15.118095 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 496/989] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:49:14 2022] GET /identity/v3/role_assignments?user.id=4fc55e3a9107489a9b24385ac5379ca9&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=7dadc9b4653f4b31856163d4e2cc6469 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:15.278094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb51ec-b59b-4a6b-920c-2939fbd6c5cc None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:15.278445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb51ec-b59b-4a6b-920c-2939fbd6c5cc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:15.278666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb51ec-b59b-4a6b-920c-2939fbd6c5cc None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:15.280187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 494/990] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:15.285866 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6741d24-217c-4ab4-9835-f273811e36f3 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:15.286414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6741d24-217c-4ab4-9835-f273811e36f3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:15.286487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6741d24-217c-4ab4-9835-f273811e36f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:15.304516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d6741d24-217c-4ab4-9835-f273811e36f3 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:15.305760 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d6741d24-217c-4ab4-9835-f273811e36f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:15.377631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 497/991] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:15.401017 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb51ec-b59b-4a6b-920c-2939fbd6c5cc None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:15.481319 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:15.505056 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb51ec-b59b-4a6b-920c-2939fbd6c5cc None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:15.539039 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240099a3-1d19-4bfc-ba72-bc552a88d155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:15.540370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240099a3-1d19-4bfc-ba72-bc552a88d155 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:15.540650 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240099a3-1d19-4bfc-ba72-bc552a88d155 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:15.540918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240099a3-1d19-4bfc-ba72-bc552a88d155 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:15.541553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240099a3-1d19-4bfc-ba72-bc552a88d155 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:15.542938 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240099a3-1d19-4bfc-ba72-bc552a88d155 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:15.554632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-240099a3-1d19-4bfc-ba72-bc552a88d155 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 21:49:15.554632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:15.554632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:49:15.554632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:49:15.554632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:49:15.554632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:49:15.554632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:49:15.554632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:15.554632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 21:49:15.554632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:15.554632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:49:15.554632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:15.554632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:15.554632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:15.554632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:15.554632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:15.554632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:15.555623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:15.555623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:15.555623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:15.555623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:15.555623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:15.555623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:15.555623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:49:15.555623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:49:15.555623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:49:15.555623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:49:15.555623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:15.555623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:15.555623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:15.555623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:15.555623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:15.555623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:15.556456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:15.556456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:15.556456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:15.556456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:15.556456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:15.556456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:15.556456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:15.556456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:15.556456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:15.556456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:15.556456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:49:15.556456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:15.556456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 21:49:15.556456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:15.558008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 495/992] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 7 21:49:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:15.561891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6741d24-217c-4ab4-9835-f273811e36f3 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:15.664242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6741d24-217c-4ab4-9835-f273811e36f3 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:15.672461 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:15.700428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab26d8-f92e-44de-b806-75258a4eb304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:15.701090 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab26d8-f92e-44de-b806-75258a4eb304 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:15.701374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab26d8-f92e-44de-b806-75258a4eb304 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:15.701649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab26d8-f92e-44de-b806-75258a4eb304 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:15.702390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab26d8-f92e-44de-b806-75258a4eb304 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:15.702699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab26d8-f92e-44de-b806-75258a4eb304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:15.704071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab26d8-f92e-44de-b806-75258a4eb304 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:15.714144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 498/993] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 7 21:49:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:15.715081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240099a3-1d19-4bfc-ba72-bc552a88d155 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:15.814384 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240099a3-1d19-4bfc-ba72-bc552a88d155 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:15.847780 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfd309-610d-4e78-8512-a78f52fd2907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:15.848454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfd309-610d-4e78-8512-a78f52fd2907 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:15.848741 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfd309-610d-4e78-8512-a78f52fd2907 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:15.849019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfd309-610d-4e78-8512-a78f52fd2907 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:15.849723 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfd309-610d-4e78-8512-a78f52fd2907 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:15.850058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfd309-610d-4e78-8512-a78f52fd2907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:15.851698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfd309-610d-4e78-8512-a78f52fd2907 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:15.861908 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 496/994] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 7 21:49:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:15.863165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab26d8-f92e-44de-b806-75258a4eb304 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:15.965056 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab26d8-f92e-44de-b806-75258a4eb304 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:15.999317 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741379c-cb8d-4fcc-adaf-48981612955e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:15.999972 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741379c-cb8d-4fcc-adaf-48981612955e None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:16.000248 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741379c-cb8d-4fcc-adaf-48981612955e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:16.000514 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741379c-cb8d-4fcc-adaf-48981612955e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:16.001237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741379c-cb8d-4fcc-adaf-48981612955e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:16.002620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741379c-cb8d-4fcc-adaf-48981612955e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:16.025967 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 499/995] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 7 21:49:15 2022] POST /identity/v3/endpoints => generated 325 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:49:16.414664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5473ed-a0e8-47a8-84cf-a052191730dc None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:16.415168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5473ed-a0e8-47a8-84cf-a052191730dc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:16.415268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5473ed-a0e8-47a8-84cf-a052191730dc None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:16.416736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 497/996] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:16.421957 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696dda7-adc1-4285-a76c-76d325581b5e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:16.422361 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696dda7-adc1-4285-a76c-76d325581b5e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:16.422518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696dda7-adc1-4285-a76c-76d325581b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:16.439175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1696dda7-adc1-4285-a76c-76d325581b5e None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:16.440366 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1696dda7-adc1-4285-a76c-76d325581b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:16.464195 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:16.514908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 500/997] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:16 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:16.537638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5473ed-a0e8-47a8-84cf-a052191730dc None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:16.547615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:16.639865 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5473ed-a0e8-47a8-84cf-a052191730dc None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:16.672773 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bd793-207e-4c38-83ff-0c9f367c8a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:16.673556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bd793-207e-4c38-83ff-0c9f367c8a2e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:16.673835 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bd793-207e-4c38-83ff-0c9f367c8a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:16.674147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bd793-207e-4c38-83ff-0c9f367c8a2e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:16.674796 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bd793-207e-4c38-83ff-0c9f367c8a2e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:16.676157 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bd793-207e-4c38-83ff-0c9f367c8a2e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:16.687863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-7b4bd793-207e-4c38-83ff-0c9f367c8a2e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 21:49:16.687863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:16.687863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:49:16.687863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:49:16.687863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:49:16.687863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:49:16.687863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:49:16.687863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:16.687863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 21:49:16.687863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:16.687863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:49:16.687863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:16.687863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:16.687863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:16.687863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:16.687863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:16.687863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:16.688842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:16.688842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:16.688842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:16.688842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:16.688842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:16.688842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:16.688842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:49:16.688842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:49:16.688842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:49:16.688842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:49:16.688842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:16.688842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:16.688842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:16.688842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:16.688842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:16.688842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:16.689747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:16.689747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:16.689747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:16.689747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:16.689747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:16.689747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:16.689747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:16.689747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:16.689747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:16.689747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:16.689747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:49:16.689747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:16.689747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 21:49:16.689747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:16.694005 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 498/998] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:49:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:16.695331 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696dda7-adc1-4285-a76c-76d325581b5e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:16.795369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696dda7-adc1-4285-a76c-76d325581b5e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:16.829889 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a59e8d-48b4-4456-a08c-c75dc3017c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:16.830870 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59e8d-48b4-4456-a08c-c75dc3017c88 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:16.831359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59e8d-48b4-4456-a08c-c75dc3017c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:16.831812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a59e8d-48b4-4456-a08c-c75dc3017c88 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:16.832683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a59e8d-48b4-4456-a08c-c75dc3017c88 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:16.833164 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a59e8d-48b4-4456-a08c-c75dc3017c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:16.834739 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a59e8d-48b4-4456-a08c-c75dc3017c88 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:16.845157 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 501/999] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 7 21:49:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:16.846813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bd793-207e-4c38-83ff-0c9f367c8a2e None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:16.918345 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:16.949879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bd793-207e-4c38-83ff-0c9f367c8a2e None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:16.983980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f372c-1649-42d2-8b8c-c421c3260e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:16.984638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f372c-1649-42d2-8b8c-c421c3260e34 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:16.984921 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f372c-1649-42d2-8b8c-c421c3260e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:16.985196 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f372c-1649-42d2-8b8c-c421c3260e34 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:16.986044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f372c-1649-42d2-8b8c-c421c3260e34 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:16.986230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f372c-1649-42d2-8b8c-c421c3260e34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:16.987593 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f372c-1649-42d2-8b8c-c421c3260e34 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:16.993366 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 499/1000] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 7 21:49:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:16.999228 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a59e8d-48b4-4456-a08c-c75dc3017c88 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:17.022224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:17.107175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a59e8d-48b4-4456-a08c-c75dc3017c88 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:17.140789 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce0c61-03d0-4d06-96b8-b18ff9bd914a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:17.141452 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce0c61-03d0-4d06-96b8-b18ff9bd914a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:17.141732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce0c61-03d0-4d06-96b8-b18ff9bd914a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:17.142033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce0c61-03d0-4d06-96b8-b18ff9bd914a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:17.142820 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce0c61-03d0-4d06-96b8-b18ff9bd914a None admin] RBAC: Adding query filter params (interface=public, service_id=9eac006f539740cc89cca3629c4626dc, region_id=RegionOne) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:17.143134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce0c61-03d0-4d06-96b8-b18ff9bd914a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:17.144535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce0c61-03d0-4d06-96b8-b18ff9bd914a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:17.154939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 502/1001] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jun 7 21:49:16 2022] GET /identity/v3/endpoints?service_id=9eac006f539740cc89cca3629c4626dc&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:17.156706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f372c-1649-42d2-8b8c-c421c3260e34 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:17.255689 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f372c-1649-42d2-8b8c-c421c3260e34 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:17.289961 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed4171-6c6a-4988-ab04-86f8bfe49367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:17.290623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed4171-6c6a-4988-ab04-86f8bfe49367 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:17.290905 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed4171-6c6a-4988-ab04-86f8bfe49367 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:17.291182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed4171-6c6a-4988-ab04-86f8bfe49367 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:17.291871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed4171-6c6a-4988-ab04-86f8bfe49367 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:17.293219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed4171-6c6a-4988-ab04-86f8bfe49367 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:17.294303 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:17.301185 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 500/1002] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 7 21:49:17 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 21:49:17.404416 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584c6fb-9a01-40af-9f2e-c1ec7ec4221b None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:17.404699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584c6fb-9a01-40af-9f2e-c1ec7ec4221b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:17.404976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584c6fb-9a01-40af-9f2e-c1ec7ec4221b None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:17.406424 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 503/1003] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:17.412146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62413256-656d-46b4-a375-b4aaa37f7b30 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:17.412426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62413256-656d-46b4-a375-b4aaa37f7b30 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:17.412700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62413256-656d-46b4-a375-b4aaa37f7b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:17.430358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-62413256-656d-46b4-a375-b4aaa37f7b30 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:17.431888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-62413256-656d-46b4-a375-b4aaa37f7b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:17.504339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 501/1004] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:17 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:17.527296 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584c6fb-9a01-40af-9f2e-c1ec7ec4221b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:17.612695 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:17.631080 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584c6fb-9a01-40af-9f2e-c1ec7ec4221b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:17.668262 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1527667-c17e-4ca9-87da-84190e40f398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:17.669053 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1527667-c17e-4ca9-87da-84190e40f398 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:17.669336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1527667-c17e-4ca9-87da-84190e40f398 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:17.669610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1527667-c17e-4ca9-87da-84190e40f398 None admin] PATH_INFO: `/v3/services/image` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:17.670289 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1527667-c17e-4ca9-87da-84190e40f398 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:17.671676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1527667-c17e-4ca9-87da-84190e40f398 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:17.683761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-e1527667-c17e-4ca9-87da-84190e40f398 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 21:49:17.683761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:17.683761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:49:17.683761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:49:17.683761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:49:17.683761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:49:17.683761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:49:17.683761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:17.683761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 21:49:17.683761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:17.683761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:49:17.683761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:17.683761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:17.683761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:17.683761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:17.683761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:17.683761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:17.684782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:17.684782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:17.684782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:17.684782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:17.684782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:17.684782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:17.684782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:49:17.684782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:49:17.684782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:49:17.684782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:49:17.684782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:17.684782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:17.684782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:17.684782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:17.684782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:17.684782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:17.690809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:17.690809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:17.690809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:17.690809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:17.690809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:17.690809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:17.690809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:17.690809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:17.690809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:17.690809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:17.690809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:49:17.690809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:17.690809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 21:49:17.690809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:17.690809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 504/1005] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Jun 7 21:49:17 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:17.693022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62413256-656d-46b4-a375-b4aaa37f7b30 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:17.792449 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62413256-656d-46b4-a375-b4aaa37f7b30 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:17.818616 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:17.827593 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926a7e9-29c9-4c76-b4d8-45c6d61fc434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:17.828264 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926a7e9-29c9-4c76-b4d8-45c6d61fc434 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:17.828544 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926a7e9-29c9-4c76-b4d8-45c6d61fc434 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:17.828817 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926a7e9-29c9-4c76-b4d8-45c6d61fc434 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:17.829519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926a7e9-29c9-4c76-b4d8-45c6d61fc434 None admin] RBAC: Adding query filter params (name=image) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:17.829822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926a7e9-29c9-4c76-b4d8-45c6d61fc434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:17.831231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926a7e9-29c9-4c76-b4d8-45c6d61fc434 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:17.841043 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 502/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:17.842629 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1527667-c17e-4ca9-87da-84190e40f398 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:17.946523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1527667-c17e-4ca9-87da-84190e40f398 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:17.984089 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29ccc2-e803-42f6-8dfd-49d2889fab47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:17.984767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29ccc2-e803-42f6-8dfd-49d2889fab47 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:17.985048 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29ccc2-e803-42f6-8dfd-49d2889fab47 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:17.985323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29ccc2-e803-42f6-8dfd-49d2889fab47 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:17.986230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29ccc2-e803-42f6-8dfd-49d2889fab47 None admin] RBAC: Adding query filter params (type=image) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:17.986546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29ccc2-e803-42f6-8dfd-49d2889fab47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:17.987925 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29ccc2-e803-42f6-8dfd-49d2889fab47 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:17.998635 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 505/1007] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:18.295376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c2646-cf40-494e-a2bb-c59bb7ee3256 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:18.295772 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c2646-cf40-494e-a2bb-c59bb7ee3256 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:18.296035 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c2646-cf40-494e-a2bb-c59bb7ee3256 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:18.297456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 503/1008] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:18.302706 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd844e5b-11a5-45a6-a6c7-d69e9b7c6276 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:18.302997 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd844e5b-11a5-45a6-a6c7-d69e9b7c6276 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:18.303273 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd844e5b-11a5-45a6-a6c7-d69e9b7c6276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:18.319944 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-dd844e5b-11a5-45a6-a6c7-d69e9b7c6276 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:18.321172 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-dd844e5b-11a5-45a6-a6c7-d69e9b7c6276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:18.328441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:18.397267 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 506/1009] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:18 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:18.420965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c2646-cf40-494e-a2bb-c59bb7ee3256 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:18.526031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c2646-cf40-494e-a2bb-c59bb7ee3256 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:18.559735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196d1cc-f1e8-4981-ba69-c56b7830e842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:18.560444 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196d1cc-f1e8-4981-ba69-c56b7830e842 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:18.560724 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196d1cc-f1e8-4981-ba69-c56b7830e842 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:18.560995 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196d1cc-f1e8-4981-ba69-c56b7830e842 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:18.562223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196d1cc-f1e8-4981-ba69-c56b7830e842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:18.563651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196d1cc-f1e8-4981-ba69-c56b7830e842 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:18.570071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 504/1010] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:18.571092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd844e5b-11a5-45a6-a6c7-d69e9b7c6276 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:18.669100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd844e5b-11a5-45a6-a6c7-d69e9b7c6276 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:18.702617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d0292-eefe-40d0-9a77-f5b95114b463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:18.703267 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d0292-eefe-40d0-9a77-f5b95114b463 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:18.703545 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d0292-eefe-40d0-9a77-f5b95114b463 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:18.703816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d0292-eefe-40d0-9a77-f5b95114b463 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:18.704522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d0292-eefe-40d0-9a77-f5b95114b463 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:18.705961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d0292-eefe-40d0-9a77-f5b95114b463 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:18.718691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:18.733655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 507/1011] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 7 21:49:18 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 21:49:19.554327 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6ad4-fd8a-4420-b24f-2fc460184b9f None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:19.554841 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6ad4-fd8a-4420-b24f-2fc460184b9f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:19.554950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6ad4-fd8a-4420-b24f-2fc460184b9f None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:19.556432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 505/1012] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:19.561433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2afb53-9591-4f06-aaae-2e7706cdd8ef None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:19.561720 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2afb53-9591-4f06-aaae-2e7706cdd8ef None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:19.562019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2afb53-9591-4f06-aaae-2e7706cdd8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:19.579205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ef2afb53-9591-4f06-aaae-2e7706cdd8ef None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:19.580375 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ef2afb53-9591-4f06-aaae-2e7706cdd8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:19.648011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 508/1013] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:19.671163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab6ad4-fd8a-4420-b24f-2fc460184b9f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:19.731246 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:19.774323 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab6ad4-fd8a-4420-b24f-2fc460184b9f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:19.808051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70715472-6ef2-45fc-b7fd-fb6bdac9ac00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:19.808829 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70715472-6ef2-45fc-b7fd-fb6bdac9ac00 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:19.809107 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70715472-6ef2-45fc-b7fd-fb6bdac9ac00 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:19.809377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70715472-6ef2-45fc-b7fd-fb6bdac9ac00 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:19.810042 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70715472-6ef2-45fc-b7fd-fb6bdac9ac00 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:19.811411 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70715472-6ef2-45fc-b7fd-fb6bdac9ac00 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:19.823274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-70715472-6ef2-45fc-b7fd-fb6bdac9ac00 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 21:49:19.823274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:19.823274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:49:19.823274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:49:19.823274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:49:19.823274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:49:19.823274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:49:19.823274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:19.823274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 21:49:19.823274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:19.823274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:49:19.823274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:19.823274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:19.823274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:19.823274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:19.823274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:19.823274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:19.824238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:19.824238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:19.824238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:19.824238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:19.824238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:19.824238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:19.824238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:49:19.824238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:49:19.824238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:49:19.824238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:49:19.824238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:19.824238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:19.824238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:19.824238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:19.824238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:19.824238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:19.825097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:19.825097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:19.825097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:19.825097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:19.825097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:19.825097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:19.825097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:19.825097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:19.825097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:19.825097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:19.825097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:49:19.825097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:19.825097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 21:49:19.825097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:19.826529 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 506/1014] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:49:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:19.830426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2afb53-9591-4f06-aaae-2e7706cdd8ef None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:19.939877 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2afb53-9591-4f06-aaae-2e7706cdd8ef None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:19.964023 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:19.978460 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21ceb3-161d-4d2a-baa7-ff8cb72c19d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:19.979126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ceb3-161d-4d2a-baa7-ff8cb72c19d3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:19.979408 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ceb3-161d-4d2a-baa7-ff8cb72c19d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:19.979683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ceb3-161d-4d2a-baa7-ff8cb72c19d3 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:19.980387 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21ceb3-161d-4d2a-baa7-ff8cb72c19d3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:19.980695 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21ceb3-161d-4d2a-baa7-ff8cb72c19d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:19.982097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21ceb3-161d-4d2a-baa7-ff8cb72c19d3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:19.991556 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 509/1015] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 7 21:49:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:19.992785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70715472-6ef2-45fc-b7fd-fb6bdac9ac00 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:20.098177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70715472-6ef2-45fc-b7fd-fb6bdac9ac00 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:20.122352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:20.134592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53510872-7c4d-4c61-9171-f86b34ba1681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:20.135255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53510872-7c4d-4c61-9171-f86b34ba1681 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:20.135589 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53510872-7c4d-4c61-9171-f86b34ba1681 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:20.135871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53510872-7c4d-4c61-9171-f86b34ba1681 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:20.136571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53510872-7c4d-4c61-9171-f86b34ba1681 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:20.136880 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53510872-7c4d-4c61-9171-f86b34ba1681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:20.138318 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53510872-7c4d-4c61-9171-f86b34ba1681 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:20.147638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 507/1016] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 7 21:49:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:20.148916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21ceb3-161d-4d2a-baa7-ff8cb72c19d3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:20.247644 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4fc52-22e1-40fa-a821-54240abf704d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:20.247834 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4fc52-22e1-40fa-a821-54240abf704d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:20.248099 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4fc52-22e1-40fa-a821-54240abf704d None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:20.249599 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 508/1017] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:20.251123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21ceb3-161d-4d2a-baa7-ff8cb72c19d3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:20.254480 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c98b8-8646-46cd-9bae-763739102891 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:20.254760 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c98b8-8646-46cd-9bae-763739102891 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:20.255031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c98b8-8646-46cd-9bae-763739102891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:20.271756 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-805c98b8-8646-46cd-9bae-763739102891 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:20.272923 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-805c98b8-8646-46cd-9bae-763739102891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:20.289044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3ef99-ce2f-44ad-9c25-12054e248826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:20.289832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3ef99-ce2f-44ad-9c25-12054e248826 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:20.290192 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3ef99-ce2f-44ad-9c25-12054e248826 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:20.290586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3ef99-ce2f-44ad-9c25-12054e248826 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:20.291321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3ef99-ce2f-44ad-9c25-12054e248826 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:20.292683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3ef99-ce2f-44ad-9c25-12054e248826 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:20.321965 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 510/1018] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 7 21:49:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:49:20.359549 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 509/1019] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:20 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 21:49:20.383796 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3ef99-ce2f-44ad-9c25-12054e248826 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:20.434739 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:20.500224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3ef99-ce2f-44ad-9c25-12054e248826 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:20.537856 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a76fb9-cd2a-48ec-a4e9-f42ecab3c0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:20.538558 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a76fb9-cd2a-48ec-a4e9-f42ecab3c0d7 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:20.538838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a76fb9-cd2a-48ec-a4e9-f42ecab3c0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:20.539107 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a76fb9-cd2a-48ec-a4e9-f42ecab3c0d7 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:20.539920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a76fb9-cd2a-48ec-a4e9-f42ecab3c0d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:20.541303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a76fb9-cd2a-48ec-a4e9-f42ecab3c0d7 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:20.556209 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 511/1020] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 7 21:49:20 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:49:20.999617 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cefe5-41ed-4201-832e-c3e6b262a2fe None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:21.000138 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cefe5-41ed-4201-832e-c3e6b262a2fe None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:21.000216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cefe5-41ed-4201-832e-c3e6b262a2fe None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:21.001654 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 510/1021] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:21.006644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9998a-1fd6-4c51-8960-3f3bd40aaaac None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:21.007025 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9998a-1fd6-4c51-8960-3f3bd40aaaac None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:21.007212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9998a-1fd6-4c51-8960-3f3bd40aaaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:21.024798 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ebb9998a-1fd6-4c51-8960-3f3bd40aaaac None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:21.025989 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ebb9998a-1fd6-4c51-8960-3f3bd40aaaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:21.098269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 512/1022] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:21.123458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cefe5-41ed-4201-832e-c3e6b262a2fe None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:21.222195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cefe5-41ed-4201-832e-c3e6b262a2fe None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:21.236710 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:21.257487 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4601eb-97af-4d4b-ac29-5e8990447e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:21.258256 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4601eb-97af-4d4b-ac29-5e8990447e79 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:21.258534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4601eb-97af-4d4b-ac29-5e8990447e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:21.258806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4601eb-97af-4d4b-ac29-5e8990447e79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:21.259958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4601eb-97af-4d4b-ac29-5e8990447e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:21.261387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4601eb-97af-4d4b-ac29-5e8990447e79 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:21.267651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 511/1023] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:21.268882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9998a-1fd6-4c51-8960-3f3bd40aaaac None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:21.298600 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:21.376739 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9998a-1fd6-4c51-8960-3f3bd40aaaac None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:21.410256 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4700909-56ea-47e3-89a0-ddec742dd3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:21.410916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4700909-56ea-47e3-89a0-ddec742dd3e1 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:21.411192 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4700909-56ea-47e3-89a0-ddec742dd3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:21.411459 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4700909-56ea-47e3-89a0-ddec742dd3e1 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:21.412161 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4700909-56ea-47e3-89a0-ddec742dd3e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:21.413575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4700909-56ea-47e3-89a0-ddec742dd3e1 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:21.433973 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 513/1024] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:49:21 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:49:22.704150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cf611-53de-4e58-b6dc-bfd21ed9f977 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:22.704644 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cf611-53de-4e58-b6dc-bfd21ed9f977 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:22.704644 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cf611-53de-4e58-b6dc-bfd21ed9f977 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:22.705986 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 512/1025] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:22.711361 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422900eb-aca7-498f-b0e9-7b2c9c7e408c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:22.711773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422900eb-aca7-498f-b0e9-7b2c9c7e408c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:22.711944 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422900eb-aca7-498f-b0e9-7b2c9c7e408c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:22.729132 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-422900eb-aca7-498f-b0e9-7b2c9c7e408c None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:22.730341 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-422900eb-aca7-498f-b0e9-7b2c9c7e408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:22.796158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 514/1026] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:22.819273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cf611-53de-4e58-b6dc-bfd21ed9f977 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:22.821154 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe4f6a-5491-4cbd-ae78-56381432b4de None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:22.821437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe4f6a-5491-4cbd-ae78-56381432b4de None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:22.821708 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe4f6a-5491-4cbd-ae78-56381432b4de None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:22.823238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 515/1027] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:22.827935 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf77fe-8085-4ceb-b10a-f31d1279558e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:22.828221 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf77fe-8085-4ceb-b10a-f31d1279558e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:22.828492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf77fe-8085-4ceb-b10a-f31d1279558e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:22.845402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-13bf77fe-8085-4ceb-b10a-f31d1279558e None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:22.846574 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-13bf77fe-8085-4ceb-b10a-f31d1279558e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:22.858245 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:22.925236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cf611-53de-4e58-b6dc-bfd21ed9f977 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:22.926059 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 516/1028] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 21:49:22.948358 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf77fe-8085-4ceb-b10a-f31d1279558e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:22.964622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08c792-ff71-41b3-ad01-b6dd24ab2cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:22.965364 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08c792-ff71-41b3-ad01-b6dd24ab2cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:22.965653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08c792-ff71-41b3-ad01-b6dd24ab2cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:22.965951 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08c792-ff71-41b3-ad01-b6dd24ab2cb2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:22.976511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08c792-ff71-41b3-ad01-b6dd24ab2cb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:49:22.985204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-8c08c792-ff71-41b3-ad01-b6dd24ab2cb2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 21:49:22.985204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:22.985204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:22.985204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:22.985204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:22.985204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:22.985204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:22.985204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:22.985204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:22.985204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:22.985204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:22.985204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:22.985204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:49:22.985204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:49:22.985204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:49:22.985204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:49:22.986150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:49:22.986150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:49:22.986150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:49:22.986150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:49:22.986150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:22.986150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:22.986150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:22.986150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:22.986150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:22.986150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:22.986150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:22.986150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:22.986150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:22.986150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:22.986150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:22.986150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:22.990778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:22.990778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:22.990778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:22.990778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:22.990778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:49:22.990778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:49:22.990778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:49:22.990778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:49:22.990778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:49:22.990778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:49:22.990778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 21:49:22.990778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:22.990778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 513/1029] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jun 7 21:49:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:22.992522 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08c792-ff71-41b3-ad01-b6dd24ab2cb2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:23.042019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:23.054173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf77fe-8085-4ceb-b10a-f31d1279558e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:23.091181 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6947d22-b447-4bd6-8e9a-33c9a16a85e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:23.092003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6947d22-b447-4bd6-8e9a-33c9a16a85e6 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:23.092262 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6947d22-b447-4bd6-8e9a-33c9a16a85e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:23.092539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6947d22-b447-4bd6-8e9a-33c9a16a85e6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:23.093197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6947d22-b447-4bd6-8e9a-33c9a16a85e6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:23.094610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6947d22-b447-4bd6-8e9a-33c9a16a85e6 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:23.104588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08c792-ff71-41b3-ad01-b6dd24ab2cb2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:23.106568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-b6947d22-b447-4bd6-8e9a-33c9a16a85e6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 21:49:23.106568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:23.106568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:49:23.106568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:49:23.106568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:49:23.106568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:49:23.106568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:49:23.106568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:23.106568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 21:49:23.106568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:23.106568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:49:23.106568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:23.106568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:23.106568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:23.106568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:23.106568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:23.106568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:23.107528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:23.107528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:23.107528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:23.107528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:23.107528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:23.107528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:23.107528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:49:23.107528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:49:23.107528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:49:23.107528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:49:23.107528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:23.107528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:23.107528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:23.107528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:23.107528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:23.107528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:23.108454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:23.108454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:23.108454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:23.108454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:23.108454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:23.108454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:23.108454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:23.108454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:23.108454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:23.108454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:23.108454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:49:23.108454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:23.108454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 21:49:23.108454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:23.108454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 517/1030] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Jun 7 21:49:22 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:23.113746 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6947d22-b447-4bd6-8e9a-33c9a16a85e6 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:23.126594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:23.145098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3ebe0-0779-40fb-bbed-1a49bc3cc983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:23.145769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3ebe0-0779-40fb-bbed-1a49bc3cc983 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:23.146089 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3ebe0-0779-40fb-bbed-1a49bc3cc983 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:23.146364 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3ebe0-0779-40fb-bbed-1a49bc3cc983 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:23.147115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3ebe0-0779-40fb-bbed-1a49bc3cc983 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:23.147423 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3ebe0-0779-40fb-bbed-1a49bc3cc983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:23.148872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3ebe0-0779-40fb-bbed-1a49bc3cc983 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:23.162036 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 514/1031] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jun 7 21:49:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:23.163007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3ebe0-0779-40fb-bbed-1a49bc3cc983 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:23.221671 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6947d22-b447-4bd6-8e9a-33c9a16a85e6 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:23.256075 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be98184-65eb-45c0-87d0-05faaaa35ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:23.256736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98184-65eb-45c0-87d0-05faaaa35ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:23.257022 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98184-65eb-45c0-87d0-05faaaa35ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:23.257298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98184-65eb-45c0-87d0-05faaaa35ad1 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:23.258541 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be98184-65eb-45c0-87d0-05faaaa35ad1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:23.258852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be98184-65eb-45c0-87d0-05faaaa35ad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:23.260251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be98184-65eb-45c0-87d0-05faaaa35ad1 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:23.269695 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 518/1032] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:23.270658 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be98184-65eb-45c0-87d0-05faaaa35ad1 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:23.272163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3ebe0-0779-40fb-bbed-1a49bc3cc983 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:23.274768 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:23.310874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472265d0-67bb-4283-a423-d93bd873b133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:23.311665 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472265d0-67bb-4283-a423-d93bd873b133 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:23.311950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472265d0-67bb-4283-a423-d93bd873b133 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:23.312223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472265d0-67bb-4283-a423-d93bd873b133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:23.324807 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472265d0-67bb-4283-a423-d93bd873b133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:23.326285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472265d0-67bb-4283-a423-d93bd873b133 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:23.344252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-472265d0-67bb-4283-a423-d93bd873b133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:23.344252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:23.344252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:23.344252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:23.344252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:23.344252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:23.344252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:23.344252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:23.344252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:23.344252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:23.344252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:23.344252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:23.344252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:49:23.344252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:49:23.344252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:49:23.345267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:49:23.345267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:23.345267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:23.345267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:23.345267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:23.345267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:23.345267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:23.345267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:23.345267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:23.345267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:23.345267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:23.345267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:23.345267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:23.345267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:23.345267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:23.345267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:23.345267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:23.346755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:49:23.346755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:49:23.346755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:23.346755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:23.350529 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 515/1033] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:23.353718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472265d0-67bb-4283-a423-d93bd873b133 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:23.357803 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:23.378485 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be98184-65eb-45c0-87d0-05faaaa35ad1 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:23.418218 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33133782-a364-4c62-8ddd-3dec5ebc60d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:23.418908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33133782-a364-4c62-8ddd-3dec5ebc60d4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:23.419192 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33133782-a364-4c62-8ddd-3dec5ebc60d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:23.419469 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33133782-a364-4c62-8ddd-3dec5ebc60d4 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:23.420187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33133782-a364-4c62-8ddd-3dec5ebc60d4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:23.420497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33133782-a364-4c62-8ddd-3dec5ebc60d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:23.421920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33133782-a364-4c62-8ddd-3dec5ebc60d4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:23.432384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 519/1034] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:23.433405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33133782-a364-4c62-8ddd-3dec5ebc60d4 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:23.474362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472265d0-67bb-4283-a423-d93bd873b133 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:23.511801 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a180f5a-b162-4d9b-85c5-515ea757dbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:23.512815 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a180f5a-b162-4d9b-85c5-515ea757dbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:23.513238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a180f5a-b162-4d9b-85c5-515ea757dbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:23.513774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a180f5a-b162-4d9b-85c5-515ea757dbe0 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:23.514531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a180f5a-b162-4d9b-85c5-515ea757dbe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:23.514833 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a180f5a-b162-4d9b-85c5-515ea757dbe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:23.516275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a180f5a-b162-4d9b-85c5-515ea757dbe0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:23.528896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 516/1035] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:23.534065 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a180f5a-b162-4d9b-85c5-515ea757dbe0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:23.535770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33133782-a364-4c62-8ddd-3dec5ebc60d4 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:23.552313 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:23.571991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40714c4a-62bf-4a90-bbc6-fbac9495f62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:23.572974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40714c4a-62bf-4a90-bbc6-fbac9495f62f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:23.573258 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40714c4a-62bf-4a90-bbc6-fbac9495f62f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:23.573537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40714c4a-62bf-4a90-bbc6-fbac9495f62f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:23.574366 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40714c4a-62bf-4a90-bbc6-fbac9495f62f None admin] RBAC: Adding query filter params (interface=public, service_id=e8ea6d6e35904acab3042f731d108e6a, region_id=RegionOne) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:23.574683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40714c4a-62bf-4a90-bbc6-fbac9495f62f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:23.576063 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40714c4a-62bf-4a90-bbc6-fbac9495f62f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:23.585829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 520/1036] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jun 7 21:49:23 2022] GET /identity/v3/endpoints?service_id=e8ea6d6e35904acab3042f731d108e6a&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:23.587012 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40714c4a-62bf-4a90-bbc6-fbac9495f62f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:23.590091 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:23.646012 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a180f5a-b162-4d9b-85c5-515ea757dbe0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:23.682675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a5eff-e4aa-409a-85cf-5cff70bcff78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:23.683869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a5eff-e4aa-409a-85cf-5cff70bcff78 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:23.684157 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a5eff-e4aa-409a-85cf-5cff70bcff78 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:23.684431 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a5eff-e4aa-409a-85cf-5cff70bcff78 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:23.692033 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a5eff-e4aa-409a-85cf-5cff70bcff78 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:23.693446 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a5eff-e4aa-409a-85cf-5cff70bcff78 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:23.695855 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40714c4a-62bf-4a90-bbc6-fbac9495f62f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:23.707850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-251a5eff-e4aa-409a-85cf-5cff70bcff78 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:49:23.707850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:23.707850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:23.707850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:23.707850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:23.707850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:23.707850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:23.707850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:23.707850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:23.707850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:23.707850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:23.707850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:23.707850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:49:23.707850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:49:23.707850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:49:23.707850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:23.709141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:23.710161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:23.710161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:23.710161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:49:23.710161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:49:23.710161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:49:23.710161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:49:23.710161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:49:23.710161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:49:23.710161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:49:23.710161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:23.710161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 517/1037] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 7 21:49:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:23.715146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a5eff-e4aa-409a-85cf-5cff70bcff78 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:23.735470 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e25cd-822b-4c66-84d3-638dcf3c864f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:23.736064 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e25cd-822b-4c66-84d3-638dcf3c864f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:23.736349 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e25cd-822b-4c66-84d3-638dcf3c864f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:23.736622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e25cd-822b-4c66-84d3-638dcf3c864f None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:23.737301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e25cd-822b-4c66-84d3-638dcf3c864f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:23.738702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e25cd-822b-4c66-84d3-638dcf3c864f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:23.757773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 521/1038] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 7 21:49:23 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 21:49:23.757773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07439d5f-51bf-41ff-b77d-3c39a50a499e None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:23.757773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07439d5f-51bf-41ff-b77d-3c39a50a499e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:23.757773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07439d5f-51bf-41ff-b77d-3c39a50a499e None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:23.757773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 522/1039] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:23.757773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11b3b9-0293-4375-ab43-372004c5f3e5 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:23.757773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11b3b9-0293-4375-ab43-372004c5f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:23.758550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11b3b9-0293-4375-ab43-372004c5f3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:23.780318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5b11b3b9-0293-4375-ab43-372004c5f3e5 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:23.782146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5b11b3b9-0293-4375-ab43-372004c5f3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:23.801126 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:23.829090 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a5eff-e4aa-409a-85cf-5cff70bcff78 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:23.855385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:23.864719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 523/1040] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 21:49:23.877646 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802c88a-bfda-49ba-bf8c-26d6d60d2483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:23.878377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802c88a-bfda-49ba-bf8c-26d6d60d2483 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:23.878660 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802c88a-bfda-49ba-bf8c-26d6d60d2483 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:23.878934 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802c88a-bfda-49ba-bf8c-26d6d60d2483 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:23.879793 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802c88a-bfda-49ba-bf8c-26d6d60d2483 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:23.880107 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802c88a-bfda-49ba-bf8c-26d6d60d2483 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:23.881558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802c88a-bfda-49ba-bf8c-26d6d60d2483 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:23.889642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11b3b9-0293-4375-ab43-372004c5f3e5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:23.903346 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 518/1041] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 7 21:49:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:23.909201 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802c88a-bfda-49ba-bf8c-26d6d60d2483 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:24.007443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11b3b9-0293-4375-ab43-372004c5f3e5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:24.015205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802c88a-bfda-49ba-bf8c-26d6d60d2483 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:24.044300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd50c1-2435-4902-bcff-12cd4e30502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:24.045093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd50c1-2435-4902-bcff-12cd4e30502b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:24.045376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd50c1-2435-4902-bcff-12cd4e30502b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:24.045657 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd50c1-2435-4902-bcff-12cd4e30502b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:24.050745 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75364448-c817-400e-9a9e-e3b2163da231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:24.051389 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75364448-c817-400e-9a9e-e3b2163da231 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:24.051675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75364448-c817-400e-9a9e-e3b2163da231 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:24.051946 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75364448-c817-400e-9a9e-e3b2163da231 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:24.054765 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:24.056871 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd50c1-2435-4902-bcff-12cd4e30502b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:49:24.064531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-fccd50c1-2435-4902-bcff-12cd4e30502b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:49:24.064531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:24.064531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:24.064531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:24.064531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:24.064531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:24.064531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:24.064531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:24.064531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:24.064531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:24.064531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:24.064531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:24.064531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:49:24.064531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:49:24.064531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:49:24.064531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:49:24.065475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:49:24.065475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:49:24.065475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:49:24.065475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:49:24.065475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:24.065475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:24.065475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:24.065475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:24.065475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:24.065475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:24.065475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:24.065475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:24.065475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:24.065475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:24.065475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:24.065475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:24.066352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:24.066352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:24.066352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:24.066352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:24.066352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:49:24.066352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:49:24.066352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:49:24.066352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:49:24.066352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:49:24.066352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:49:24.066352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:49:24.066352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:24.066352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 524/1042] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:49:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:24.071987 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd50c1-2435-4902-bcff-12cd4e30502b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:24.129524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:24.130698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75364448-c817-400e-9a9e-e3b2163da231 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:24.132382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75364448-c817-400e-9a9e-e3b2163da231 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:24.175938 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd50c1-2435-4902-bcff-12cd4e30502b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:24.210671 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440caef-50c0-481f-b279-ab8ea0096713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:24.211406 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440caef-50c0-481f-b279-ab8ea0096713 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:24.211691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440caef-50c0-481f-b279-ab8ea0096713 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:24.211962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440caef-50c0-481f-b279-ab8ea0096713 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:24.212709 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440caef-50c0-481f-b279-ab8ea0096713 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:24.213014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440caef-50c0-481f-b279-ab8ea0096713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:24.214443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440caef-50c0-481f-b279-ab8ea0096713 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:24.229997 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 525/1043] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:49:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:24.233727 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440caef-50c0-481f-b279-ab8ea0096713 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:24.241959 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 519/1044] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:49:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 07 21:49:24.246898 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75364448-c817-400e-9a9e-e3b2163da231 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:24.282666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:24.344969 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440caef-50c0-481f-b279-ab8ea0096713 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:24.348894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75364448-c817-400e-9a9e-e3b2163da231 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:24.369117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:24.384744 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24128fa8-b5c1-4b68-bf0b-fe556548bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:24.385530 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24128fa8-b5c1-4b68-bf0b-fe556548bb7f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:24.385840 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24128fa8-b5c1-4b68-bf0b-fe556548bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:24.386161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24128fa8-b5c1-4b68-bf0b-fe556548bb7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:24.388541 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d045e-492d-462a-ab02-00cac08c89e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:24.389407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d045e-492d-462a-ab02-00cac08c89e7 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:24.389686 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d045e-492d-462a-ab02-00cac08c89e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:24.389980 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d045e-492d-462a-ab02-00cac08c89e7 None admin] PATH_INFO: `/v3/users/a6bcfd11587340aa8b01f49b83f09d91` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:24.396925 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24128fa8-b5c1-4b68-bf0b-fe556548bb7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:24.398401 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24128fa8-b5c1-4b68-bf0b-fe556548bb7f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:24.404636 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d045e-492d-462a-ab02-00cac08c89e7 None admin] RBAC: Authorizing `identity:get_user(user_id=a6bcfd11587340aa8b01f49b83f09d91)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:24.406121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d045e-492d-462a-ab02-00cac08c89e7 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:24.407972 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 526/1045] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:49:24 2022] GET /identity/v3/users/a6bcfd11587340aa8b01f49b83f09d91 => generated 285 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:24.413312 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d045e-492d-462a-ab02-00cac08c89e7 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:24.418930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-24128fa8-b5c1-4b68-bf0b-fe556548bb7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:24.418930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:24.418930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:24.418930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:24.418930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:24.418930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:24.418930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:24.418930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:24.418930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:24.418930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:24.418930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:24.418930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:24.418930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:49:24.418930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:49:24.418930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:49:24.419803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:49:24.419803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:24.419803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:24.419803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:24.419803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:24.419803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:24.419803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:24.419803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:24.419803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:24.419803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:24.419803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:24.419803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:24.419803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:24.419803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:24.419803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:24.419803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:24.419803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:24.421024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:49:24.421024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:49:24.421024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:24.421024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:24.425719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 520/1046] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:24.426566 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24128fa8-b5c1-4b68-bf0b-fe556548bb7f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:24.518453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d045e-492d-462a-ab02-00cac08c89e7 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:24.522140 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:24.540246 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24128fa8-b5c1-4b68-bf0b-fe556548bb7f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:24.553856 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ab172-8220-4a4f-a1c4-34373f379e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:24.554532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ab172-8220-4a4f-a1c4-34373f379e21 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:24.555335 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ab172-8220-4a4f-a1c4-34373f379e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:24.555616 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ab172-8220-4a4f-a1c4-34373f379e21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:24.578128 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7552085-a7a6-43dd-9727-b1d76162fa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:24.579210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7552085-a7a6-43dd-9727-b1d76162fa54 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:24.579774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7552085-a7a6-43dd-9727-b1d76162fa54 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:24.580268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7552085-a7a6-43dd-9727-b1d76162fa54 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:24.581158 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7552085-a7a6-43dd-9727-b1d76162fa54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:24.581754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7552085-a7a6-43dd-9727-b1d76162fa54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:24.583415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7552085-a7a6-43dd-9727-b1d76162fa54 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:24.596318 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 521/1047] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:24.601569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7552085-a7a6-43dd-9727-b1d76162fa54 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:24.605046 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:24.630993 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ab172-8220-4a4f-a1c4-34373f379e21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:24.632693 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ab172-8220-4a4f-a1c4-34373f379e21 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:24.700809 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7552085-a7a6-43dd-9727-b1d76162fa54 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:24.737910 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4fedc-c316-4a46-8282-5bbb8c578010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:24.738711 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4fedc-c316-4a46-8282-5bbb8c578010 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:24.738988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4fedc-c316-4a46-8282-5bbb8c578010 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:24.743850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4fedc-c316-4a46-8282-5bbb8c578010 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:24.743977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 527/1048] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:49:24 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 07 21:49:24.744931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ab172-8220-4a4f-a1c4-34373f379e21 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:24.749557 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4fedc-c316-4a46-8282-5bbb8c578010 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:24.751034 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4fedc-c316-4a46-8282-5bbb8c578010 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:24.765559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-80b4fedc-c316-4a46-8282-5bbb8c578010 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:49:24.765559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:24.765559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:24.765559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:24.765559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:24.765559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:24.765559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:24.765559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:24.765559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:24.765559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:24.765559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:24.765559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:24.765559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:49:24.765559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:49:24.765559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:49:24.766496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:49:24.766496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:24.766496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:24.766496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:24.766496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:24.766496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:24.766496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:24.766496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:24.766496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:24.766496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:24.766496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:24.766496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:24.766496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:24.766496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:24.766496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:24.766496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:24.766496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:24.767397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:49:24.767397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:49:24.767397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:49:24.767397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:49:24.767397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:49:24.767397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:49:24.767397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:49:24.767397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:24.767397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 522/1049] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:49:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:24.772314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4fedc-c316-4a46-8282-5bbb8c578010 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:24.782213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:24.830252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:24.855963 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ab172-8220-4a4f-a1c4-34373f379e21 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:24.883461 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4fedc-c316-4a46-8282-5bbb8c578010 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:24.892512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cad4f-789c-40fb-8a91-97dbfa743c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:24.893370 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cad4f-789c-40fb-8a91-97dbfa743c8d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:24.893651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cad4f-789c-40fb-8a91-97dbfa743c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:24.893937 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cad4f-789c-40fb-8a91-97dbfa743c8d None admin] PATH_INFO: `/v3/projects/9aee4385c03d48b2a7336914dc35c9a4` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:24.895123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cad4f-789c-40fb-8a91-97dbfa743c8d None admin] RBAC: Authorizing `identity:get_project(project_id=9aee4385c03d48b2a7336914dc35c9a4)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:24.896559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cad4f-789c-40fb-8a91-97dbfa743c8d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:24.898269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 528/1050] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:49:24 2022] GET /identity/v3/projects/9aee4385c03d48b2a7336914dc35c9a4 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:24.904134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cad4f-789c-40fb-8a91-97dbfa743c8d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:24.924851 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a4165-9365-49b2-a18a-cf907444c27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:24.925514 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a4165-9365-49b2-a18a-cf907444c27b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:24.925800 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a4165-9365-49b2-a18a-cf907444c27b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:24.926115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a4165-9365-49b2-a18a-cf907444c27b None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:24.926899 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a4165-9365-49b2-a18a-cf907444c27b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:24.927213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a4165-9365-49b2-a18a-cf907444c27b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:24.928685 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a4165-9365-49b2-a18a-cf907444c27b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:24.941856 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 523/1051] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:49:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:24.948485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a4165-9365-49b2-a18a-cf907444c27b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:25.009956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cad4f-789c-40fb-8a91-97dbfa743c8d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:25.016941 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:25.047863 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a437d-1423-4cf3-a5d9-ba70bf542faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:25.048587 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a437d-1423-4cf3-a5d9-ba70bf542faa None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:25.048974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a437d-1423-4cf3-a5d9-ba70bf542faa None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:25.049254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a437d-1423-4cf3-a5d9-ba70bf542faa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:25.050097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a437d-1423-4cf3-a5d9-ba70bf542faa None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=9aee4385c03d48b2a7336914dc35c9a4, user.id=a6bcfd11587340aa8b01f49b83f09d91) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:25.050411 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a437d-1423-4cf3-a5d9-ba70bf542faa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:25.051841 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a437d-1423-4cf3-a5d9-ba70bf542faa None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:25.052603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a4165-9365-49b2-a18a-cf907444c27b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:25.058041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 529/1052] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:49:24 2022] GET /identity/v3/role_assignments?user.id=a6bcfd11587340aa8b01f49b83f09d91&scope.project.id=9aee4385c03d48b2a7336914dc35c9a4&role.id=8f58ef9d28494d97a68de20b84355450 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:25.090562 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579369c-a0f4-4e2b-b183-5a8905920ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:25.091263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579369c-a0f4-4e2b-b183-5a8905920ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:25.091546 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579369c-a0f4-4e2b-b183-5a8905920ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:25.091995 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579369c-a0f4-4e2b-b183-5a8905920ef7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:25.092914 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579369c-a0f4-4e2b-b183-5a8905920ef7 None admin] RBAC: Adding query filter params (role.id=7dadc9b4653f4b31856163d4e2cc6469, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=1d5760a3f9f946978b1251d3e2aaa943) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:25.093233 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579369c-a0f4-4e2b-b183-5a8905920ef7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:25.095010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579369c-a0f4-4e2b-b183-5a8905920ef7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:25.109968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 524/1053] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:49:24 2022] GET /identity/v3/role_assignments?user.id=1d5760a3f9f946978b1251d3e2aaa943&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=7dadc9b4653f4b31856163d4e2cc6469 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:25.984219 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07668877-eb25-4a56-bab9-d5b1a0a31e71 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:25.984739 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07668877-eb25-4a56-bab9-d5b1a0a31e71 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:25.984739 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07668877-eb25-4a56-bab9-d5b1a0a31e71 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:25.986249 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 530/1054] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:25.991239 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be65b7e-aca7-41c0-a515-388d119bfc6a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:25.991611 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be65b7e-aca7-41c0-a515-388d119bfc6a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:25.991794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be65b7e-aca7-41c0-a515-388d119bfc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:26.008688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2be65b7e-aca7-41c0-a515-388d119bfc6a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:26.009861 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2be65b7e-aca7-41c0-a515-388d119bfc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:26.076864 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 525/1055] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:26.098635 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07668877-eb25-4a56-bab9-d5b1a0a31e71 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:26.110286 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:26.203684 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07668877-eb25-4a56-bab9-d5b1a0a31e71 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:26.239533 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9610fee-d2db-44c1-8a26-99004d9ae635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:26.240240 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9610fee-d2db-44c1-8a26-99004d9ae635 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:26.240517 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9610fee-d2db-44c1-8a26-99004d9ae635 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:26.240788 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9610fee-d2db-44c1-8a26-99004d9ae635 None admin] PATH_INFO: `/v3/services/image` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:26.241427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9610fee-d2db-44c1-8a26-99004d9ae635 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:26.243439 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9610fee-d2db-44c1-8a26-99004d9ae635 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:26.256005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c9610fee-d2db-44c1-8a26-99004d9ae635 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 21:49:26.256005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:26.256005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:49:26.256005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:49:26.256005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:49:26.256005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:49:26.256005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:49:26.256005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:26.256005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 21:49:26.256005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:26.256005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:49:26.256005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:26.256005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:26.256005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:26.256005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:26.256005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:26.256005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:26.257030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:26.257030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:26.257030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:26.257030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:26.257030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:26.257030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:26.257030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:49:26.257030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:49:26.257030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:49:26.257030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:49:26.257030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:26.257030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:26.257030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:26.257030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:26.257030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:26.257030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:26.257979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:26.257979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:26.257979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:26.257979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:26.257979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:26.257979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:26.257979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:26.257979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:26.257979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:26.257979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:26.257979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:49:26.257979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:49:26.257979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 21:49:26.257979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:26.257979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 531/1056] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Jun 7 21:49:26 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:26.262967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be65b7e-aca7-41c0-a515-388d119bfc6a None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:26.321112 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:26.368398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be65b7e-aca7-41c0-a515-388d119bfc6a None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:26.403380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e6f03-0820-4851-999e-64a3d2165f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:26.404029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e6f03-0820-4851-999e-64a3d2165f43 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:26.404308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e6f03-0820-4851-999e-64a3d2165f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:26.404580 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e6f03-0820-4851-999e-64a3d2165f43 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:26.405271 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e6f03-0820-4851-999e-64a3d2165f43 None admin] RBAC: Adding query filter params (name=image) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:26.405573 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e6f03-0820-4851-999e-64a3d2165f43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:26.406964 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e6f03-0820-4851-999e-64a3d2165f43 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:26.411962 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 526/1057] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:26.417427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9610fee-d2db-44c1-8a26-99004d9ae635 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:26.490553 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:26.521349 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9610fee-d2db-44c1-8a26-99004d9ae635 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:26.553866 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f7f2f-a4c5-4645-b23e-c55fa534e6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:26.554535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f7f2f-a4c5-4645-b23e-c55fa534e6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:26.555343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f7f2f-a4c5-4645-b23e-c55fa534e6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:26.555616 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f7f2f-a4c5-4645-b23e-c55fa534e6c0 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:26.556306 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f7f2f-a4c5-4645-b23e-c55fa534e6c0 None admin] RBAC: Adding query filter params (type=image) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:26.556607 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f7f2f-a4c5-4645-b23e-c55fa534e6c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:26.557990 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f7f2f-a4c5-4645-b23e-c55fa534e6c0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:26.562965 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 532/1058] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:26.568375 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e6f03-0820-4851-999e-64a3d2165f43 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:26.666069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e6f03-0820-4851-999e-64a3d2165f43 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:26.689216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:26.700985 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e3ec5-ab8e-42bd-86be-d69d6934cceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:26.701642 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3ec5-ab8e-42bd-86be-d69d6934cceb None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:26.701921 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3ec5-ab8e-42bd-86be-d69d6934cceb None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:26.702217 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3ec5-ab8e-42bd-86be-d69d6934cceb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:26.702960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e3ec5-ab8e-42bd-86be-d69d6934cceb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:26.704321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e3ec5-ab8e-42bd-86be-d69d6934cceb None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:26.722683 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 527/1059] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 7 21:49:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:49:27.311729 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8cd7-5a4f-4ad0-bc10-2de19d1b6984 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:27.312284 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8cd7-5a4f-4ad0-bc10-2de19d1b6984 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:27.312284 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8cd7-5a4f-4ad0-bc10-2de19d1b6984 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:27.313777 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 533/1060] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:27.318837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835846e-32b1-4770-b5dc-bfcf166b04b1 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:27.319222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835846e-32b1-4770-b5dc-bfcf166b04b1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:27.319407 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835846e-32b1-4770-b5dc-bfcf166b04b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:27.336688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6835846e-32b1-4770-b5dc-bfcf166b04b1 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:27.337852 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6835846e-32b1-4770-b5dc-bfcf166b04b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:27.351388 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f99ff-4949-4f4d-9134-aad35318de3e None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:27.351388 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f99ff-4949-4f4d-9134-aad35318de3e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:27.351388 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f99ff-4949-4f4d-9134-aad35318de3e None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:27.351388 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 534/1061] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:49:27.356317 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae98f75-cb40-4060-b5ed-a7b446d40a2b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:27.356676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae98f75-cb40-4060-b5ed-a7b446d40a2b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:27.356885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae98f75-cb40-4060-b5ed-a7b446d40a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:27.378283 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5ae98f75-cb40-4060-b5ed-a7b446d40a2b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:27.379489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5ae98f75-cb40-4060-b5ed-a7b446d40a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:27.423224 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 528/1062] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:27.445618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835846e-32b1-4770-b5dc-bfcf166b04b1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:27.450065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 535/1063] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 21:49:27.470923 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae98f75-cb40-4060-b5ed-a7b446d40a2b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:27.541384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:27.553159 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835846e-32b1-4770-b5dc-bfcf166b04b1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:27.561874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:27.584907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae98f75-cb40-4060-b5ed-a7b446d40a2b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:27.592686 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da73800-700e-4d8a-bbb5-b7c59a94d771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:27.593500 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da73800-700e-4d8a-bbb5-b7c59a94d771 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:27.593777 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da73800-700e-4d8a-bbb5-b7c59a94d771 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:27.594122 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da73800-700e-4d8a-bbb5-b7c59a94d771 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:27.604566 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da73800-700e-4d8a-bbb5-b7c59a94d771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:49:27.612189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-4da73800-700e-4d8a-bbb5-b7c59a94d771 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:49:27.612189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:27.612189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:27.612189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:27.612189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:27.612189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:27.612189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:27.612189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:27.612189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:27.612189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:27.612189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:27.612189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:27.612189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:49:27.612189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:49:27.612189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:49:27.612189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:49:27.613134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:49:27.613134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:49:27.613134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:49:27.613134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:49:27.613134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:27.613134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:27.613134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:27.613134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:27.613134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:27.613134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:27.613134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:27.613134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:27.613134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:27.613134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:27.613134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:27.613134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:27.614003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:27.614003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:27.614003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:27.614003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:27.614003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:49:27.614003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:49:27.614003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:49:27.614003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:49:27.614003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:49:27.614003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:49:27.614003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:49:27.614003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:27.614003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 529/1064] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:49:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:27.619261 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da73800-700e-4d8a-bbb5-b7c59a94d771 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:27.622811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0fbc1-d57a-436f-b983-2a962e1c2499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:27.623697 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0fbc1-d57a-436f-b983-2a962e1c2499 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:27.624053 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0fbc1-d57a-436f-b983-2a962e1c2499 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:27.624428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0fbc1-d57a-436f-b983-2a962e1c2499 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:27.637633 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0fbc1-d57a-436f-b983-2a962e1c2499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:49:27.648334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-46c0fbc1-d57a-436f-b983-2a962e1c2499 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 21:49:27.648334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:27.648334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:27.648334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:27.648334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:27.648334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:27.648334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:27.648334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:27.648334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:27.648334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:27.648334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:27.648334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:27.648334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:49:27.648334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:49:27.648334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:49:27.648334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:49:27.649291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:49:27.649291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:49:27.649291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:49:27.649291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:49:27.649291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:27.649291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:27.649291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:27.649291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:27.649291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:27.649291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:27.649291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:27.649291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:27.649291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:27.649291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:27.649291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:27.649291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:27.650144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:27.650144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:27.650144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:27.650144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:27.650144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:49:27.650144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:49:27.650144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:49:27.650144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:49:27.650144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:49:27.650144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:49:27.650144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 21:49:27.650144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:27.650790 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 536/1065] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jun 7 21:49:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:27.655492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0fbc1-d57a-436f-b983-2a962e1c2499 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:27.727590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da73800-700e-4d8a-bbb5-b7c59a94d771 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:27.762329 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee47802-b2b3-46a6-a10d-4a02f50f4320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:27.762991 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee47802-b2b3-46a6-a10d-4a02f50f4320 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:27.763236 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0fbc1-d57a-436f-b983-2a962e1c2499 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:27.763343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee47802-b2b3-46a6-a10d-4a02f50f4320 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:27.763538 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee47802-b2b3-46a6-a10d-4a02f50f4320 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:27.764281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee47802-b2b3-46a6-a10d-4a02f50f4320 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:27.764599 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee47802-b2b3-46a6-a10d-4a02f50f4320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:27.765991 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee47802-b2b3-46a6-a10d-4a02f50f4320 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:27.774375 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 530/1066] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:49:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:27.780022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee47802-b2b3-46a6-a10d-4a02f50f4320 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:27.794711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:27.805263 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbe6b3-57af-47c1-b2c8-222c6c792968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:27.806014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbe6b3-57af-47c1-b2c8-222c6c792968 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:27.806298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbe6b3-57af-47c1-b2c8-222c6c792968 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:27.806573 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbe6b3-57af-47c1-b2c8-222c6c792968 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:27.807373 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbe6b3-57af-47c1-b2c8-222c6c792968 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:27.807683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbe6b3-57af-47c1-b2c8-222c6c792968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:27.809131 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbe6b3-57af-47c1-b2c8-222c6c792968 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:27.809308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:27.818057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 537/1067] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jun 7 21:49:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:27.824185 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbe6b3-57af-47c1-b2c8-222c6c792968 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:27.897355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee47802-b2b3-46a6-a10d-4a02f50f4320 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:27.932360 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003cdab-6bca-4c29-b0e9-50e24eda7a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:27.933075 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbe6b3-57af-47c1-b2c8-222c6c792968 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:27.933255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003cdab-6bca-4c29-b0e9-50e24eda7a53 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:27.933506 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003cdab-6bca-4c29-b0e9-50e24eda7a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:27.933782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003cdab-6bca-4c29-b0e9-50e24eda7a53 None admin] PATH_INFO: `/v3/users/a6bcfd11587340aa8b01f49b83f09d91` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:27.935167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003cdab-6bca-4c29-b0e9-50e24eda7a53 None admin] RBAC: Authorizing `identity:get_user(user_id=a6bcfd11587340aa8b01f49b83f09d91)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:27.936598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003cdab-6bca-4c29-b0e9-50e24eda7a53 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:27.942840 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 531/1068] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:49:27 2022] GET /identity/v3/users/a6bcfd11587340aa8b01f49b83f09d91 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:27.943647 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003cdab-6bca-4c29-b0e9-50e24eda7a53 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:27.971144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d08ce-9262-4332-8a8d-e6dc58e5dbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:27.971937 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d08ce-9262-4332-8a8d-e6dc58e5dbfe None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:27.972218 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d08ce-9262-4332-8a8d-e6dc58e5dbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:27.972489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d08ce-9262-4332-8a8d-e6dc58e5dbfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:27.984177 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d08ce-9262-4332-8a8d-e6dc58e5dbfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:27.985637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d08ce-9262-4332-8a8d-e6dc58e5dbfe None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:28.003638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-5a3d08ce-9262-4332-8a8d-e6dc58e5dbfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:28.003638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:28.003638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:28.003638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:28.003638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:28.003638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:28.003638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:28.003638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:28.003638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:28.003638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:28.003638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:28.003638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:28.003638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:49:28.003638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:49:28.003638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:49:28.004548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:49:28.004548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:28.004548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:28.004548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:28.004548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:28.004548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:28.004548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:28.004548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:28.004548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:28.004548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:28.004548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:28.004548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:28.004548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:28.004548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:28.004548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:28.004548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:28.004548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:28.005448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:49:28.005448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:49:28.005448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:28.005448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:28.005448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 538/1069] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:28.010350 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d08ce-9262-4332-8a8d-e6dc58e5dbfe None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:28.046584 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:28.053763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003cdab-6bca-4c29-b0e9-50e24eda7a53 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:28.055713 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:28.091813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96139a55-9649-4d15-9dfb-44042a19361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:28.092889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96139a55-9649-4d15-9dfb-44042a19361b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:28.093168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96139a55-9649-4d15-9dfb-44042a19361b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:28.093438 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96139a55-9649-4d15-9dfb-44042a19361b None admin] PATH_INFO: `/v3/projects/9aee4385c03d48b2a7336914dc35c9a4` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:28.094627 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96139a55-9649-4d15-9dfb-44042a19361b None admin] RBAC: Authorizing `identity:get_project(project_id=9aee4385c03d48b2a7336914dc35c9a4)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:28.096043 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96139a55-9649-4d15-9dfb-44042a19361b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:28.097891 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 532/1070] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:49:27 2022] GET /identity/v3/projects/9aee4385c03d48b2a7336914dc35c9a4 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:28.103766 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96139a55-9649-4d15-9dfb-44042a19361b None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:28.125135 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d08ce-9262-4332-8a8d-e6dc58e5dbfe None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:28.161261 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1b0c0-c68a-403f-a69b-d31b372b02c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:28.161915 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1b0c0-c68a-403f-a69b-d31b372b02c7 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:28.162227 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1b0c0-c68a-403f-a69b-d31b372b02c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:28.162505 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1b0c0-c68a-403f-a69b-d31b372b02c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:28.163216 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1b0c0-c68a-403f-a69b-d31b372b02c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:28.163524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1b0c0-c68a-403f-a69b-d31b372b02c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:28.164964 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1b0c0-c68a-403f-a69b-d31b372b02c7 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:28.181895 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 539/1071] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:28.182927 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1b0c0-c68a-403f-a69b-d31b372b02c7 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:28.208111 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96139a55-9649-4d15-9dfb-44042a19361b None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:28.244912 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5430c23-1ad2-430a-8aa8-3148d1b53017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:28.245822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5430c23-1ad2-430a-8aa8-3148d1b53017 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:28.246134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5430c23-1ad2-430a-8aa8-3148d1b53017 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:28.246414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5430c23-1ad2-430a-8aa8-3148d1b53017 None admin] PATH_INFO: `/v3/projects/9aee4385c03d48b2a7336914dc35c9a4/users/a6bcfd11587340aa8b01f49b83f09d91/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:28.248552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5430c23-1ad2-430a-8aa8-3148d1b53017 None admin] RBAC: Authorizing `identity:create_grant(project_id=9aee4385c03d48b2a7336914dc35c9a4, user_id=a6bcfd11587340aa8b01f49b83f09d91, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:28.250129 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5430c23-1ad2-430a-8aa8-3148d1b53017 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:28.265210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 533/1072] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:49:28 2022] PUT /identity/v3/projects/9aee4385c03d48b2a7336914dc35c9a4/users/a6bcfd11587340aa8b01f49b83f09d91/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 21:49:28.286828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:28.291338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1b0c0-c68a-403f-a69b-d31b372b02c7 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:28.329419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a9562-91cd-4a20-a696-71bed0490044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:28.330272 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a9562-91cd-4a20-a696-71bed0490044 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:28.330541 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a9562-91cd-4a20-a696-71bed0490044 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:28.330812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a9562-91cd-4a20-a696-71bed0490044 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:28.339838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a9562-91cd-4a20-a696-71bed0490044 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:28.341313 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a9562-91cd-4a20-a696-71bed0490044 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:28.360413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-f66a9562-91cd-4a20-a696-71bed0490044 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:49:28.360413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:28.360413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:28.360413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:28.360413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:28.360413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:28.360413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:28.360413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:28.360413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:28.360413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:28.360413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:28.360413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:28.360413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:49:28.360413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:49:28.360413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:49:28.360413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:28.361414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:28.362400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:28.362400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:28.362400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:49:28.362400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:49:28.362400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:49:28.362400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:49:28.362400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:49:28.362400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:49:28.362400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:49:28.362400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:28.370071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 540/1073] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 7 21:49:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:28.370816 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5430c23-1ad2-430a-8aa8-3148d1b53017 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:28.399601 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:28.486144 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5430c23-1ad2-430a-8aa8-3148d1b53017 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:28.520814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68935ec-f131-468c-a188-772b78dc4bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:28.521490 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68935ec-f131-468c-a188-772b78dc4bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:28.521774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68935ec-f131-468c-a188-772b78dc4bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:28.522083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68935ec-f131-468c-a188-772b78dc4bb5 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:28.522927 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68935ec-f131-468c-a188-772b78dc4bb5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:28.523239 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68935ec-f131-468c-a188-772b78dc4bb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:28.524712 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68935ec-f131-468c-a188-772b78dc4bb5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:28.543614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 534/1074] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 7 21:49:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:28.549362 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a9562-91cd-4a20-a696-71bed0490044 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:28.650215 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a9562-91cd-4a20-a696-71bed0490044 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:28.688063 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeafff5-7bcd-465f-b4db-cad98e4c393e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:28.688858 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeafff5-7bcd-465f-b4db-cad98e4c393e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:28.689142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeafff5-7bcd-465f-b4db-cad98e4c393e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:28.689416 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeafff5-7bcd-465f-b4db-cad98e4c393e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:28.700191 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeafff5-7bcd-465f-b4db-cad98e4c393e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:28.701639 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeafff5-7bcd-465f-b4db-cad98e4c393e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:28.718918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-aeeafff5-7bcd-465f-b4db-cad98e4c393e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:28.718918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:28.718918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:28.718918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:28.718918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:28.718918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:28.718918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:28.718918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:28.718918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:28.718918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:28.718918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:28.718918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:28.718918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:49:28.718918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:49:28.718918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:49:28.719805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:49:28.719805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:28.719805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:28.719805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:28.719805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:28.719805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:28.719805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:28.719805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:28.719805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:28.719805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:28.719805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:28.719805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:28.719805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:28.719805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:28.719805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:28.719805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:28.719805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:28.720712 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:49:28.720712 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:49:28.720712 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:28.720712 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:28.720712 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 541/1075] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:28.727353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68935ec-f131-468c-a188-772b78dc4bb5 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:28.810667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:28.829493 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68935ec-f131-468c-a188-772b78dc4bb5 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:28.864489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c605d-537d-4a08-926b-bdc748f8f14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:28.865141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c605d-537d-4a08-926b-bdc748f8f14e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:28.865417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c605d-537d-4a08-926b-bdc748f8f14e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:28.865682 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c605d-537d-4a08-926b-bdc748f8f14e None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:28.866414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c605d-537d-4a08-926b-bdc748f8f14e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:28.866715 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c605d-537d-4a08-926b-bdc748f8f14e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:28.868073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c605d-537d-4a08-926b-bdc748f8f14e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:28.879462 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 535/1076] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:28.884919 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeafff5-7bcd-465f-b4db-cad98e4c393e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:28.900369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:28.985248 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeafff5-7bcd-465f-b4db-cad98e4c393e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:28.992110 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8608ee-33e4-4b4f-a56c-e36fc7662a33 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:28.992921 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8608ee-33e4-4b4f-a56c-e36fc7662a33 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:28.993201 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8608ee-33e4-4b4f-a56c-e36fc7662a33 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:28.994745 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 536/1077] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:49:28.999707 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f9cea-b986-4760-87f2-c9e361f84b7d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:29.000004 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f9cea-b986-4760-87f2-c9e361f84b7d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:29.000279 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f9cea-b986-4760-87f2-c9e361f84b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:29.017259 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d65f9cea-b986-4760-87f2-c9e361f84b7d None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:29.018474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d65f9cea-b986-4760-87f2-c9e361f84b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:29.021279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad562e-feb5-422f-9942-1bf3bb13ec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:29.022092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad562e-feb5-422f-9942-1bf3bb13ec03 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:29.022371 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad562e-feb5-422f-9942-1bf3bb13ec03 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:29.022642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad562e-feb5-422f-9942-1bf3bb13ec03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:29.029308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad562e-feb5-422f-9942-1bf3bb13ec03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:29.030772 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad562e-feb5-422f-9942-1bf3bb13ec03 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:29.044594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-20ad562e-feb5-422f-9942-1bf3bb13ec03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:49:29.044594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:29.044594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:29.044594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:29.044594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:29.044594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:29.044594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:29.044594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:29.044594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:29.044594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:29.044594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:29.044594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:29.044594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:49:29.044594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:49:29.044594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:49:29.045496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:49:29.045496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:29.045496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:29.045496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:29.045496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:29.045496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:29.045496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:29.045496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:29.045496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:29.045496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:29.045496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:29.045496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:29.045496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:29.045496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:29.045496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:29.045496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:29.045496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:29.047021 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:49:29.047021 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:49:29.047021 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:49:29.047021 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:49:29.047021 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:49:29.047021 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:49:29.047021 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:49:29.047021 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:29.047021 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 542/1078] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:49:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:29.051349 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad562e-feb5-422f-9942-1bf3bb13ec03 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:29.088664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 537/1079] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 21:49:29.111382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f9cea-b986-4760-87f2-c9e361f84b7d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:29.125396 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:29.156872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad562e-feb5-422f-9942-1bf3bb13ec03 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:29.180174 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:29.196775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fd592-ffdd-42b0-9ecf-6a4548d166c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:29.197424 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fd592-ffdd-42b0-9ecf-6a4548d166c9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:29.197703 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fd592-ffdd-42b0-9ecf-6a4548d166c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:29.197995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fd592-ffdd-42b0-9ecf-6a4548d166c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:29.198767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fd592-ffdd-42b0-9ecf-6a4548d166c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:29.199072 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fd592-ffdd-42b0-9ecf-6a4548d166c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:29.200488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fd592-ffdd-42b0-9ecf-6a4548d166c9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:29.212314 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 543/1080] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:49:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:29.214867 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f9cea-b986-4760-87f2-c9e361f84b7d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:29.218117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fd592-ffdd-42b0-9ecf-6a4548d166c9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:29.252899 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935409dd-1ef9-48f9-afdd-4fedc03cb5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:29.253537 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935409dd-1ef9-48f9-afdd-4fedc03cb5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:29.253823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935409dd-1ef9-48f9-afdd-4fedc03cb5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:29.254110 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935409dd-1ef9-48f9-afdd-4fedc03cb5d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:29.320770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fd592-ffdd-42b0-9ecf-6a4548d166c9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:29.324347 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935409dd-1ef9-48f9-afdd-4fedc03cb5d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:29.325786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935409dd-1ef9-48f9-afdd-4fedc03cb5d1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:29.354948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:29.361885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b922740-baed-4d8a-8eee-067d0c2a959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:29.363029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b922740-baed-4d8a-8eee-067d0c2a959d None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:29.363309 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b922740-baed-4d8a-8eee-067d0c2a959d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:29.363579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b922740-baed-4d8a-8eee-067d0c2a959d None admin] PATH_INFO: `/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/1d5760a3f9f946978b1251d3e2aaa943/roles/7dadc9b4653f4b31856163d4e2cc6469` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:29.367420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b922740-baed-4d8a-8eee-067d0c2a959d None admin] RBAC: Authorizing `identity:create_grant(project_id=eca8f481deb242789622ebb10aa2c5da, user_id=1d5760a3f9f946978b1251d3e2aaa943, role_id=7dadc9b4653f4b31856163d4e2cc6469)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:29.369652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b922740-baed-4d8a-8eee-067d0c2a959d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:29.393965 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 544/1081] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:49:29 2022] PUT /identity/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/1d5760a3f9f946978b1251d3e2aaa943/roles/7dadc9b4653f4b31856163d4e2cc6469 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 21:49:29.416703 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:29.452236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 538/1082] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:49:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 07 21:49:29.458861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b922740-baed-4d8a-8eee-067d0c2a959d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:29.567267 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b922740-baed-4d8a-8eee-067d0c2a959d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:29.604462 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f85b1-f2ff-4425-9396-29f6d7afd0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:29.605256 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f85b1-f2ff-4425-9396-29f6d7afd0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:29.605538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f85b1-f2ff-4425-9396-29f6d7afd0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:29.605807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f85b1-f2ff-4425-9396-29f6d7afd0d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:29.616150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f85b1-f2ff-4425-9396-29f6d7afd0d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:29.618156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f85b1-f2ff-4425-9396-29f6d7afd0d6 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:29.635557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c65f85b1-f2ff-4425-9396-29f6d7afd0d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:29.635557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:29.635557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:29.635557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:29.635557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:29.635557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:29.635557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:29.635557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:29.635557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:29.635557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:29.635557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:29.635557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:29.635557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:49:29.635557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:49:29.635557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:49:29.636542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:49:29.636542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:29.636542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:29.636542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:29.636542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:29.636542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:29.636542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:29.636542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:29.636542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:29.636542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:29.636542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:29.636542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:29.636542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:29.636542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:29.636542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:29.636542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:29.636542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:29.637445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:49:29.637445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:49:29.637445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:29.637445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:29.641588 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 545/1083] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:29.643015 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935409dd-1ef9-48f9-afdd-4fedc03cb5d1 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:29.743604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935409dd-1ef9-48f9-afdd-4fedc03cb5d1 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:29.778023 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1e040-fb99-48f2-ad74-9e43da43b98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:29.778690 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1e040-fb99-48f2-ad74-9e43da43b98e None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:29.778970 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1e040-fb99-48f2-ad74-9e43da43b98e None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:29.779243 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1e040-fb99-48f2-ad74-9e43da43b98e None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:29.779958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1e040-fb99-48f2-ad74-9e43da43b98e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:29.780261 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1e040-fb99-48f2-ad74-9e43da43b98e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:29.781630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1e040-fb99-48f2-ad74-9e43da43b98e None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:29.801964 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 539/1084] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:30.528456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2660c57-1d9c-43a1-a953-63a6f984c0ab None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:30.528970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2660c57-1d9c-43a1-a953-63a6f984c0ab None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:30.528970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2660c57-1d9c-43a1-a953-63a6f984c0ab None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:30.530352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 546/1085] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:30.536164 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a5616-d516-4d5e-a8ac-bf6465bbc499 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:30.536659 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a5616-d516-4d5e-a8ac-bf6465bbc499 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:30.536740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a5616-d516-4d5e-a8ac-bf6465bbc499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:30.553111 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1f2a5616-d516-4d5e-a8ac-bf6465bbc499 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:30.554311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1f2a5616-d516-4d5e-a8ac-bf6465bbc499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:30.580151 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:30.621406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 540/1086] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:30.644578 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2660c57-1d9c-43a1-a953-63a6f984c0ab None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:30.691506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:30.747230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2660c57-1d9c-43a1-a953-63a6f984c0ab None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:30.780115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7602628-9f6b-40b7-8fbf-4ac69f0c550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:30.780900 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7602628-9f6b-40b7-8fbf-4ac69f0c550e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:30.781181 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7602628-9f6b-40b7-8fbf-4ac69f0c550e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:30.781456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7602628-9f6b-40b7-8fbf-4ac69f0c550e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:30.791936 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7602628-9f6b-40b7-8fbf-4ac69f0c550e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:49:30.799506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c7602628-9f6b-40b7-8fbf-4ac69f0c550e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:49:30.799506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:30.799506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:30.799506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:30.799506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:30.799506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:30.799506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:30.799506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:30.799506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:30.799506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:30.799506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:30.799506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:30.799506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:49:30.799506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:49:30.799506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:49:30.799506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:49:30.800594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:49:30.800594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:49:30.800594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:49:30.800594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:49:30.800594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:30.800594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:30.800594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:30.800594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:30.800594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:30.800594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:30.800594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:30.800594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:30.800594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:30.800594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:30.800594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:30.800594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:30.807121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:30.807121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:30.807121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:30.807121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:30.807121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:49:30.807121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:49:30.807121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:49:30.807121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:49:30.807121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:49:30.807121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:49:30.807121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:49:30.807121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:30.807121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 547/1087] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:49:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:30.807984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a5616-d516-4d5e-a8ac-bf6465bbc499 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:30.902262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a5616-d516-4d5e-a8ac-bf6465bbc499 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:30.935394 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2f0de-dc4b-45f3-9aa5-06a32db85235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:30.936056 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2f0de-dc4b-45f3-9aa5-06a32db85235 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:30.936339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2f0de-dc4b-45f3-9aa5-06a32db85235 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:30.936619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2f0de-dc4b-45f3-9aa5-06a32db85235 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:30.937361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2f0de-dc4b-45f3-9aa5-06a32db85235 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:30.937668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2f0de-dc4b-45f3-9aa5-06a32db85235 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:30.939062 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2f0de-dc4b-45f3-9aa5-06a32db85235 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:30.947118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 541/1088] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:49:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:30.952728 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7602628-9f6b-40b7-8fbf-4ac69f0c550e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:31.050656 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7602628-9f6b-40b7-8fbf-4ac69f0c550e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:31.052929 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:31.083190 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba329a6-32df-48e8-b7db-5be0d76a4c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:31.084045 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba329a6-32df-48e8-b7db-5be0d76a4c48 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:31.084328 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba329a6-32df-48e8-b7db-5be0d76a4c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:31.084599 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba329a6-32df-48e8-b7db-5be0d76a4c48 None admin] PATH_INFO: `/v3/users/a6bcfd11587340aa8b01f49b83f09d91` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:31.085768 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba329a6-32df-48e8-b7db-5be0d76a4c48 None admin] RBAC: Authorizing `identity:get_user(user_id=a6bcfd11587340aa8b01f49b83f09d91)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:31.087894 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba329a6-32df-48e8-b7db-5be0d76a4c48 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:31.089673 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 548/1089] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:49:30 2022] GET /identity/v3/users/a6bcfd11587340aa8b01f49b83f09d91 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:31.095228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2f0de-dc4b-45f3-9aa5-06a32db85235 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:31.121097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:31.194782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2f0de-dc4b-45f3-9aa5-06a32db85235 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:31.227774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1be6f5-eb35-4114-9c79-4496ddc439c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:31.228414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be6f5-eb35-4114-9c79-4496ddc439c9 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:31.228698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be6f5-eb35-4114-9c79-4496ddc439c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:31.228977 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be6f5-eb35-4114-9c79-4496ddc439c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:31.296746 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1be6f5-eb35-4114-9c79-4496ddc439c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:31.298227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1be6f5-eb35-4114-9c79-4496ddc439c9 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:31.323489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:31.402285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 542/1090] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:49:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:49:31.408091 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba329a6-32df-48e8-b7db-5be0d76a4c48 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:31.505309 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba329a6-32df-48e8-b7db-5be0d76a4c48 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:31.537795 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e50d84-2ebe-471c-b434-acf35823db14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:31.538681 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50d84-2ebe-471c-b434-acf35823db14 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:31.539478 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50d84-2ebe-471c-b434-acf35823db14 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:31.539764 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50d84-2ebe-471c-b434-acf35823db14 None admin] PATH_INFO: `/v3/projects/9aee4385c03d48b2a7336914dc35c9a4` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:31.540940 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e50d84-2ebe-471c-b434-acf35823db14 None admin] RBAC: Authorizing `identity:get_project(project_id=9aee4385c03d48b2a7336914dc35c9a4)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:31.542403 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e50d84-2ebe-471c-b434-acf35823db14 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:31.544086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 549/1091] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:49:31 2022] GET /identity/v3/projects/9aee4385c03d48b2a7336914dc35c9a4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:31.550164 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1be6f5-eb35-4114-9c79-4496ddc439c9 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:31.645795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1be6f5-eb35-4114-9c79-4496ddc439c9 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:31.651246 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc3c02-b663-47a7-b0db-e4a1795ed869 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:31.651534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc3c02-b663-47a7-b0db-e4a1795ed869 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:31.651809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc3c02-b663-47a7-b0db-e4a1795ed869 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:31.653151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 550/1092] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:31.657816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093793d-3a0c-4b34-8db9-2d456d3d1876 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:31.658129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093793d-3a0c-4b34-8db9-2d456d3d1876 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:31.658401 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093793d-3a0c-4b34-8db9-2d456d3d1876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:31.669896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:31.675234 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c093793d-3a0c-4b34-8db9-2d456d3d1876 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:31.676440 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c093793d-3a0c-4b34-8db9-2d456d3d1876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:31.681453 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60398e82-b111-4efc-baeb-98b8240a84e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:31.682197 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60398e82-b111-4efc-baeb-98b8240a84e2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:31.682479 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60398e82-b111-4efc-baeb-98b8240a84e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:31.682755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60398e82-b111-4efc-baeb-98b8240a84e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:31.683575 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60398e82-b111-4efc-baeb-98b8240a84e2 None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=9aee4385c03d48b2a7336914dc35c9a4, user.id=a6bcfd11587340aa8b01f49b83f09d91) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:31.683888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60398e82-b111-4efc-baeb-98b8240a84e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:31.685319 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60398e82-b111-4efc-baeb-98b8240a84e2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:31.701967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 543/1093] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:49:31 2022] GET /identity/v3/role_assignments?user.id=a6bcfd11587340aa8b01f49b83f09d91&scope.project.id=9aee4385c03d48b2a7336914dc35c9a4&role.id=8f58ef9d28494d97a68de20b84355450 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:31.712363 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:31.748747 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 551/1094] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 21:49:31.772582 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60398e82-b111-4efc-baeb-98b8240a84e2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:31.878893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60398e82-b111-4efc-baeb-98b8240a84e2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:31.913175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d16af-b323-421c-bdd5-dc7de7235f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:31.914026 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d16af-b323-421c-bdd5-dc7de7235f3f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:31.914310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d16af-b323-421c-bdd5-dc7de7235f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:31.914590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d16af-b323-421c-bdd5-dc7de7235f3f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:31.924949 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d16af-b323-421c-bdd5-dc7de7235f3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:49:31.933553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-6b1d16af-b323-421c-bdd5-dc7de7235f3f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 21:49:31.933553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:31.933553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:31.933553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:31.933553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:31.933553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:31.933553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:31.933553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:31.933553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:31.933553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:31.933553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:31.933553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:31.933553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:49:31.933553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:49:31.933553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:49:31.933553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:49:31.934735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:49:31.934735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:49:31.934735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:49:31.934735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:49:31.934735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:31.934735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:31.934735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:31.934735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:31.934735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:31.934735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:31.934735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:31.934735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:31.934735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:31.934735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:31.934735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:31.934735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:31.935692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:31.935692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:31.935692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:31.935692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:31.935692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:49:31.935692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:49:31.935692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:49:31.935692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:49:31.935692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:49:31.935692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:49:31.935692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 21:49:31.935692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:31.935692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 544/1095] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jun 7 21:49:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:31.940747 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093793d-3a0c-4b34-8db9-2d456d3d1876 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:32.037110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093793d-3a0c-4b34-8db9-2d456d3d1876 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:32.069975 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f346-2021-4694-ae9e-9ef918dffb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:32.071249 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f346-2021-4694-ae9e-9ef918dffb5c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:32.071528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f346-2021-4694-ae9e-9ef918dffb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:32.071798 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f346-2021-4694-ae9e-9ef918dffb5c None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:32.072537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754f346-2021-4694-ae9e-9ef918dffb5c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:32.072837 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754f346-2021-4694-ae9e-9ef918dffb5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:32.074216 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754f346-2021-4694-ae9e-9ef918dffb5c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:32.082180 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 552/1096] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jun 7 21:49:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:32.087906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d16af-b323-421c-bdd5-dc7de7235f3f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:32.136076 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:32.186222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d16af-b323-421c-bdd5-dc7de7235f3f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:32.218520 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f7c73-cca0-4002-ac39-ec42f09eb671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:32.219335 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f7c73-cca0-4002-ac39-ec42f09eb671 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:32.219622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f7c73-cca0-4002-ac39-ec42f09eb671 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:32.219901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f7c73-cca0-4002-ac39-ec42f09eb671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:32.231177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f7c73-cca0-4002-ac39-ec42f09eb671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:32.232637 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f7c73-cca0-4002-ac39-ec42f09eb671 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:32.249762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-344f7c73-cca0-4002-ac39-ec42f09eb671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:32.249762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:32.249762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:32.249762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:32.249762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:32.249762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:32.249762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:32.249762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:32.249762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:32.249762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:32.249762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:32.249762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:32.249762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:49:32.249762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:49:32.249762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:49:32.250860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:49:32.250860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:32.250860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:32.250860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:32.250860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:32.250860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:32.250860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:32.250860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:32.250860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:32.250860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:32.250860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:32.250860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:32.250860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:32.250860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:32.250860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:32.250860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:32.250860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:32.251748 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:49:32.251748 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:49:32.251748 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:32.251748 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:32.251748 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 545/1097] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:49:32.256764 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f346-2021-4694-ae9e-9ef918dffb5c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:32.288762 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:32.356477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f346-2021-4694-ae9e-9ef918dffb5c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:32.389895 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdaaa6-231f-40ef-823d-3d366f5b188a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:32.390579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdaaa6-231f-40ef-823d-3d366f5b188a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:32.390863 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdaaa6-231f-40ef-823d-3d366f5b188a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:32.391139 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdaaa6-231f-40ef-823d-3d366f5b188a None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:32.391858 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdaaa6-231f-40ef-823d-3d366f5b188a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:32.392166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdaaa6-231f-40ef-823d-3d366f5b188a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:32.393536 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdaaa6-231f-40ef-823d-3d366f5b188a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:32.405070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 553/1098] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:32.410722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f7c73-cca0-4002-ac39-ec42f09eb671 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:32.505664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:32.508783 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f7c73-cca0-4002-ac39-ec42f09eb671 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:32.541759 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b406ef3-5f34-47f4-9544-6703d3272979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:32.542481 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406ef3-5f34-47f4-9544-6703d3272979 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:32.542761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406ef3-5f34-47f4-9544-6703d3272979 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:32.543030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406ef3-5f34-47f4-9544-6703d3272979 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:32.550255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b406ef3-5f34-47f4-9544-6703d3272979 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:32.551676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b406ef3-5f34-47f4-9544-6703d3272979 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:32.565612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-7b406ef3-5f34-47f4-9544-6703d3272979 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:49:32.565612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:32.565612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:32.565612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:32.565612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:32.565612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:32.565612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:32.565612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:32.565612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:32.565612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:32.565612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:32.565612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:32.565612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:49:32.565612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:49:32.565612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:49:32.565612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:32.566636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:32.568087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:32.568087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:32.568087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:49:32.568087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:49:32.568087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:49:32.568087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:49:32.568087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:49:32.568087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:49:32.568087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 21:49:32.568087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:32.568087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 546/1099] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 7 21:49:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:32.572522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdaaa6-231f-40ef-823d-3d366f5b188a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:32.660691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:32.669611 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdaaa6-231f-40ef-823d-3d366f5b188a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:32.702765 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccc451-2a1d-4a6d-a8c7-338ca8680c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:32.703415 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccc451-2a1d-4a6d-a8c7-338ca8680c33 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:32.703699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccc451-2a1d-4a6d-a8c7-338ca8680c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:32.703974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccc451-2a1d-4a6d-a8c7-338ca8680c33 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:32.704796 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cccc451-2a1d-4a6d-a8c7-338ca8680c33 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:32.705106 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cccc451-2a1d-4a6d-a8c7-338ca8680c33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:32.706566 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cccc451-2a1d-4a6d-a8c7-338ca8680c33 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:32.723575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 554/1100] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 7 21:49:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:32.729370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b406ef3-5f34-47f4-9544-6703d3272979 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:32.826837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b406ef3-5f34-47f4-9544-6703d3272979 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:32.860776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7aa5f-e095-4b1b-a40c-9add6922309f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:32.861419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7aa5f-e095-4b1b-a40c-9add6922309f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:32.861702 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7aa5f-e095-4b1b-a40c-9add6922309f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:32.862003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7aa5f-e095-4b1b-a40c-9add6922309f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:32.889230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:32.928670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7aa5f-e095-4b1b-a40c-9add6922309f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:32.930195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7aa5f-e095-4b1b-a40c-9add6922309f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:33.027438 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 547/1101] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:49:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:49:33.033198 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccc451-2a1d-4a6d-a8c7-338ca8680c33 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:33.130179 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccc451-2a1d-4a6d-a8c7-338ca8680c33 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:33.163103 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45b850-6c0c-49a4-9850-0b179831e65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:33.163881 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45b850-6c0c-49a4-9850-0b179831e65f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:33.164665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45b850-6c0c-49a4-9850-0b179831e65f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:33.164939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45b850-6c0c-49a4-9850-0b179831e65f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:33.174798 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45b850-6c0c-49a4-9850-0b179831e65f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:33.176241 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45b850-6c0c-49a4-9850-0b179831e65f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:33.193749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-6a45b850-6c0c-49a4-9850-0b179831e65f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:33.193749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:33.193749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:33.193749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:33.193749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:33.193749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:33.193749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:33.193749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:33.193749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:33.193749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:33.193749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:33.193749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:33.193749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:49:33.193749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:49:33.193749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:49:33.194811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:49:33.194811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:33.194811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:33.194811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:33.194811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:33.194811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:33.194811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:33.194811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:33.194811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:33.194811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:33.194811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:33.194811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:33.194811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:33.194811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:33.194811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:33.194811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:33.194811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:33.195747 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:49:33.195747 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:49:33.195747 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:49:33.195747 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:33.195747 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 555/1102] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:33.200620 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7aa5f-e095-4b1b-a40c-9add6922309f None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:33.258683 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:33.298618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7aa5f-e095-4b1b-a40c-9add6922309f None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:33.331921 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daea7e7-9ff3-4347-ab03-383beb9d7f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:33.332578 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daea7e7-9ff3-4347-ab03-383beb9d7f64 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:33.332860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daea7e7-9ff3-4347-ab03-383beb9d7f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:33.333135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daea7e7-9ff3-4347-ab03-383beb9d7f64 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:33.333853 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daea7e7-9ff3-4347-ab03-383beb9d7f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:33.334190 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daea7e7-9ff3-4347-ab03-383beb9d7f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:33.335550 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daea7e7-9ff3-4347-ab03-383beb9d7f64 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:33.346602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 548/1103] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:33.352565 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45b850-6c0c-49a4-9850-0b179831e65f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:33.355466 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:33.450889 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45b850-6c0c-49a4-9850-0b179831e65f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:33.484752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06649615-430a-40b4-b3b6-621a9e61ead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:33.485535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06649615-430a-40b4-b3b6-621a9e61ead3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:33.485820 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06649615-430a-40b4-b3b6-621a9e61ead3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:33.486130 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06649615-430a-40b4-b3b6-621a9e61ead3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:33.492681 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06649615-430a-40b4-b3b6-621a9e61ead3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:33.494150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06649615-430a-40b4-b3b6-621a9e61ead3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:33.507586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-06649615-430a-40b4-b3b6-621a9e61ead3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:49:33.507586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:33.507586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:33.507586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:33.507586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:33.507586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:33.507586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:33.507586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:33.507586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:33.507586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:33.507586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:33.507586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:33.507586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:49:33.507586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:49:33.507586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:49:33.508502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:49:33.508502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:33.508502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:33.508502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:33.508502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:33.508502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:33.508502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:33.508502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:33.508502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:33.508502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:33.508502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:33.508502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:33.508502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:33.508502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:33.508502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:33.508502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:33.508502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:33.509407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:49:33.509407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:49:33.509407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:49:33.509407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:49:33.509407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:49:33.509407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:49:33.509407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:49:33.509407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:33.509407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 556/1104] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:49:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:33.514572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daea7e7-9ff3-4347-ab03-383beb9d7f64 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:33.611754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daea7e7-9ff3-4347-ab03-383beb9d7f64 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:33.633726 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:33.648982 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d282be8-6ee7-47ee-b49b-970ebf1d0cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:33.649649 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d282be8-6ee7-47ee-b49b-970ebf1d0cac None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:33.649950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d282be8-6ee7-47ee-b49b-970ebf1d0cac None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:33.650236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d282be8-6ee7-47ee-b49b-970ebf1d0cac None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:33.651024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d282be8-6ee7-47ee-b49b-970ebf1d0cac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:33.651331 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d282be8-6ee7-47ee-b49b-970ebf1d0cac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:33.652759 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d282be8-6ee7-47ee-b49b-970ebf1d0cac None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:33.664784 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 549/1105] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:49:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:33.670719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06649615-430a-40b4-b3b6-621a9e61ead3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:33.730918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:33.769012 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06649615-430a-40b4-b3b6-621a9e61ead3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:33.801691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d5078-b654-4cad-a7c2-bc8544b910e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:33.802358 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d5078-b654-4cad-a7c2-bc8544b910e8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:33.802639 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d5078-b654-4cad-a7c2-bc8544b910e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:33.802910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d5078-b654-4cad-a7c2-bc8544b910e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:33.803730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d5078-b654-4cad-a7c2-bc8544b910e8 None admin] RBAC: Adding query filter params (role.id=7dadc9b4653f4b31856163d4e2cc6469, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=1d5760a3f9f946978b1251d3e2aaa943) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:33.804040 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d5078-b654-4cad-a7c2-bc8544b910e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:33.806030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d5078-b654-4cad-a7c2-bc8544b910e8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:33.811821 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 557/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:49:33 2022] GET /identity/v3/role_assignments?user.id=1d5760a3f9f946978b1251d3e2aaa943&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=7dadc9b4653f4b31856163d4e2cc6469 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:33.945180 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb0d02-2aed-4ae3-88a6-1b0cdef63d4f None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:33.945469 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb0d02-2aed-4ae3-88a6-1b0cdef63d4f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:33.945748 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb0d02-2aed-4ae3-88a6-1b0cdef63d4f None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:33.947170 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 550/1107] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:33.953007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baee24d-c818-48cc-92c9-fd912a35ba46 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:33.953295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baee24d-c818-48cc-92c9-fd912a35ba46 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:33.953572 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baee24d-c818-48cc-92c9-fd912a35ba46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:33.971090 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-6baee24d-c818-48cc-92c9-fd912a35ba46 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:33.972293 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6baee24d-c818-48cc-92c9-fd912a35ba46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:34.044068 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 558/1108] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:34.068514 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb0d02-2aed-4ae3-88a6-1b0cdef63d4f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:34.170722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb0d02-2aed-4ae3-88a6-1b0cdef63d4f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:34.204583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf936a-97c1-4212-a877-134a5147fb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:34.205376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf936a-97c1-4212-a877-134a5147fb1b None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:34.205656 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf936a-97c1-4212-a877-134a5147fb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:34.205944 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf936a-97c1-4212-a877-134a5147fb1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:34.207141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf936a-97c1-4212-a877-134a5147fb1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:34.208574 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf936a-97c1-4212-a877-134a5147fb1b None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:34.210407 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 551/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:34.216663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baee24d-c818-48cc-92c9-fd912a35ba46 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:34.275191 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:34.325642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baee24d-c818-48cc-92c9-fd912a35ba46 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:34.360683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5672dd1-f21e-4ab2-9d91-865e1236361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:34.361359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5672dd1-f21e-4ab2-9d91-865e1236361c None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:34.361641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5672dd1-f21e-4ab2-9d91-865e1236361c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:34.361916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5672dd1-f21e-4ab2-9d91-865e1236361c None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:34.362663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5672dd1-f21e-4ab2-9d91-865e1236361c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:34.364109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5672dd1-f21e-4ab2-9d91-865e1236361c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:34.384808 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 559/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:49:34 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:49:36.636089 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c127e-64f7-40f8-9e4b-a8543e1f43ce None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:36.636611 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c127e-64f7-40f8-9e4b-a8543e1f43ce None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:36.636611 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c127e-64f7-40f8-9e4b-a8543e1f43ce None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:36.637952 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 552/1111] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:36.643015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b6cdb-f35b-47ee-ac7c-22fb7af492aa None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:36.643445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b6cdb-f35b-47ee-ac7c-22fb7af492aa None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:36.643548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b6cdb-f35b-47ee-ac7c-22fb7af492aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:36.661076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4e2b6cdb-f35b-47ee-ac7c-22fb7af492aa None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:36.662276 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4e2b6cdb-f35b-47ee-ac7c-22fb7af492aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:36.726046 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 560/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:36.749226 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c127e-64f7-40f8-9e4b-a8543e1f43ce None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:36.798278 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:36.848204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c127e-64f7-40f8-9e4b-a8543e1f43ce None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:36.881811 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea43629-f572-465f-9896-4f2e476e8d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:36.882704 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea43629-f572-465f-9896-4f2e476e8d20 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:36.882987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea43629-f572-465f-9896-4f2e476e8d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:36.883263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea43629-f572-465f-9896-4f2e476e8d20 None admin] PATH_INFO: `/v3/roles/73d4eafa268f4cc3aca4863c73b794ae` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:36.884725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea43629-f572-465f-9896-4f2e476e8d20 None admin] RBAC: Authorizing `identity:get_role(role_id=73d4eafa268f4cc3aca4863c73b794ae)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:36.886172 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea43629-f572-465f-9896-4f2e476e8d20 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:36.887469 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 553/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:49:36 2022] GET /identity/v3/roles/73d4eafa268f4cc3aca4863c73b794ae => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:36.893097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b6cdb-f35b-47ee-ac7c-22fb7af492aa None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:36.934615 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:36.989221 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b6cdb-f35b-47ee-ac7c-22fb7af492aa None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:37.021410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539afe1f-58a9-4e57-a804-c2fc72e0a574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:37.022282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539afe1f-58a9-4e57-a804-c2fc72e0a574 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:37.022558 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539afe1f-58a9-4e57-a804-c2fc72e0a574 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:37.022823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539afe1f-58a9-4e57-a804-c2fc72e0a574 None admin] PATH_INFO: `/v3/users/6c5d9cfcb0cc4816adc28565245957c9` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:37.035700 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539afe1f-58a9-4e57-a804-c2fc72e0a574 None admin] RBAC: Authorizing `identity:get_user(user_id=6c5d9cfcb0cc4816adc28565245957c9)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:37.037118 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539afe1f-58a9-4e57-a804-c2fc72e0a574 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:37.038728 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 561/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:49:36 2022] GET /identity/v3/users/6c5d9cfcb0cc4816adc28565245957c9 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:37.044760 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea43629-f572-465f-9896-4f2e476e8d20 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:37.142003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea43629-f572-465f-9896-4f2e476e8d20 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:37.157624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:37.175303 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9152e14-a91a-4a9e-a762-7a1911356a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:37.175928 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9152e14-a91a-4a9e-a762-7a1911356a73 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:37.176211 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9152e14-a91a-4a9e-a762-7a1911356a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:37.176485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9152e14-a91a-4a9e-a762-7a1911356a73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:37.241163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9152e14-a91a-4a9e-a762-7a1911356a73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:37.243166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9152e14-a91a-4a9e-a762-7a1911356a73 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:37.336628 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 554/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:49:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:49:37.342501 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539afe1f-58a9-4e57-a804-c2fc72e0a574 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:37.435807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:37.439079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539afe1f-58a9-4e57-a804-c2fc72e0a574 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:37.472736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227da28-32e1-41e6-8728-d6fc6265b2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:37.473583 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227da28-32e1-41e6-8728-d6fc6265b2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:37.473863 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227da28-32e1-41e6-8728-d6fc6265b2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:37.474159 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227da28-32e1-41e6-8728-d6fc6265b2a1 None admin] PATH_INFO: `/v3/projects/9aee4385c03d48b2a7336914dc35c9a4` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:37.475320 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227da28-32e1-41e6-8728-d6fc6265b2a1 None admin] RBAC: Authorizing `identity:get_project(project_id=9aee4385c03d48b2a7336914dc35c9a4)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:37.477088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227da28-32e1-41e6-8728-d6fc6265b2a1 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:37.478807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 562/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:49:37 2022] GET /identity/v3/projects/9aee4385c03d48b2a7336914dc35c9a4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:37.484765 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9152e14-a91a-4a9e-a762-7a1911356a73 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:37.501553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:37.580243 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9152e14-a91a-4a9e-a762-7a1911356a73 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:37.612911 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161aa012-39c6-4f38-8d17-c6689be52824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:37.613549 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aa012-39c6-4f38-8d17-c6689be52824 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:37.613833 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aa012-39c6-4f38-8d17-c6689be52824 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:37.614134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aa012-39c6-4f38-8d17-c6689be52824 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:37.614953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161aa012-39c6-4f38-8d17-c6689be52824 None admin] RBAC: Adding query filter params (role.id=73d4eafa268f4cc3aca4863c73b794ae, scope.project.id=9aee4385c03d48b2a7336914dc35c9a4, user.id=6c5d9cfcb0cc4816adc28565245957c9) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:37.615263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161aa012-39c6-4f38-8d17-c6689be52824 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:37.616681 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161aa012-39c6-4f38-8d17-c6689be52824 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:37.622222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 555/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:49:37 2022] GET /identity/v3/role_assignments?user.id=6c5d9cfcb0cc4816adc28565245957c9&scope.project.id=9aee4385c03d48b2a7336914dc35c9a4&role.id=73d4eafa268f4cc3aca4863c73b794ae => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:39.809266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e272d10-ce55-48e6-bd59-2e8e46fae3b9 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:39.809782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e272d10-ce55-48e6-bd59-2e8e46fae3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:39.809782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e272d10-ce55-48e6-bd59-2e8e46fae3b9 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:39.811142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 563/1118] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:39.816332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1d93c-5ee7-41c8-bc95-c3252185f0d5 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:39.816762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1d93c-5ee7-41c8-bc95-c3252185f0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:39.816891 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1d93c-5ee7-41c8-bc95-c3252185f0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:39.833177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6eb1d93c-5ee7-41c8-bc95-c3252185f0d5 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:39.834403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6eb1d93c-5ee7-41c8-bc95-c3252185f0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:39.898754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 556/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:39.921574 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e272d10-ce55-48e6-bd59-2e8e46fae3b9 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:40.018100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e272d10-ce55-48e6-bd59-2e8e46fae3b9 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:40.050084 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b78ea-27a6-4e38-a006-ecb30f3bd487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:40.050916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b78ea-27a6-4e38-a006-ecb30f3bd487 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:40.051191 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b78ea-27a6-4e38-a006-ecb30f3bd487 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:40.051457 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b78ea-27a6-4e38-a006-ecb30f3bd487 None admin] PATH_INFO: `/v3/roles/73d4eafa268f4cc3aca4863c73b794ae` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:40.052906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b78ea-27a6-4e38-a006-ecb30f3bd487 None admin] RBAC: Authorizing `identity:get_role(role_id=73d4eafa268f4cc3aca4863c73b794ae)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:40.054291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b78ea-27a6-4e38-a006-ecb30f3bd487 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:40.056137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 564/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:49:39 2022] GET /identity/v3/roles/73d4eafa268f4cc3aca4863c73b794ae => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:40.061841 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1d93c-5ee7-41c8-bc95-c3252185f0d5 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:40.073455 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:40.157166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1d93c-5ee7-41c8-bc95-c3252185f0d5 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:40.198192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97cf7d-1f2b-4f3b-aacf-1187a5d4c431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:40.199042 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97cf7d-1f2b-4f3b-aacf-1187a5d4c431 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:40.199323 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97cf7d-1f2b-4f3b-aacf-1187a5d4c431 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:40.199597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97cf7d-1f2b-4f3b-aacf-1187a5d4c431 None admin] PATH_INFO: `/v3/users/6c5d9cfcb0cc4816adc28565245957c9` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:40.200766 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97cf7d-1f2b-4f3b-aacf-1187a5d4c431 None admin] RBAC: Authorizing `identity:get_user(user_id=6c5d9cfcb0cc4816adc28565245957c9)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:40.202344 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97cf7d-1f2b-4f3b-aacf-1187a5d4c431 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:40.203952 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 557/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:49:40 2022] GET /identity/v3/users/6c5d9cfcb0cc4816adc28565245957c9 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:40.209672 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b78ea-27a6-4e38-a006-ecb30f3bd487 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:40.243584 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:40.303841 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b78ea-27a6-4e38-a006-ecb30f3bd487 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:40.336324 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38eda58-2ad0-4ba3-8a65-5ab9ed06c11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:40.337195 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eda58-2ad0-4ba3-8a65-5ab9ed06c11e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:40.337468 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eda58-2ad0-4ba3-8a65-5ab9ed06c11e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:40.337735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eda58-2ad0-4ba3-8a65-5ab9ed06c11e None admin] PATH_INFO: `/v3/projects/9aee4385c03d48b2a7336914dc35c9a4` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:40.338907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38eda58-2ad0-4ba3-8a65-5ab9ed06c11e None admin] RBAC: Authorizing `identity:get_project(project_id=9aee4385c03d48b2a7336914dc35c9a4)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:40.340322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38eda58-2ad0-4ba3-8a65-5ab9ed06c11e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:40.341983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 565/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:49:40 2022] GET /identity/v3/projects/9aee4385c03d48b2a7336914dc35c9a4 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:40.347758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97cf7d-1f2b-4f3b-aacf-1187a5d4c431 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:40.428345 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:40.449984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97cf7d-1f2b-4f3b-aacf-1187a5d4c431 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:40.482668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef191d-84fb-486b-9c6e-b7716b73d3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:40.483536 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef191d-84fb-486b-9c6e-b7716b73d3d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:40.483818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef191d-84fb-486b-9c6e-b7716b73d3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:40.484092 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef191d-84fb-486b-9c6e-b7716b73d3d4 None admin] PATH_INFO: `/v3/projects/9aee4385c03d48b2a7336914dc35c9a4/users/6c5d9cfcb0cc4816adc28565245957c9/roles/73d4eafa268f4cc3aca4863c73b794ae` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:40.486275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef191d-84fb-486b-9c6e-b7716b73d3d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9aee4385c03d48b2a7336914dc35c9a4, user_id=6c5d9cfcb0cc4816adc28565245957c9, role_id=73d4eafa268f4cc3aca4863c73b794ae)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:40.487707 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef191d-84fb-486b-9c6e-b7716b73d3d4 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:40.500349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 558/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:49:40 2022] PUT /identity/v3/projects/9aee4385c03d48b2a7336914dc35c9a4/users/6c5d9cfcb0cc4816adc28565245957c9/roles/73d4eafa268f4cc3aca4863c73b794ae => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:49:42.706652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b85a0-6ad3-4051-8bc8-cf3ebe6e350b None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:42.707167 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b85a0-6ad3-4051-8bc8-cf3ebe6e350b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:42.707167 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b85a0-6ad3-4051-8bc8-cf3ebe6e350b None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:42.708458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 566/1124] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:42.714178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e01a-3f5f-4e74-a3fb-6e6fb9eaa4dd None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:42.714601 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e01a-3f5f-4e74-a3fb-6e6fb9eaa4dd None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:42.714734 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e01a-3f5f-4e74-a3fb-6e6fb9eaa4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:42.731215 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-fdb4e01a-3f5f-4e74-a3fb-6e6fb9eaa4dd None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:42.732365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fdb4e01a-3f5f-4e74-a3fb-6e6fb9eaa4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:42.795904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 559/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:42.818853 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b85a0-6ad3-4051-8bc8-cf3ebe6e350b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:42.916966 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b85a0-6ad3-4051-8bc8-cf3ebe6e350b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:42.919236 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:42.950124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de447274-5057-4b9b-bf14-96419527e2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:42.950960 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de447274-5057-4b9b-bf14-96419527e2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:42.951235 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de447274-5057-4b9b-bf14-96419527e2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:42.951506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de447274-5057-4b9b-bf14-96419527e2a6 None admin] PATH_INFO: `/v3/roles/73d4eafa268f4cc3aca4863c73b794ae` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:42.952939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de447274-5057-4b9b-bf14-96419527e2a6 None admin] RBAC: Authorizing `identity:get_role(role_id=73d4eafa268f4cc3aca4863c73b794ae)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:42.954425 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de447274-5057-4b9b-bf14-96419527e2a6 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:42.955746 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 567/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:49:42 2022] GET /identity/v3/roles/73d4eafa268f4cc3aca4863c73b794ae => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:42.961891 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4e01a-3f5f-4e74-a3fb-6e6fb9eaa4dd None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:43.025271 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:43.057665 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4e01a-3f5f-4e74-a3fb-6e6fb9eaa4dd None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:43.089693 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085abe8-84d1-4a4b-9b40-5b94e358600a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:43.090560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085abe8-84d1-4a4b-9b40-5b94e358600a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:43.090840 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085abe8-84d1-4a4b-9b40-5b94e358600a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:43.091116 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085abe8-84d1-4a4b-9b40-5b94e358600a None admin] PATH_INFO: `/v3/users/6c5d9cfcb0cc4816adc28565245957c9` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:43.092267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085abe8-84d1-4a4b-9b40-5b94e358600a None admin] RBAC: Authorizing `identity:get_user(user_id=6c5d9cfcb0cc4816adc28565245957c9)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:43.093716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085abe8-84d1-4a4b-9b40-5b94e358600a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:43.095325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 560/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:49:42 2022] GET /identity/v3/users/6c5d9cfcb0cc4816adc28565245957c9 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:49:43.100779 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de447274-5057-4b9b-bf14-96419527e2a6 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:43.195148 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de447274-5057-4b9b-bf14-96419527e2a6 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:43.227277 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadcafd-e65e-45b8-831a-538b06725027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:43.227838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadcafd-e65e-45b8-831a-538b06725027 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:43.228114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadcafd-e65e-45b8-831a-538b06725027 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:43.228384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadcafd-e65e-45b8-831a-538b06725027 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:43.266844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:43.292490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadcafd-e65e-45b8-831a-538b06725027 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:43.293907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadcafd-e65e-45b8-831a-538b06725027 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:43.387700 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 568/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:49:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:49:43.393494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085abe8-84d1-4a4b-9b40-5b94e358600a None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:43.488676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085abe8-84d1-4a4b-9b40-5b94e358600a None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:43.520542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3746331-5348-4a81-80a1-5d0722d72514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:43.521370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3746331-5348-4a81-80a1-5d0722d72514 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:43.521648 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3746331-5348-4a81-80a1-5d0722d72514 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:43.521918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3746331-5348-4a81-80a1-5d0722d72514 None admin] PATH_INFO: `/v3/projects/9aee4385c03d48b2a7336914dc35c9a4` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:43.523101 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3746331-5348-4a81-80a1-5d0722d72514 None admin] RBAC: Authorizing `identity:get_project(project_id=9aee4385c03d48b2a7336914dc35c9a4)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:43.525041 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3746331-5348-4a81-80a1-5d0722d72514 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:43.526708 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 561/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:49:43 2022] GET /identity/v3/projects/9aee4385c03d48b2a7336914dc35c9a4 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:43.532663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadcafd-e65e-45b8-831a-538b06725027 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:43.599143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:43.627291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadcafd-e65e-45b8-831a-538b06725027 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:43.665300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0913f3-6ae6-47e7-b7f5-869c0afd403f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:43.665954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0913f3-6ae6-47e7-b7f5-869c0afd403f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:43.666244 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0913f3-6ae6-47e7-b7f5-869c0afd403f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:43.666519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0913f3-6ae6-47e7-b7f5-869c0afd403f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:43.667335 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0913f3-6ae6-47e7-b7f5-869c0afd403f None admin] RBAC: Adding query filter params (role.id=73d4eafa268f4cc3aca4863c73b794ae, scope.project.id=9aee4385c03d48b2a7336914dc35c9a4, user.id=6c5d9cfcb0cc4816adc28565245957c9) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:43.667646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0913f3-6ae6-47e7-b7f5-869c0afd403f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:43.669062 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0913f3-6ae6-47e7-b7f5-869c0afd403f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:43.676382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 569/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:49:43 2022] GET /identity/v3/role_assignments?user.id=6c5d9cfcb0cc4816adc28565245957c9&scope.project.id=9aee4385c03d48b2a7336914dc35c9a4&role.id=73d4eafa268f4cc3aca4863c73b794ae => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:45.913941 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a9711-d6eb-4d76-9c6d-5295d7b41b99 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:45.914464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a9711-d6eb-4d76-9c6d-5295d7b41b99 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:45.914557 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a9711-d6eb-4d76-9c6d-5295d7b41b99 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:45.915871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 562/1131] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:45.920974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b93be-f66c-4d10-87f6-ee27adb5875d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:45.921376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b93be-f66c-4d10-87f6-ee27adb5875d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:45.921526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b93be-f66c-4d10-87f6-ee27adb5875d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:45.938410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-903b93be-f66c-4d10-87f6-ee27adb5875d None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:45.939571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-903b93be-f66c-4d10-87f6-ee27adb5875d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:46.004086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 570/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:46.028259 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a9711-d6eb-4d76-9c6d-5295d7b41b99 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:46.031978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:46.126950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a9711-d6eb-4d76-9c6d-5295d7b41b99 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:46.158748 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b013309-e60d-4a6d-b874-eab80a00c38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:46.159511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b013309-e60d-4a6d-b874-eab80a00c38a None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:46.159788 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b013309-e60d-4a6d-b874-eab80a00c38a None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:46.160060 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b013309-e60d-4a6d-b874-eab80a00c38a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:46.161199 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b013309-e60d-4a6d-b874-eab80a00c38a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:46.162634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b013309-e60d-4a6d-b874-eab80a00c38a None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:46.164752 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 563/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:46.170342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b93be-f66c-4d10-87f6-ee27adb5875d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:46.232156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:46.266123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b93be-f66c-4d10-87f6-ee27adb5875d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:46.298358 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c5dff-a70e-4c95-ac9a-b202eb9c7af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:46.298995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c5dff-a70e-4c95-ac9a-b202eb9c7af3 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:46.299272 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c5dff-a70e-4c95-ac9a-b202eb9c7af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:46.299537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c5dff-a70e-4c95-ac9a-b202eb9c7af3 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:46.300234 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c5dff-a70e-4c95-ac9a-b202eb9c7af3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:46.301650 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c5dff-a70e-4c95-ac9a-b202eb9c7af3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:46.326045 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 571/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 7 21:49:46 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 21:49:48.546763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788bef3-d8e2-42bd-b219-4ad4226e2b20 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:48.547388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788bef3-d8e2-42bd-b219-4ad4226e2b20 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:48.547388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788bef3-d8e2-42bd-b219-4ad4226e2b20 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:48.548659 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 564/1135] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:48.553825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea657bd2-29e7-43fb-8279-b08da21a85f2 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:48.554260 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea657bd2-29e7-43fb-8279-b08da21a85f2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:48.554972 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea657bd2-29e7-43fb-8279-b08da21a85f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:48.572060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ea657bd2-29e7-43fb-8279-b08da21a85f2 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:48.573232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ea657bd2-29e7-43fb-8279-b08da21a85f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:48.637669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 572/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:48.662210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788bef3-d8e2-42bd-b219-4ad4226e2b20 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:48.730274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:48.760266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788bef3-d8e2-42bd-b219-4ad4226e2b20 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:48.792089 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efe7fd-2af2-4747-b290-21469f6e83b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:48.792857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efe7fd-2af2-4747-b290-21469f6e83b8 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:48.793139 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efe7fd-2af2-4747-b290-21469f6e83b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:48.793412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efe7fd-2af2-4747-b290-21469f6e83b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:48.794552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efe7fd-2af2-4747-b290-21469f6e83b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:48.795981 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efe7fd-2af2-4747-b290-21469f6e83b8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:48.797574 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 565/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:49:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:48.803021 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea657bd2-29e7-43fb-8279-b08da21a85f2 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:48.850101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:48.900321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea657bd2-29e7-43fb-8279-b08da21a85f2 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:48.932647 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7b5ff-5824-4234-b9c4-dcd33f90c90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:48.933299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7b5ff-5824-4234-b9c4-dcd33f90c90d None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:48.933581 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7b5ff-5824-4234-b9c4-dcd33f90c90d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:48.933857 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7b5ff-5824-4234-b9c4-dcd33f90c90d None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:48.934591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7b5ff-5824-4234-b9c4-dcd33f90c90d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:48.936033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7b5ff-5824-4234-b9c4-dcd33f90c90d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:48.959846 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 573/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:49:48 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:49:51.209946 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66808b9c-6237-4939-a2ff-02c4d158a4d0 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:51.211066 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66808b9c-6237-4939-a2ff-02c4d158a4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:51.211066 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66808b9c-6237-4939-a2ff-02c4d158a4d0 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:51.212418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 566/1139] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:51.217769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91880bba-0b45-48a3-8ce9-c8c7f353ef56 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:51.218204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91880bba-0b45-48a3-8ce9-c8c7f353ef56 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:51.218370 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91880bba-0b45-48a3-8ce9-c8c7f353ef56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:51.235540 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-91880bba-0b45-48a3-8ce9-c8c7f353ef56 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:51.236711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-91880bba-0b45-48a3-8ce9-c8c7f353ef56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:51.301211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 574/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:51.324852 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66808b9c-6237-4939-a2ff-02c4d158a4d0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:51.421870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66808b9c-6237-4939-a2ff-02c4d158a4d0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:51.456078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731323b-2656-41d7-8c17-79c2feb26730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:51.456972 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731323b-2656-41d7-8c17-79c2feb26730 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:51.457317 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731323b-2656-41d7-8c17-79c2feb26730 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:51.457653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731323b-2656-41d7-8c17-79c2feb26730 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:51.466204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:51.469444 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731323b-2656-41d7-8c17-79c2feb26730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:49:51.477352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-6731323b-2656-41d7-8c17-79c2feb26730 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:49:51.477352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:51.477352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:51.477352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:51.477352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:51.477352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:51.477352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:51.477352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:51.477352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:51.477352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:51.477352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:51.477352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:51.477352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:49:51.477352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:49:51.477352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:49:51.477352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:49:51.478376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:49:51.478376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:49:51.478376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:49:51.478376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:49:51.478376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:51.478376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:51.478376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:51.478376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:51.478376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:51.478376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:51.478376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:51.478376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:51.478376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:51.478376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:51.478376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:51.478376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:51.479365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:51.479365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:51.479365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:51.479365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:51.479365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:49:51.479365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:49:51.479365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:49:51.479365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:49:51.479365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:49:51.479365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:49:51.479365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:49:51.479365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:51.479365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 567/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:49:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:51.484674 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91880bba-0b45-48a3-8ce9-c8c7f353ef56 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:51.518073 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:51.584910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91880bba-0b45-48a3-8ce9-c8c7f353ef56 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:51.619786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190089a0-41d0-4ae4-b60b-abf0b724bf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:51.620461 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190089a0-41d0-4ae4-b60b-abf0b724bf9b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:51.620747 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190089a0-41d0-4ae4-b60b-abf0b724bf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:51.621026 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190089a0-41d0-4ae4-b60b-abf0b724bf9b None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:51.621773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190089a0-41d0-4ae4-b60b-abf0b724bf9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:51.622113 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190089a0-41d0-4ae4-b60b-abf0b724bf9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:51.623498 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190089a0-41d0-4ae4-b60b-abf0b724bf9b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:51.631692 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 575/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:49:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:51.637467 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731323b-2656-41d7-8c17-79c2feb26730 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:51.735144 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731323b-2656-41d7-8c17-79c2feb26730 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:51.767581 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ff4fd-368b-43e3-b7ef-dfed516d033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:51.768430 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ff4fd-368b-43e3-b7ef-dfed516d033d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:51.768711 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ff4fd-368b-43e3-b7ef-dfed516d033d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:51.768983 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ff4fd-368b-43e3-b7ef-dfed516d033d None admin] PATH_INFO: `/v3/users/b25b7902ecac49f4b0bef1221a7d85f1` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:51.781867 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ff4fd-368b-43e3-b7ef-dfed516d033d None admin] RBAC: Authorizing `identity:get_user(user_id=b25b7902ecac49f4b0bef1221a7d85f1)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:51.783334 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ff4fd-368b-43e3-b7ef-dfed516d033d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:51.784958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 568/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:49:51 2022] GET /identity/v3/users/b25b7902ecac49f4b0bef1221a7d85f1 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:51.790813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190089a0-41d0-4ae4-b60b-abf0b724bf9b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:51.882107 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:51.888602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190089a0-41d0-4ae4-b60b-abf0b724bf9b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:51.921451 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdb769-074c-4cd8-ae12-dc329468c78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:51.922116 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb769-074c-4cd8-ae12-dc329468c78d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:51.922404 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb769-074c-4cd8-ae12-dc329468c78d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:51.922681 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb769-074c-4cd8-ae12-dc329468c78d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:51.987519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdb769-074c-4cd8-ae12-dc329468c78d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:51.988902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdb769-074c-4cd8-ae12-dc329468c78d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:52.077437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:52.084225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 576/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:49:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:49:52.090085 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ff4fd-368b-43e3-b7ef-dfed516d033d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:52.146603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:52.187262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ff4fd-368b-43e3-b7ef-dfed516d033d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:52.218922 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6c340-f2d5-4ab5-9a44-ead2397a797f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:52.219753 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6c340-f2d5-4ab5-9a44-ead2397a797f None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:52.220025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6c340-f2d5-4ab5-9a44-ead2397a797f None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:52.220293 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6c340-f2d5-4ab5-9a44-ead2397a797f None admin] PATH_INFO: `/v3/projects/fc7fad25c62449a5addff549d018ad04` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:52.221436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6c340-f2d5-4ab5-9a44-ead2397a797f None admin] RBAC: Authorizing `identity:get_project(project_id=fc7fad25c62449a5addff549d018ad04)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:52.222867 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6c340-f2d5-4ab5-9a44-ead2397a797f None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:52.224510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 569/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:49:52 2022] GET /identity/v3/projects/fc7fad25c62449a5addff549d018ad04 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:52.231150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdb769-074c-4cd8-ae12-dc329468c78d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:52.324294 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdb769-074c-4cd8-ae12-dc329468c78d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:52.356465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902c1f6-504d-4f5f-b591-b505a4f2b78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:52.357098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902c1f6-504d-4f5f-b591-b505a4f2b78d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:52.357375 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902c1f6-504d-4f5f-b591-b505a4f2b78d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:52.357644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902c1f6-504d-4f5f-b591-b505a4f2b78d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:52.358559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902c1f6-504d-4f5f-b591-b505a4f2b78d None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=fc7fad25c62449a5addff549d018ad04, user.id=b25b7902ecac49f4b0bef1221a7d85f1) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:52.358861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902c1f6-504d-4f5f-b591-b505a4f2b78d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:52.360285 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902c1f6-504d-4f5f-b591-b505a4f2b78d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:52.365559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 577/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:49:52 2022] GET /identity/v3/role_assignments?user.id=b25b7902ecac49f4b0bef1221a7d85f1&scope.project.id=fc7fad25c62449a5addff549d018ad04&role.id=8f58ef9d28494d97a68de20b84355450 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:54.550407 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174453e-d097-4df8-b6fe-d5084d04657c None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:54.550921 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174453e-d097-4df8-b6fe-d5084d04657c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:54.551009 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174453e-d097-4df8-b6fe-d5084d04657c None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:54.552333 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 570/1147] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:54.557606 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cae21-ee8c-41d1-9003-0a5e164368e8 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:54.558035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cae21-ee8c-41d1-9003-0a5e164368e8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:54.558187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cae21-ee8c-41d1-9003-0a5e164368e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:54.574777 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-223cae21-ee8c-41d1-9003-0a5e164368e8 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:54.575943 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-223cae21-ee8c-41d1-9003-0a5e164368e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:54.629306 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:54.640368 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 578/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:54.662739 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174453e-d097-4df8-b6fe-d5084d04657c None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:54.759946 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174453e-d097-4df8-b6fe-d5084d04657c None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:54.784496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:54.793103 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973b631-e314-4330-b751-dbedaf996f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:54.793873 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973b631-e314-4330-b751-dbedaf996f92 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:54.794183 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973b631-e314-4330-b751-dbedaf996f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:54.794453 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973b631-e314-4330-b751-dbedaf996f92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:54.804614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973b631-e314-4330-b751-dbedaf996f92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:49:54.812124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-b973b631-e314-4330-b751-dbedaf996f92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:49:54.812124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:54.812124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:54.812124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:54.812124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:54.812124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:54.812124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:54.812124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:54.812124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:54.812124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:54.812124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:54.812124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:54.812124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:49:54.812124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:49:54.812124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:49:54.812124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:49:54.813213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:49:54.813213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:49:54.813213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:49:54.813213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:49:54.813213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:54.813213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:54.813213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:54.813213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:54.813213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:54.813213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:54.813213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:54.813213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:54.813213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:54.813213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:54.813213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:54.813213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:54.814296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:54.814296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:54.814296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:54.814296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:54.814296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:49:54.814296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:49:54.814296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:49:54.814296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:49:54.814296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:49:54.814296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:49:54.814296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:49:54.814296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:49:54.814296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 571/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:49:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:54.819069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cae21-ee8c-41d1-9003-0a5e164368e8 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:54.913040 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cae21-ee8c-41d1-9003-0a5e164368e8 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:54.945479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b3507-e82f-4ef7-bd22-f0b6b93c4c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:54.946147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b3507-e82f-4ef7-bd22-f0b6b93c4c06 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:54.946429 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b3507-e82f-4ef7-bd22-f0b6b93c4c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:54.946703 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b3507-e82f-4ef7-bd22-f0b6b93c4c06 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:54.947433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b3507-e82f-4ef7-bd22-f0b6b93c4c06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:54.947738 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b3507-e82f-4ef7-bd22-f0b6b93c4c06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:54.949099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b3507-e82f-4ef7-bd22-f0b6b93c4c06 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:54.956816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 579/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:49:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:54.962838 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973b631-e314-4330-b751-dbedaf996f92 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:55.058459 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973b631-e314-4330-b751-dbedaf996f92 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:55.090285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d748db-5c03-4712-afda-4cd89c30ef99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:55.091125 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d748db-5c03-4712-afda-4cd89c30ef99 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:55.091406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d748db-5c03-4712-afda-4cd89c30ef99 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:55.091679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d748db-5c03-4712-afda-4cd89c30ef99 None admin] PATH_INFO: `/v3/users/b25b7902ecac49f4b0bef1221a7d85f1` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:55.092839 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d748db-5c03-4712-afda-4cd89c30ef99 None admin] RBAC: Authorizing `identity:get_user(user_id=b25b7902ecac49f4b0bef1221a7d85f1)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:55.094323 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d748db-5c03-4712-afda-4cd89c30ef99 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:55.095904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 572/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:49:54 2022] GET /identity/v3/users/b25b7902ecac49f4b0bef1221a7d85f1 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:55.101818 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b3507-e82f-4ef7-bd22-f0b6b93c4c06 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:55.152566 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:55.197418 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b3507-e82f-4ef7-bd22-f0b6b93c4c06 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:55.229224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862daaf-89cb-477d-840f-0058c02ed466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:55.230081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862daaf-89cb-477d-840f-0058c02ed466 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:55.230360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862daaf-89cb-477d-840f-0058c02ed466 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:55.230625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862daaf-89cb-477d-840f-0058c02ed466 None admin] PATH_INFO: `/v3/projects/fc7fad25c62449a5addff549d018ad04` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:55.231770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862daaf-89cb-477d-840f-0058c02ed466 None admin] RBAC: Authorizing `identity:get_project(project_id=fc7fad25c62449a5addff549d018ad04)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:55.233180 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862daaf-89cb-477d-840f-0058c02ed466 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:55.234845 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 580/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:49:55 2022] GET /identity/v3/projects/fc7fad25c62449a5addff549d018ad04 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:55.240554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d748db-5c03-4712-afda-4cd89c30ef99 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:55.294048 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:55.337813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d748db-5c03-4712-afda-4cd89c30ef99 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:55.372343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00441389-eb3c-46ab-b264-56faaecf20f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:55.373209 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00441389-eb3c-46ab-b264-56faaecf20f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:55.373485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00441389-eb3c-46ab-b264-56faaecf20f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:55.373754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00441389-eb3c-46ab-b264-56faaecf20f0 None admin] PATH_INFO: `/v3/projects/fc7fad25c62449a5addff549d018ad04/users/b25b7902ecac49f4b0bef1221a7d85f1/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:55.375703 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00441389-eb3c-46ab-b264-56faaecf20f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc7fad25c62449a5addff549d018ad04, user_id=b25b7902ecac49f4b0bef1221a7d85f1, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:55.377113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00441389-eb3c-46ab-b264-56faaecf20f0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:55.390074 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 573/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:49:55 2022] PUT /identity/v3/projects/fc7fad25c62449a5addff549d018ad04/users/b25b7902ecac49f4b0bef1221a7d85f1/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:49:57.588916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c38c1-a881-4094-8729-0bfcb77dfd65 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:57.589478 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c38c1-a881-4094-8729-0bfcb77dfd65 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:57.589478 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c38c1-a881-4094-8729-0bfcb77dfd65 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:57.590849 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 581/1154] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:49:57.596077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efe9bf-86ef-4d85-87c0-43099564a51f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:57.596493 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efe9bf-86ef-4d85-87c0-43099564a51f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:57.596635 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efe9bf-86ef-4d85-87c0-43099564a51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:57.613634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f8efe9bf-86ef-4d85-87c0-43099564a51f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:49:57.614894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f8efe9bf-86ef-4d85-87c0-43099564a51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:49:57.679466 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 574/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:49:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:49:57.702716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c38c1-a881-4094-8729-0bfcb77dfd65 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:57.799387 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c38c1-a881-4094-8729-0bfcb77dfd65 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:57.818115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:57.831959 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8150188-1f9b-4bd5-8fc3-da14604ed4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:57.832728 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8150188-1f9b-4bd5-8fc3-da14604ed4fa None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:57.833005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8150188-1f9b-4bd5-8fc3-da14604ed4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:57.833273 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8150188-1f9b-4bd5-8fc3-da14604ed4fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:57.843785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8150188-1f9b-4bd5-8fc3-da14604ed4fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:49:57.851638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-b8150188-1f9b-4bd5-8fc3-da14604ed4fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:49:57.851638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:49:57.851638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:49:57.851638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:49:57.851638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:49:57.851638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:49:57.851638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:49:57.851638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:49:57.851638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:49:57.851638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:49:57.851638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:49:57.851638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:49:57.851638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:49:57.851638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:49:57.851638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:49:57.851638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:49:57.852726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:49:57.852726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:49:57.852726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:49:57.852726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:49:57.852726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:49:57.852726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:49:57.852726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:49:57.852726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:49:57.852726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:49:57.852726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:49:57.852726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:49:57.852726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:49:57.852726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:49:57.852726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:49:57.852726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:49:57.852726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:49:57.853886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:49:57.853886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:49:57.853886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:49:57.853886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:49:57.853886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:49:57.853886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:49:57.853886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:49:57.853886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:49:57.853886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:49:57.853886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:49:57.853886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:49:57.853886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:49:57.853886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 582/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:49:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:49:57.858719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efe9bf-86ef-4d85-87c0-43099564a51f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:57.902191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:57.953718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efe9bf-86ef-4d85-87c0-43099564a51f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:57.985389 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee939f-b03e-4d2a-8411-3871badedfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:57.986068 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee939f-b03e-4d2a-8411-3871badedfb0 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:57.986349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee939f-b03e-4d2a-8411-3871badedfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:57.986623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee939f-b03e-4d2a-8411-3871badedfb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:57.987351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee939f-b03e-4d2a-8411-3871badedfb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:57.987651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee939f-b03e-4d2a-8411-3871badedfb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:57.988990 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee939f-b03e-4d2a-8411-3871badedfb0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:57.997155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 575/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:49:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:58.002853 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8150188-1f9b-4bd5-8fc3-da14604ed4fa None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:58.099390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8150188-1f9b-4bd5-8fc3-da14604ed4fa None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:58.131515 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac3c57-ddf5-4cf4-beeb-7e3ed820511e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:58.132884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac3c57-ddf5-4cf4-beeb-7e3ed820511e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:58.133158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac3c57-ddf5-4cf4-beeb-7e3ed820511e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:58.133423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac3c57-ddf5-4cf4-beeb-7e3ed820511e None admin] PATH_INFO: `/v3/users/b25b7902ecac49f4b0bef1221a7d85f1` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:58.134609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac3c57-ddf5-4cf4-beeb-7e3ed820511e None admin] RBAC: Authorizing `identity:get_user(user_id=b25b7902ecac49f4b0bef1221a7d85f1)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:58.136032 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac3c57-ddf5-4cf4-beeb-7e3ed820511e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:58.137613 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 583/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:49:58 2022] GET /identity/v3/users/b25b7902ecac49f4b0bef1221a7d85f1 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:58.143262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee939f-b03e-4d2a-8411-3871badedfb0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:58.238046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee939f-b03e-4d2a-8411-3871badedfb0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:58.244826 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:58.270788 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea5b46-a94c-494c-ae59-4f0a0bdf19a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:58.271412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea5b46-a94c-494c-ae59-4f0a0bdf19a0 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:58.271689 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea5b46-a94c-494c-ae59-4f0a0bdf19a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:58.271958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea5b46-a94c-494c-ae59-4f0a0bdf19a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:58.334984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea5b46-a94c-494c-ae59-4f0a0bdf19a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:58.336953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea5b46-a94c-494c-ae59-4f0a0bdf19a0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:58.429744 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 576/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:49:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:49:58.435751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac3c57-ddf5-4cf4-beeb-7e3ed820511e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:58.483156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:58.533072 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac3c57-ddf5-4cf4-beeb-7e3ed820511e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:58.565744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecf44d-370c-4ef8-a9d8-d229805956ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:58.566609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf44d-370c-4ef8-a9d8-d229805956ff None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:58.566888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf44d-370c-4ef8-a9d8-d229805956ff None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:58.567158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf44d-370c-4ef8-a9d8-d229805956ff None admin] PATH_INFO: `/v3/projects/fc7fad25c62449a5addff549d018ad04` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:58.568304 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecf44d-370c-4ef8-a9d8-d229805956ff None admin] RBAC: Authorizing `identity:get_project(project_id=fc7fad25c62449a5addff549d018ad04)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:58.570296 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecf44d-370c-4ef8-a9d8-d229805956ff None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:58.571969 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 584/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:49:58 2022] GET /identity/v3/projects/fc7fad25c62449a5addff549d018ad04 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:49:58.578028 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea5b46-a94c-494c-ae59-4f0a0bdf19a0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:49:58.586010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:49:58.671434 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea5b46-a94c-494c-ae59-4f0a0bdf19a0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:49:58.704833 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e7ae8-0223-4a79-ac1f-21fe648b2c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:49:58.705461 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e7ae8-0223-4a79-ac1f-21fe648b2c27 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:49:58.705740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e7ae8-0223-4a79-ac1f-21fe648b2c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:49:58.706038 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e7ae8-0223-4a79-ac1f-21fe648b2c27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:49:58.706849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e7ae8-0223-4a79-ac1f-21fe648b2c27 None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=fc7fad25c62449a5addff549d018ad04, user.id=b25b7902ecac49f4b0bef1221a7d85f1) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:49:58.707159 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e7ae8-0223-4a79-ac1f-21fe648b2c27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:49:58.708570 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e7ae8-0223-4a79-ac1f-21fe648b2c27 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:49:58.714685 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 577/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:49:58 2022] GET /identity/v3/role_assignments?user.id=b25b7902ecac49f4b0bef1221a7d85f1&scope.project.id=fc7fad25c62449a5addff549d018ad04&role.id=8f58ef9d28494d97a68de20b84355450 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:50:00.943098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f40a2-acbc-4709-9636-17575ba9297f None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:00.943624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f40a2-acbc-4709-9636-17575ba9297f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:00.943624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f40a2-acbc-4709-9636-17575ba9297f None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:00.945589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 585/1162] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:50:00.950855 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba6d33-0f50-4312-91f2-360f11b182f1 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:00.951273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba6d33-0f50-4312-91f2-360f11b182f1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:00.951404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba6d33-0f50-4312-91f2-360f11b182f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:00.969086 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-67ba6d33-0f50-4312-91f2-360f11b182f1 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:50:00.970286 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-67ba6d33-0f50-4312-91f2-360f11b182f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:50:01.030181 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:01.035187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 578/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:50:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:50:01.059035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f40a2-acbc-4709-9636-17575ba9297f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:01.156645 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f40a2-acbc-4709-9636-17575ba9297f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:01.172548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:01.190295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5d3fa-20b6-4463-9d43-b7887ed3a624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:01.190922 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5d3fa-20b6-4463-9d43-b7887ed3a624 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:01.191200 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5d3fa-20b6-4463-9d43-b7887ed3a624 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:01.191472 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5d3fa-20b6-4463-9d43-b7887ed3a624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:01.255572 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5d3fa-20b6-4463-9d43-b7887ed3a624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:01.256945 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5d3fa-20b6-4463-9d43-b7887ed3a624 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:01.351838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 586/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:50:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:50:01.357738 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba6d33-0f50-4312-91f2-360f11b182f1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:01.450886 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba6d33-0f50-4312-91f2-360f11b182f1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:01.482978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218b0c0-002f-40a4-a4c0-ed6c491e8d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:01.483753 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218b0c0-002f-40a4-a4c0-ed6c491e8d2d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:01.484027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218b0c0-002f-40a4-a4c0-ed6c491e8d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:01.484294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218b0c0-002f-40a4-a4c0-ed6c491e8d2d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:01.490982 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218b0c0-002f-40a4-a4c0-ed6c491e8d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:01.492938 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218b0c0-002f-40a4-a4c0-ed6c491e8d2d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:01.506706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-a218b0c0-002f-40a4-a4c0-ed6c491e8d2d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 07 21:50:01.506706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:50:01.506706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 07 21:50:01.506706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 07 21:50:01.506706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:50:01.506706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:50:01.506706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:50:01.506706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:50:01.506706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 07 21:50:01.506706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:50:01.506706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:50:01.506706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:50:01.506706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:50:01.506706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:50:01.506706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:50:01.506706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:50:01.506706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:50:01.508404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:50:01.508404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:50:01.508404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:50:01.508404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:50:01.508404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:50:01.508404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:50:01.508404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:50:01.508404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:50:01.508404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:50:01.508404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:50:01.508404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:50:01.508404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:50:01.508404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:50:01.508404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:50:01.508404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:50:01.508404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:50:01.509534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:50:01.509534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:50:01.509534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:50:01.509534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:50:01.509534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:50:01.509534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:50:01.509534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:50:01.509534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:50:01.509534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:50:01.509534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:50:01.509534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 07 21:50:01.509534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:50:01.509534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 07 21:50:01.509534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:50:01.509534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 579/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 7 21:50:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:50:01.514241 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5d3fa-20b6-4463-9d43-b7887ed3a624 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:01.530971 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:01.609175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5d3fa-20b6-4463-9d43-b7887ed3a624 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:01.641944 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9fe9e-8e55-4458-ae83-40685d59e003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:01.642606 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9fe9e-8e55-4458-ae83-40685d59e003 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:01.642892 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9fe9e-8e55-4458-ae83-40685d59e003 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:01.643166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9fe9e-8e55-4458-ae83-40685d59e003 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:01.643869 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9fe9e-8e55-4458-ae83-40685d59e003 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:50:01.644171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9fe9e-8e55-4458-ae83-40685d59e003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:01.645526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9fe9e-8e55-4458-ae83-40685d59e003 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:01.652604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 587/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jun 7 21:50:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:50:03.839841 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289f3d0-60b4-40a6-aebf-453f06ccba10 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:03.840414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289f3d0-60b4-40a6-aebf-453f06ccba10 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:03.840414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289f3d0-60b4-40a6-aebf-453f06ccba10 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:03.841763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 580/1167] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:50:03.847014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40468-396e-49f2-a1ac-477eba5a74f1 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:03.847402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40468-396e-49f2-a1ac-477eba5a74f1 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:03.847575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40468-396e-49f2-a1ac-477eba5a74f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:03.864215 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-9bf40468-396e-49f2-a1ac-477eba5a74f1 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:50:03.865389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9bf40468-396e-49f2-a1ac-477eba5a74f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:50:03.930546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 588/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:50:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:50:03.953027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289f3d0-60b4-40a6-aebf-453f06ccba10 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:04.011849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:04.051965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289f3d0-60b4-40a6-aebf-453f06ccba10 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:04.084049 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c4894-dbaf-4846-b074-ebdbd4b03ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:04.084686 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c4894-dbaf-4846-b074-ebdbd4b03ea1 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:04.084967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c4894-dbaf-4846-b074-ebdbd4b03ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:04.085770 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c4894-dbaf-4846-b074-ebdbd4b03ea1 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:04.086535 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c4894-dbaf-4846-b074-ebdbd4b03ea1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:04.087890 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c4894-dbaf-4846-b074-ebdbd4b03ea1 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:04.103421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 581/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Tue Jun 7 21:50:03 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:50:06.340803 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902d370-0c84-4425-b3eb-e44f637cf5a2 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:06.341371 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902d370-0c84-4425-b3eb-e44f637cf5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:06.341371 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902d370-0c84-4425-b3eb-e44f637cf5a2 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:06.342740 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 589/1170] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:50:06.347968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a6511-b7f7-4568-bdb1-3a64a7981c35 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:06.348387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a6511-b7f7-4568-bdb1-3a64a7981c35 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:06.348534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a6511-b7f7-4568-bdb1-3a64a7981c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:06.365746 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d82a6511-b7f7-4568-bdb1-3a64a7981c35 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:50:06.367594 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d82a6511-b7f7-4568-bdb1-3a64a7981c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:50:06.431553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 582/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:50:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:50:06.454248 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902d370-0c84-4425-b3eb-e44f637cf5a2 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:06.466209 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:06.554624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902d370-0c84-4425-b3eb-e44f637cf5a2 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:06.589942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9181f-2a24-48bd-9026-f06897a32146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:06.590797 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9181f-2a24-48bd-9026-f06897a32146 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:06.591157 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9181f-2a24-48bd-9026-f06897a32146 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:06.591378 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9181f-2a24-48bd-9026-f06897a32146 None admin] PATH_INFO: `/v3/domains/b14b851608e541f998586c23c1599124` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:06.601796 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9181f-2a24-48bd-9026-f06897a32146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b14b851608e541f998586c23c1599124)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:06.603311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9181f-2a24-48bd-9026-f06897a32146 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:06.604930 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 590/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Tue Jun 7 21:50:06 2022] GET /identity/v3/domains/b14b851608e541f998586c23c1599124 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:50:06.610821 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a6511-b7f7-4568-bdb1-3a64a7981c35 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:06.658442 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:06.707809 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a6511-b7f7-4568-bdb1-3a64a7981c35 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:06.739595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e58c84-9941-4f1b-8a04-15dda32125f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:06.740232 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e58c84-9941-4f1b-8a04-15dda32125f5 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:06.740510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e58c84-9941-4f1b-8a04-15dda32125f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:06.740782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e58c84-9941-4f1b-8a04-15dda32125f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:06.742024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e58c84-9941-4f1b-8a04-15dda32125f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:06.743485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e58c84-9941-4f1b-8a04-15dda32125f5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:06.767380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 583/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 7 21:50:06 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 21:50:08.994412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddb7ab-60ff-4102-a93c-c54dec05946f None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:08.994958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddb7ab-60ff-4102-a93c-c54dec05946f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:08.994958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddb7ab-60ff-4102-a93c-c54dec05946f None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:08.996319 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 591/1174] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:50:09.001435 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e44b88-70e6-48dd-9648-90c3c1dd98d1 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:09.001822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e44b88-70e6-48dd-9648-90c3c1dd98d1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:09.002024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e44b88-70e6-48dd-9648-90c3c1dd98d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:09.018727 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a8e44b88-70e6-48dd-9648-90c3c1dd98d1 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:50:09.019882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a8e44b88-70e6-48dd-9648-90c3c1dd98d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:50:09.083191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 584/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:50:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:50:09.108760 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddb7ab-60ff-4102-a93c-c54dec05946f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:09.176885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:09.209219 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddb7ab-60ff-4102-a93c-c54dec05946f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:09.242105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a89f2b-4fc7-4f41-a904-ab3d099e359e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:09.242954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a89f2b-4fc7-4f41-a904-ab3d099e359e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:09.243236 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a89f2b-4fc7-4f41-a904-ab3d099e359e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:09.243508 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a89f2b-4fc7-4f41-a904-ab3d099e359e None admin] PATH_INFO: `/v3/domains/b14b851608e541f998586c23c1599124` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:09.244719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a89f2b-4fc7-4f41-a904-ab3d099e359e None admin] RBAC: Authorizing `identity:get_domain(domain_id=b14b851608e541f998586c23c1599124)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:09.246124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a89f2b-4fc7-4f41-a904-ab3d099e359e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:09.247701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 592/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Tue Jun 7 21:50:09 2022] GET /identity/v3/domains/b14b851608e541f998586c23c1599124 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:50:09.253248 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e44b88-70e6-48dd-9648-90c3c1dd98d1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:09.283203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:09.351717 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e44b88-70e6-48dd-9648-90c3c1dd98d1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:09.385041 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d99e3-ad17-43f7-9d0f-665737d268e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:09.385703 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d99e3-ad17-43f7-9d0f-665737d268e2 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:09.386037 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d99e3-ad17-43f7-9d0f-665737d268e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:09.386311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d99e3-ad17-43f7-9d0f-665737d268e2 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:09.387010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d99e3-ad17-43f7-9d0f-665737d268e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:09.388436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d99e3-ad17-43f7-9d0f-665737d268e2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:09.407607 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 585/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:50:09 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:50:11.638896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c5064-1698-4a35-bf0d-b9160dd7f490 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:11.639394 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c5064-1698-4a35-bf0d-b9160dd7f490 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:11.639394 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c5064-1698-4a35-bf0d-b9160dd7f490 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:11.640704 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 593/1178] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:50:11.645914 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c69e7-98f0-4f5c-8032-d9abfa4a5fdf None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:11.646359 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c69e7-98f0-4f5c-8032-d9abfa4a5fdf None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:11.646492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c69e7-98f0-4f5c-8032-d9abfa4a5fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:11.663323 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3f5c69e7-98f0-4f5c-8032-d9abfa4a5fdf None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:50:11.664496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3f5c69e7-98f0-4f5c-8032-d9abfa4a5fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:50:11.727866 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 586/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:50:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:50:11.750891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c5064-1698-4a35-bf0d-b9160dd7f490 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:11.848838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c5064-1698-4a35-bf0d-b9160dd7f490 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:11.880651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6944a6-372f-4e8a-a223-5f52883fe34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:11.881415 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6944a6-372f-4e8a-a223-5f52883fe34c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:11.881692 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6944a6-372f-4e8a-a223-5f52883fe34c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:11.882020 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6944a6-372f-4e8a-a223-5f52883fe34c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:11.888495 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:11.892966 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6944a6-372f-4e8a-a223-5f52883fe34c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:50:11.901325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-ff6944a6-372f-4e8a-a223-5f52883fe34c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:50:11.901325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:50:11.901325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:50:11.901325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:50:11.901325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:50:11.901325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:50:11.901325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:50:11.901325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:50:11.901325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:50:11.901325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:50:11.901325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:50:11.901325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:50:11.901325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:50:11.901325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:50:11.901325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:50:11.901325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:50:11.902512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:50:11.902512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:50:11.902512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:50:11.902512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:50:11.902512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:50:11.902512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:50:11.902512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:50:11.902512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:50:11.902512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:50:11.902512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:50:11.902512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:50:11.902512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:50:11.902512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:50:11.902512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:50:11.902512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:50:11.902512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:50:11.903609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:50:11.903609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:50:11.903609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:50:11.903609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:50:11.903609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:50:11.903609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:50:11.903609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:50:11.903609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:50:11.903609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:50:11.903609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:50:11.903609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:50:11.903609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:50:11.903609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 594/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:50:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:50:11.908241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c69e7-98f0-4f5c-8032-d9abfa4a5fdf None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:11.925877 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:12.005519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c69e7-98f0-4f5c-8032-d9abfa4a5fdf None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:12.038263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a381a-a8f8-48b8-b724-7e7407152797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:12.038912 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a381a-a8f8-48b8-b724-7e7407152797 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:12.039192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a381a-a8f8-48b8-b724-7e7407152797 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:12.039467 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a381a-a8f8-48b8-b724-7e7407152797 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:12.040201 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a381a-a8f8-48b8-b724-7e7407152797 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:50:12.040502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a381a-a8f8-48b8-b724-7e7407152797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:12.041856 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a381a-a8f8-48b8-b724-7e7407152797 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:12.049682 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 587/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:50:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:50:12.056274 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6944a6-372f-4e8a-a223-5f52883fe34c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:12.153417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6944a6-372f-4e8a-a223-5f52883fe34c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:12.185716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879e949-86e7-4f37-bbcc-35c1d664a395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:12.186598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879e949-86e7-4f37-bbcc-35c1d664a395 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:12.186879 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879e949-86e7-4f37-bbcc-35c1d664a395 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:12.187156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879e949-86e7-4f37-bbcc-35c1d664a395 None admin] PATH_INFO: `/v3/users/fc255732f14042009ce4dbaedaafcc2b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:12.200213 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879e949-86e7-4f37-bbcc-35c1d664a395 None admin] RBAC: Authorizing `identity:get_user(user_id=fc255732f14042009ce4dbaedaafcc2b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:12.201648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879e949-86e7-4f37-bbcc-35c1d664a395 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:12.203296 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 595/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:50:12 2022] GET /identity/v3/users/fc255732f14042009ce4dbaedaafcc2b => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:50:12.208982 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a381a-a8f8-48b8-b724-7e7407152797 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:12.285066 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:12.303695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a381a-a8f8-48b8-b724-7e7407152797 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:12.335318 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc095e7-02e7-4167-87b4-b8402a181832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:12.335942 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc095e7-02e7-4167-87b4-b8402a181832 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:12.336218 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc095e7-02e7-4167-87b4-b8402a181832 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:12.336485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc095e7-02e7-4167-87b4-b8402a181832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:12.401577 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc095e7-02e7-4167-87b4-b8402a181832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:12.403034 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc095e7-02e7-4167-87b4-b8402a181832 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:12.476795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:12.495657 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 588/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:50:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:50:12.501513 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879e949-86e7-4f37-bbcc-35c1d664a395 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:12.555717 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:12.598599 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879e949-86e7-4f37-bbcc-35c1d664a395 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:12.633445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e77cc-51e1-41c5-9d47-7a2577264a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:12.634333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e77cc-51e1-41c5-9d47-7a2577264a90 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:12.634616 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e77cc-51e1-41c5-9d47-7a2577264a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:12.634889 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e77cc-51e1-41c5-9d47-7a2577264a90 None admin] PATH_INFO: `/v3/projects/67990c13103d479eae10847b264bd113` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:12.636053 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e77cc-51e1-41c5-9d47-7a2577264a90 None admin] RBAC: Authorizing `identity:get_project(project_id=67990c13103d479eae10847b264bd113)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:12.637486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e77cc-51e1-41c5-9d47-7a2577264a90 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:12.639177 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 596/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:50:12 2022] GET /identity/v3/projects/67990c13103d479eae10847b264bd113 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:50:12.645379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc095e7-02e7-4167-87b4-b8402a181832 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:12.739997 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc095e7-02e7-4167-87b4-b8402a181832 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:12.772927 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5c337-8f30-4191-bf61-83bc45a87446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:12.773555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5c337-8f30-4191-bf61-83bc45a87446 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:12.773834 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5c337-8f30-4191-bf61-83bc45a87446 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:12.774138 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5c337-8f30-4191-bf61-83bc45a87446 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:12.774945 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5c337-8f30-4191-bf61-83bc45a87446 None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=67990c13103d479eae10847b264bd113, user.id=fc255732f14042009ce4dbaedaafcc2b) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:50:12.775250 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5c337-8f30-4191-bf61-83bc45a87446 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:12.776642 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5c337-8f30-4191-bf61-83bc45a87446 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:12.781841 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 589/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:50:12 2022] GET /identity/v3/role_assignments?user.id=fc255732f14042009ce4dbaedaafcc2b&scope.project.id=67990c13103d479eae10847b264bd113&role.id=8f58ef9d28494d97a68de20b84355450 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:50:14.966822 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d46f4-24dd-4386-b5b7-670633f9a283 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:14.967375 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d46f4-24dd-4386-b5b7-670633f9a283 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:14.967375 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d46f4-24dd-4386-b5b7-670633f9a283 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:14.968716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 597/1186] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:50:14.973948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ab03-def2-488f-b3c3-04edb3408af2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:14.974364 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ab03-def2-488f-b3c3-04edb3408af2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:14.974529 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ab03-def2-488f-b3c3-04edb3408af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:14.991813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-cdd7ab03-def2-488f-b3c3-04edb3408af2 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:50:14.992993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-cdd7ab03-def2-488f-b3c3-04edb3408af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:50:15.031424 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:15.057771 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 590/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:50:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:50:15.080290 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d46f4-24dd-4386-b5b7-670633f9a283 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:15.178743 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d46f4-24dd-4386-b5b7-670633f9a283 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:15.200713 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:15.211876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d6e4f-915c-4538-a7c9-9ee078535e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:15.212650 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d6e4f-915c-4538-a7c9-9ee078535e9b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:15.212926 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d6e4f-915c-4538-a7c9-9ee078535e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:15.213197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d6e4f-915c-4538-a7c9-9ee078535e9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:15.223038 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d6e4f-915c-4538-a7c9-9ee078535e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:50:15.231222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-772d6e4f-915c-4538-a7c9-9ee078535e9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:50:15.231222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:50:15.231222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:50:15.231222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:50:15.231222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:50:15.231222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:50:15.231222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:50:15.231222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:50:15.231222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:50:15.231222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:50:15.231222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:50:15.231222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:50:15.231222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:50:15.231222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:50:15.231222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:50:15.231222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:50:15.232322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:50:15.232322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:50:15.232322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:50:15.232322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:50:15.232322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:50:15.232322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:50:15.232322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:50:15.232322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:50:15.232322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:50:15.232322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:50:15.232322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:50:15.232322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:50:15.232322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:50:15.232322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:50:15.232322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:50:15.232322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:50:15.233381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:50:15.233381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:50:15.233381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:50:15.233381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:50:15.233381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:50:15.233381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:50:15.233381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:50:15.233381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:50:15.233381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:50:15.233381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:50:15.233381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:50:15.233381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:50:15.233381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 598/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:50:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:50:15.238297 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7ab03-def2-488f-b3c3-04edb3408af2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:15.331682 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7ab03-def2-488f-b3c3-04edb3408af2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:15.364427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a1d03-e1b3-4211-8947-33b7e5aab291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:15.365084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1d03-e1b3-4211-8947-33b7e5aab291 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:15.365365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1d03-e1b3-4211-8947-33b7e5aab291 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:15.365639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1d03-e1b3-4211-8947-33b7e5aab291 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:15.366505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a1d03-e1b3-4211-8947-33b7e5aab291 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:50:15.366813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a1d03-e1b3-4211-8947-33b7e5aab291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:15.368171 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a1d03-e1b3-4211-8947-33b7e5aab291 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:15.376061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 591/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:50:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:50:15.382385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d6e4f-915c-4538-a7c9-9ee078535e9b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:15.478217 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d6e4f-915c-4538-a7c9-9ee078535e9b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:15.510169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74041656-ad21-4800-b113-9a799f4d0c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:15.511015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74041656-ad21-4800-b113-9a799f4d0c8b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:15.511291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74041656-ad21-4800-b113-9a799f4d0c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:15.511567 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74041656-ad21-4800-b113-9a799f4d0c8b None admin] PATH_INFO: `/v3/users/fc255732f14042009ce4dbaedaafcc2b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:15.512716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74041656-ad21-4800-b113-9a799f4d0c8b None admin] RBAC: Authorizing `identity:get_user(user_id=fc255732f14042009ce4dbaedaafcc2b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:15.514155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74041656-ad21-4800-b113-9a799f4d0c8b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:15.515725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 599/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:50:15 2022] GET /identity/v3/users/fc255732f14042009ce4dbaedaafcc2b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:50:15.521193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a1d03-e1b3-4211-8947-33b7e5aab291 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:15.555069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:15.617037 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a1d03-e1b3-4211-8947-33b7e5aab291 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:15.648892 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e62312-1fd8-4de4-9124-12627c903f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:15.649732 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e62312-1fd8-4de4-9124-12627c903f78 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:15.650042 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e62312-1fd8-4de4-9124-12627c903f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:15.650324 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e62312-1fd8-4de4-9124-12627c903f78 None admin] PATH_INFO: `/v3/projects/67990c13103d479eae10847b264bd113` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:15.651478 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e62312-1fd8-4de4-9124-12627c903f78 None admin] RBAC: Authorizing `identity:get_project(project_id=67990c13103d479eae10847b264bd113)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:15.652881 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e62312-1fd8-4de4-9124-12627c903f78 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:15.654561 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 592/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:50:15 2022] GET /identity/v3/projects/67990c13103d479eae10847b264bd113 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:50:15.660231 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74041656-ad21-4800-b113-9a799f4d0c8b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:15.710823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:15.756412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74041656-ad21-4800-b113-9a799f4d0c8b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:15.788713 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed744f-e1b9-4ded-b8a7-0248fd92ddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:15.789583 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed744f-e1b9-4ded-b8a7-0248fd92ddcb None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:15.789864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed744f-e1b9-4ded-b8a7-0248fd92ddcb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:15.790165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed744f-e1b9-4ded-b8a7-0248fd92ddcb None admin] PATH_INFO: `/v3/projects/67990c13103d479eae10847b264bd113/users/fc255732f14042009ce4dbaedaafcc2b/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:15.792076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed744f-e1b9-4ded-b8a7-0248fd92ddcb None admin] RBAC: Authorizing `identity:create_grant(project_id=67990c13103d479eae10847b264bd113, user_id=fc255732f14042009ce4dbaedaafcc2b, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:15.793493 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed744f-e1b9-4ded-b8a7-0248fd92ddcb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:15.806499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 600/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:50:15 2022] PUT /identity/v3/projects/67990c13103d479eae10847b264bd113/users/fc255732f14042009ce4dbaedaafcc2b/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:50:17.990856 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9b1b6-3ee7-4ab4-ab3e-8870c0b25b2b None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:17.991907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9b1b6-3ee7-4ab4-ab3e-8870c0b25b2b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:17.992000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9b1b6-3ee7-4ab4-ab3e-8870c0b25b2b None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:17.993312 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 593/1193] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:50:17.998472 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3fd2d-7de1-4c90-93b7-5f337f2a9309 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:17.998904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3fd2d-7de1-4c90-93b7-5f337f2a9309 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:17.999029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3fd2d-7de1-4c90-93b7-5f337f2a9309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:18.015857 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8ae3fd2d-7de1-4c90-93b7-5f337f2a9309 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:50:18.017008 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8ae3fd2d-7de1-4c90-93b7-5f337f2a9309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:50:18.079707 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 601/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:50:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:50:18.103833 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9b1b6-3ee7-4ab4-ab3e-8870c0b25b2b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:18.201637 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9b1b6-3ee7-4ab4-ab3e-8870c0b25b2b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:18.203984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:18.235594 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94484c9-2f74-4d17-b990-5045e68c92b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:18.236365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94484c9-2f74-4d17-b990-5045e68c92b5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:18.236646 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94484c9-2f74-4d17-b990-5045e68c92b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:18.236920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94484c9-2f74-4d17-b990-5045e68c92b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:18.246661 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94484c9-2f74-4d17-b990-5045e68c92b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:50:18.254124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e94484c9-2f74-4d17-b990-5045e68c92b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:50:18.254124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:50:18.254124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:50:18.254124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:50:18.254124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:50:18.254124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:50:18.254124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:50:18.254124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:50:18.254124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:50:18.254124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:50:18.254124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:50:18.254124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:50:18.254124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:50:18.254124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:50:18.254124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:50:18.254124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:50:18.255285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:50:18.255285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:50:18.255285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:50:18.255285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:50:18.255285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:50:18.255285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:50:18.255285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:50:18.255285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:50:18.255285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:50:18.255285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:50:18.255285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:50:18.255285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:50:18.255285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:50:18.255285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:50:18.255285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:50:18.255285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:50:18.256168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:50:18.256168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:50:18.256168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:50:18.256168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:50:18.256168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:50:18.256168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:50:18.256168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:50:18.256168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:50:18.256168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:50:18.256168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:50:18.256168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:50:18.256168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:50:18.256168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 594/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:50:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:50:18.261634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3fd2d-7de1-4c90-93b7-5f337f2a9309 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:18.302435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:18.357601 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3fd2d-7de1-4c90-93b7-5f337f2a9309 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:18.390414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3773f50-f341-49f1-b189-cffa12dc355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:18.391070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3773f50-f341-49f1-b189-cffa12dc355a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:18.391350 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3773f50-f341-49f1-b189-cffa12dc355a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:18.391624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3773f50-f341-49f1-b189-cffa12dc355a None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:18.392354 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3773f50-f341-49f1-b189-cffa12dc355a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:50:18.392657 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3773f50-f341-49f1-b189-cffa12dc355a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:18.394043 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3773f50-f341-49f1-b189-cffa12dc355a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:18.401799 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 602/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:50:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:50:18.407514 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94484c9-2f74-4d17-b990-5045e68c92b5 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:18.503847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94484c9-2f74-4d17-b990-5045e68c92b5 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:18.535322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfc7d6-ccf0-4dc1-9c0b-80ffddf7e01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:18.536163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfc7d6-ccf0-4dc1-9c0b-80ffddf7e01d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:18.536445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfc7d6-ccf0-4dc1-9c0b-80ffddf7e01d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:18.536717 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfc7d6-ccf0-4dc1-9c0b-80ffddf7e01d None admin] PATH_INFO: `/v3/users/fc255732f14042009ce4dbaedaafcc2b` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:18.538413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfc7d6-ccf0-4dc1-9c0b-80ffddf7e01d None admin] RBAC: Authorizing `identity:get_user(user_id=fc255732f14042009ce4dbaedaafcc2b)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:18.539850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfc7d6-ccf0-4dc1-9c0b-80ffddf7e01d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:18.541434 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 595/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 7 21:50:18 2022] GET /identity/v3/users/fc255732f14042009ce4dbaedaafcc2b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:50:18.546935 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3773f50-f341-49f1-b189-cffa12dc355a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:18.643263 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3773f50-f341-49f1-b189-cffa12dc355a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:18.645514 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:18.676845 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c53b3-6594-4d47-b8de-ee3f43cef654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:18.677475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c53b3-6594-4d47-b8de-ee3f43cef654 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:18.677756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c53b3-6594-4d47-b8de-ee3f43cef654 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:18.678059 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c53b3-6594-4d47-b8de-ee3f43cef654 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:18.742598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c53b3-6594-4d47-b8de-ee3f43cef654 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:18.744050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c53b3-6594-4d47-b8de-ee3f43cef654 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:18.837343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 603/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:50:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:50:18.843188 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfc7d6-ccf0-4dc1-9c0b-80ffddf7e01d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:18.874724 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:18.940103 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfc7d6-ccf0-4dc1-9c0b-80ffddf7e01d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:18.971569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dd9c5-c1a9-4ca5-89ff-2d142944a3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:18.972404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dd9c5-c1a9-4ca5-89ff-2d142944a3ec None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:18.972680 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dd9c5-c1a9-4ca5-89ff-2d142944a3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:18.972950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dd9c5-c1a9-4ca5-89ff-2d142944a3ec None admin] PATH_INFO: `/v3/projects/67990c13103d479eae10847b264bd113` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:18.974117 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dd9c5-c1a9-4ca5-89ff-2d142944a3ec None admin] RBAC: Authorizing `identity:get_project(project_id=67990c13103d479eae10847b264bd113)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:18.976072 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dd9c5-c1a9-4ca5-89ff-2d142944a3ec None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:18.978018 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 596/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 7 21:50:18 2022] GET /identity/v3/projects/67990c13103d479eae10847b264bd113 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:50:18.984120 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c53b3-6594-4d47-b8de-ee3f43cef654 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:50:18.987143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:19.078605 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c53b3-6594-4d47-b8de-ee3f43cef654 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:50:19.111394 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f517e1-5706-4f08-9065-dfc31fbe4338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:50:19.111972 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f517e1-5706-4f08-9065-dfc31fbe4338 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:50:19.112253 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f517e1-5706-4f08-9065-dfc31fbe4338 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:50:19.112527 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f517e1-5706-4f08-9065-dfc31fbe4338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:50:19.113339 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f517e1-5706-4f08-9065-dfc31fbe4338 None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=67990c13103d479eae10847b264bd113, user.id=fc255732f14042009ce4dbaedaafcc2b) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:50:19.113647 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f517e1-5706-4f08-9065-dfc31fbe4338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:50:19.115219 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f517e1-5706-4f08-9065-dfc31fbe4338 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:50:19.120874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 604/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:50:18 2022] GET /identity/v3/role_assignments?user.id=fc255732f14042009ce4dbaedaafcc2b&scope.project.id=67990c13103d479eae10847b264bd113&role.id=8f58ef9d28494d97a68de20b84355450 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:50:28.967604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=50 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:50:29.118292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=66 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:19.563563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d22206-a1bd-4be9-88cc-95333396593d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:19.564129 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d22206-a1bd-4be9-88cc-95333396593d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:19.564219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d22206-a1bd-4be9-88cc-95333396593d None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:19.565761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 597/1201] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:51:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:51:19.571562 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20538583-beb2-4447-96b5-0c10cd5702c3 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:19.572134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20538583-beb2-4447-96b5-0c10cd5702c3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:19.572134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20538583-beb2-4447-96b5-0c10cd5702c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:19.590161 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-20538583-beb2-4447-96b5-0c10cd5702c3 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:51:19.591498 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-20538583-beb2-4447-96b5-0c10cd5702c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:51:19.667160 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 605/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:51:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:51:19.692990 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d22206-a1bd-4be9-88cc-95333396593d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:19.830854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d22206-a1bd-4be9-88cc-95333396593d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:19.884087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ece52-8909-4cc2-a488-c37701f5dbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:19.884903 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ece52-8909-4cc2-a488-c37701f5dbad None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:19.885183 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ece52-8909-4cc2-a488-c37701f5dbad None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:19.885454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ece52-8909-4cc2-a488-c37701f5dbad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:19.899998 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ece52-8909-4cc2-a488-c37701f5dbad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:19.901479 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ece52-8909-4cc2-a488-c37701f5dbad None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:19.926227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-4d8ece52-8909-4cc2-a488-c37701f5dbad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:19.926227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:19.926227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:19.926227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:19.926227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:19.926227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:19.926227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:19.926227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:19.926227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:19.926227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:19.926227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:19.926227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:19.926227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:51:19.926227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:51:19.926227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:51:19.928052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:51:19.928052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:19.928052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:19.928052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:19.928052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:19.928052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:19.928052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:19.928052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:19.928052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:19.928052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:19.928052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:19.928052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:19.928052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:19.928052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:19.928052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:19.928052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:19.928052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:19.931171 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:51:19.931171 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:51:19.931171 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:19.931171 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:51:19.931171 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 598/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:19.934832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20538583-beb2-4447-96b5-0c10cd5702c3 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:20.063998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20538583-beb2-4447-96b5-0c10cd5702c3 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:20.098419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:20.107023 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158c1e5-cf95-4c66-b594-720ada39a352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:20.107686 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158c1e5-cf95-4c66-b594-720ada39a352 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:20.107972 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158c1e5-cf95-4c66-b594-720ada39a352 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:20.108248 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158c1e5-cf95-4c66-b594-720ada39a352 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:20.109077 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158c1e5-cf95-4c66-b594-720ada39a352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:20.109387 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158c1e5-cf95-4c66-b594-720ada39a352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:20.110958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158c1e5-cf95-4c66-b594-720ada39a352 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:20.124209 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 606/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:20.130941 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ece52-8909-4cc2-a488-c37701f5dbad None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:20.214888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:20.282239 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ece52-8909-4cc2-a488-c37701f5dbad None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:20.330507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fde525-cd9a-4b7b-999c-85c6a490e0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:20.331300 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fde525-cd9a-4b7b-999c-85c6a490e0e5 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:20.331722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fde525-cd9a-4b7b-999c-85c6a490e0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:20.332068 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fde525-cd9a-4b7b-999c-85c6a490e0e5 None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:20.332891 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fde525-cd9a-4b7b-999c-85c6a490e0e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:20.335143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fde525-cd9a-4b7b-999c-85c6a490e0e5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:20.367352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 599/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 7 21:51:20 2022] POST /identity/v3/users => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:51:22.907602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941cab9-a0a6-4f13-9952-d5f4d1b51536 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:22.908192 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941cab9-a0a6-4f13-9952-d5f4d1b51536 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:22.908192 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941cab9-a0a6-4f13-9952-d5f4d1b51536 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:22.909888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 607/1206] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:51:22.916786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848d7ca-73d8-4580-a7c4-2974e7c23729 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:22.917227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848d7ca-73d8-4580-a7c4-2974e7c23729 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:22.917330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848d7ca-73d8-4580-a7c4-2974e7c23729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:22.937612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8848d7ca-73d8-4580-a7c4-2974e7c23729 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:51:22.939214 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8848d7ca-73d8-4580-a7c4-2974e7c23729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:51:23.023866 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 600/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:51:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:51:23.049549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941cab9-a0a6-4f13-9952-d5f4d1b51536 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:23.175972 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941cab9-a0a6-4f13-9952-d5f4d1b51536 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:23.216735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc8625-9e34-405d-8659-9556d25ee7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:23.217621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc8625-9e34-405d-8659-9556d25ee7fb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:23.218027 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc8625-9e34-405d-8659-9556d25ee7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:23.218414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc8625-9e34-405d-8659-9556d25ee7fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:23.242055 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc8625-9e34-405d-8659-9556d25ee7fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:51:23.250669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-47dc8625-9e34-405d-8659-9556d25ee7fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:51:23.250669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:23.250669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:23.250669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:23.250669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:23.250669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:23.250669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:23.250669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:23.250669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:23.250669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:23.250669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:23.250669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:23.250669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:51:23.250669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:51:23.250669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:51:23.250669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:51:23.251644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:51:23.251644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:51:23.251644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:51:23.251644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:51:23.251644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:23.251644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:23.251644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:23.251644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:23.251644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:23.251644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:23.251644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:23.251644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:23.251644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:23.251644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:23.251644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:23.251644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:23.252491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:23.252491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:23.252491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:23.252491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:23.252491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:51:23.252491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:51:23.252491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:51:23.252491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:51:23.252491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:51:23.252491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:51:23.252491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:51:23.252491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:23.252491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 608/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:51:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:23.258485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848d7ca-73d8-4580-a7c4-2974e7c23729 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:23.302940 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:23.383943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848d7ca-73d8-4580-a7c4-2974e7c23729 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:23.426409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb017f-e3e1-4fb9-85ca-3f3f454442ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:23.427132 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb017f-e3e1-4fb9-85ca-3f3f454442ad None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:23.427388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb017f-e3e1-4fb9-85ca-3f3f454442ad None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:23.427691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb017f-e3e1-4fb9-85ca-3f3f454442ad None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:23.428511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb017f-e3e1-4fb9-85ca-3f3f454442ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:23.428861 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb017f-e3e1-4fb9-85ca-3f3f454442ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:23.430322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb017f-e3e1-4fb9-85ca-3f3f454442ad None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:23.444327 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 601/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:51:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:23.445817 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc8625-9e34-405d-8659-9556d25ee7fb None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:23.508725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:23.574945 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc8625-9e34-405d-8659-9556d25ee7fb None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:23.619244 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda0b13-057e-4554-b5c1-84505b7452b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:23.620168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda0b13-057e-4554-b5c1-84505b7452b7 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:23.620545 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda0b13-057e-4554-b5c1-84505b7452b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:23.620873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda0b13-057e-4554-b5c1-84505b7452b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:23.635929 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda0b13-057e-4554-b5c1-84505b7452b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:23.637433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda0b13-057e-4554-b5c1-84505b7452b7 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:23.658592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-1dda0b13-057e-4554-b5c1-84505b7452b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:23.658592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:23.658592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:23.658592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:23.658592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:23.658592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:23.658592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:23.658592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:23.658592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:23.658592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:23.658592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:23.658592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:23.658592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:51:23.658592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:51:23.658592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:51:23.659618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:51:23.659618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:23.659618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:23.659618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:23.659618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:23.659618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:23.659618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:23.659618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:23.659618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:23.659618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:23.659618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:23.659618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:23.659618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:23.659618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:23.659618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:23.659618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:23.659618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:23.660534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:51:23.660534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:51:23.660534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:23.660534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:23.660534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 609/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:23.665783 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb017f-e3e1-4fb9-85ca-3f3f454442ad None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:23.791044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:23.794622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb017f-e3e1-4fb9-85ca-3f3f454442ad None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:23.840363 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d6946-ef0e-45e4-86a0-500d2f7d7fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:23.841108 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6946-ef0e-45e4-86a0-500d2f7d7fed None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:23.841467 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6946-ef0e-45e4-86a0-500d2f7d7fed None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:23.841747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6946-ef0e-45e4-86a0-500d2f7d7fed None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:23.842509 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d6946-ef0e-45e4-86a0-500d2f7d7fed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:23.842817 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d6946-ef0e-45e4-86a0-500d2f7d7fed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:23.844563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d6946-ef0e-45e4-86a0-500d2f7d7fed None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:23.861555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 602/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:23.867272 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda0b13-057e-4554-b5c1-84505b7452b7 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:23.991234 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda0b13-057e-4554-b5c1-84505b7452b7 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:23.992913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:24.031641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dbbe1-2b9c-45ad-a02d-4df3e5828eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:24.033401 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dbbe1-2b9c-45ad-a02d-4df3e5828eeb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:24.033401 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dbbe1-2b9c-45ad-a02d-4df3e5828eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:24.033401 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dbbe1-2b9c-45ad-a02d-4df3e5828eeb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:24.043231 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9dbbe1-2b9c-45ad-a02d-4df3e5828eeb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:24.044786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9dbbe1-2b9c-45ad-a02d-4df3e5828eeb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:24.062623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-5d9dbbe1-2b9c-45ad-a02d-4df3e5828eeb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 21:51:24.062623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:24.062623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:24.062623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:24.062623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:24.062623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:24.062623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:24.062623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:24.062623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:24.062623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:24.062623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:24.062623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:24.062623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:51:24.062623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:51:24.062623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:51:24.062623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:24.069257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:24.070640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:24.070640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:24.070640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:51:24.070640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:51:24.070640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:51:24.070640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:51:24.070640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:51:24.070640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:51:24.070640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 21:51:24.070640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:24.070640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 610/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:24.071385 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d6946-ef0e-45e4-86a0-500d2f7d7fed None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:24.215381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d6946-ef0e-45e4-86a0-500d2f7d7fed None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:24.265761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cfafb-baa3-451e-bfbb-05e4f64912ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:24.266535 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cfafb-baa3-451e-bfbb-05e4f64912ac None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:24.266855 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cfafb-baa3-451e-bfbb-05e4f64912ac None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:24.267177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cfafb-baa3-451e-bfbb-05e4f64912ac None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:24.268043 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024cfafb-baa3-451e-bfbb-05e4f64912ac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:24.268363 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024cfafb-baa3-451e-bfbb-05e4f64912ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:24.269825 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024cfafb-baa3-451e-bfbb-05e4f64912ac None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:24.294537 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 603/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jun 7 21:51:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:24.300146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dbbe1-2b9c-45ad-a02d-4df3e5828eeb None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:24.424079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dbbe1-2b9c-45ad-a02d-4df3e5828eeb None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:24.467082 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cebe0-a32b-4f40-b426-7116a46dc77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:24.467732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cebe0-a32b-4f40-b426-7116a46dc77d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:24.468018 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cebe0-a32b-4f40-b426-7116a46dc77d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:24.468294 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cebe0-a32b-4f40-b426-7116a46dc77d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:24.500515 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:24.542887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cebe0-a32b-4f40-b426-7116a46dc77d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:24.544383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cebe0-a32b-4f40-b426-7116a46dc77d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:24.659009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 611/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:51:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:51:24.667345 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cfafb-baa3-451e-bfbb-05e4f64912ac None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:24.690261 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:24.783199 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cfafb-baa3-451e-bfbb-05e4f64912ac None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:24.819807 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814724c-c67b-4ebc-aa8b-484da0ff6d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:24.820604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814724c-c67b-4ebc-aa8b-484da0ff6d0d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:24.820956 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814724c-c67b-4ebc-aa8b-484da0ff6d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:24.821164 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814724c-c67b-4ebc-aa8b-484da0ff6d0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:24.832423 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814724c-c67b-4ebc-aa8b-484da0ff6d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:24.834438 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814724c-c67b-4ebc-aa8b-484da0ff6d0d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:24.853212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-4814724c-c67b-4ebc-aa8b-484da0ff6d0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:24.853212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:24.853212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:24.853212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:24.853212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:24.853212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:24.853212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:24.853212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:24.853212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:24.853212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:24.853212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:24.853212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:24.853212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:51:24.853212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:51:24.853212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:51:24.854377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:51:24.854377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:24.854377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:24.854377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:24.854377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:24.854377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:24.854377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:24.854377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:24.854377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:24.854377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:24.854377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:24.854377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:24.854377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:24.854377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:24.854377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:24.854377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:24.854377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:24.860000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:51:24.860000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:51:24.860000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:24.860000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:51:24.860000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 604/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:24.860352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cebe0-a32b-4f40-b426-7116a46dc77d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:24.926292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:24.970788 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cebe0-a32b-4f40-b426-7116a46dc77d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:25.008240 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc78e0-b248-4f81-b07f-3f2189e1b44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:25.008889 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc78e0-b248-4f81-b07f-3f2189e1b44b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:25.009178 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc78e0-b248-4f81-b07f-3f2189e1b44b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:25.009455 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc78e0-b248-4f81-b07f-3f2189e1b44b None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:25.010203 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc78e0-b248-4f81-b07f-3f2189e1b44b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:25.010507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc78e0-b248-4f81-b07f-3f2189e1b44b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:25.011888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc78e0-b248-4f81-b07f-3f2189e1b44b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:25.025442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 612/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:25.030933 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814724c-c67b-4ebc-aa8b-484da0ff6d0d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:25.118718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:25.161353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814724c-c67b-4ebc-aa8b-484da0ff6d0d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:25.199804 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480b3ec-c8f8-478f-8067-4e2bafeca9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:25.201083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480b3ec-c8f8-478f-8067-4e2bafeca9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:25.201576 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480b3ec-c8f8-478f-8067-4e2bafeca9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:25.201864 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480b3ec-c8f8-478f-8067-4e2bafeca9e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:25.209494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480b3ec-c8f8-478f-8067-4e2bafeca9e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:25.211006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480b3ec-c8f8-478f-8067-4e2bafeca9e2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:25.227935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-f480b3ec-c8f8-478f-8067-4e2bafeca9e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:51:25.227935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:25.227935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:25.227935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:25.227935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:25.227935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:25.227935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:25.227935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:25.227935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:25.227935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:25.227935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:25.227935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:25.227935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:51:25.227935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:51:25.227935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:51:25.228980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:51:25.228980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:25.228980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:25.228980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:25.228980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:25.228980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:25.228980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:25.228980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:25.228980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:25.228980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:25.228980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:25.228980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:25.228980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:25.228980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:25.228980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:25.228980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:25.228980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:25.229897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:51:25.229897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:51:25.229897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:51:25.229897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:51:25.229897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:51:25.229897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:51:25.229897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:51:25.229897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:51:25.229897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 605/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:51:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:25.235258 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc78e0-b248-4f81-b07f-3f2189e1b44b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:25.341197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc78e0-b248-4f81-b07f-3f2189e1b44b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:25.383685 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:25.397048 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c6182-b015-418b-9604-c58fc912db5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:25.397834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c6182-b015-418b-9604-c58fc912db5b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:25.398247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c6182-b015-418b-9604-c58fc912db5b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:25.398613 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c6182-b015-418b-9604-c58fc912db5b None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:25.399491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c6182-b015-418b-9604-c58fc912db5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:25.399897 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c6182-b015-418b-9604-c58fc912db5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:25.401424 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c6182-b015-418b-9604-c58fc912db5b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:25.414407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 613/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:51:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:25.420761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480b3ec-c8f8-478f-8067-4e2bafeca9e2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:25.562702 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480b3ec-c8f8-478f-8067-4e2bafeca9e2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:25.731078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:25.740370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896f439-1673-499f-8a74-a56e93c2bd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:25.741105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896f439-1673-499f-8a74-a56e93c2bd50 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:25.741501 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896f439-1673-499f-8a74-a56e93c2bd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:25.741913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896f439-1673-499f-8a74-a56e93c2bd50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:25.742919 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896f439-1673-499f-8a74-a56e93c2bd50 None admin] RBAC: Adding query filter params (role.id=382652f08fc24ce39f91164181237006, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=90facf92f97d435dbe8a001759a8fe0c) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:25.743214 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896f439-1673-499f-8a74-a56e93c2bd50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:25.744889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896f439-1673-499f-8a74-a56e93c2bd50 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:25.751426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 606/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:51:25 2022] GET /identity/v3/role_assignments?user.id=90facf92f97d435dbe8a001759a8fe0c&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=382652f08fc24ce39f91164181237006 => generated 259 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:28.048769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd0b0-2577-412f-adb8-08913d4ce435 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:28.049343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd0b0-2577-412f-adb8-08913d4ce435 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:28.049343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd0b0-2577-412f-adb8-08913d4ce435 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:28.050696 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 614/1220] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:51:28.057057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c6de-85ce-4e1d-b231-468353f04489 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:28.057496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c6de-85ce-4e1d-b231-468353f04489 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:28.057673 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c6de-85ce-4e1d-b231-468353f04489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:28.075558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8f14c6de-85ce-4e1d-b231-468353f04489 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:51:28.076776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8f14c6de-85ce-4e1d-b231-468353f04489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:51:28.165966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 607/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:51:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:51:28.190504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fd0b0-2577-412f-adb8-08913d4ce435 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:28.314767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fd0b0-2577-412f-adb8-08913d4ce435 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:28.365445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d57127-90ba-4d28-9493-141d8f3ad60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:28.367676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d57127-90ba-4d28-9493-141d8f3ad60c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:28.367676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d57127-90ba-4d28-9493-141d8f3ad60c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:28.367891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d57127-90ba-4d28-9493-141d8f3ad60c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:28.381843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d57127-90ba-4d28-9493-141d8f3ad60c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:51:28.390625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-80d57127-90ba-4d28-9493-141d8f3ad60c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:51:28.390625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:28.390625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:28.390625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:28.390625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:28.390625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:28.390625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:28.390625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:28.390625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:28.390625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:28.390625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:28.390625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:28.390625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:51:28.390625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:51:28.390625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:51:28.390625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:51:28.391843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:51:28.391843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:51:28.391843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:51:28.391843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:51:28.391843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:28.391843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:28.391843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:28.391843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:28.391843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:28.391843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:28.391843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:28.391843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:28.391843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:28.391843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:28.391843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:28.391843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:28.392848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:28.392848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:28.392848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:28.392848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:28.392848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:51:28.392848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:51:28.392848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:51:28.392848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:51:28.392848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:51:28.392848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:51:28.392848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:51:28.392848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:28.392848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 615/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:51:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:28.398971 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14c6de-85ce-4e1d-b231-468353f04489 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:28.507896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14c6de-85ce-4e1d-b231-468353f04489 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:28.533513 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:28.548120 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d736a-db7a-4132-a13c-5ec62419430c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:28.548948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d736a-db7a-4132-a13c-5ec62419430c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:28.549234 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d736a-db7a-4132-a13c-5ec62419430c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:28.549512 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d736a-db7a-4132-a13c-5ec62419430c None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:28.550301 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d736a-db7a-4132-a13c-5ec62419430c None admin] RBAC: Adding query filter params (name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:28.550611 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d736a-db7a-4132-a13c-5ec62419430c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:28.552126 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d736a-db7a-4132-a13c-5ec62419430c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:28.562885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 608/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:51:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:28.571173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d57127-90ba-4d28-9493-141d8f3ad60c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:28.623783 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:28.694622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d57127-90ba-4d28-9493-141d8f3ad60c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:28.732535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef83d80-db89-4f1c-badc-022b75ec840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:28.733426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef83d80-db89-4f1c-badc-022b75ec840f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:28.733625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef83d80-db89-4f1c-badc-022b75ec840f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:28.733863 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef83d80-db89-4f1c-badc-022b75ec840f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:28.745376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef83d80-db89-4f1c-badc-022b75ec840f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:28.747030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef83d80-db89-4f1c-badc-022b75ec840f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:28.766382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-aef83d80-db89-4f1c-badc-022b75ec840f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:28.766382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:28.766382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:28.766382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:28.766382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:28.766382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:28.766382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:28.766382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:28.766382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:28.766382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:28.766382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:28.766382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:28.766382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:51:28.766382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:51:28.766382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:51:28.767551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:51:28.767551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:28.767551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:28.767551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:28.767551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:28.767551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:28.767551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:28.767551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:28.767551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:28.767551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:28.767551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:28.767551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:28.767551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:28.767551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:28.767551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:28.767551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:28.767551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:28.768579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:51:28.768579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:51:28.768579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:28.768579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:28.768579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 616/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:51:28.773753 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d736a-db7a-4132-a13c-5ec62419430c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:28.881277 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d736a-db7a-4132-a13c-5ec62419430c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:28.915953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752e0f5-5dc7-4c85-a942-61438fc02cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:28.916607 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752e0f5-5dc7-4c85-a942-61438fc02cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:28.916882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752e0f5-5dc7-4c85-a942-61438fc02cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:28.917237 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752e0f5-5dc7-4c85-a942-61438fc02cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:28.917869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752e0f5-5dc7-4c85-a942-61438fc02cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:28.918262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752e0f5-5dc7-4c85-a942-61438fc02cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:28.919655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752e0f5-5dc7-4c85-a942-61438fc02cc2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:28.932528 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 609/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:28.938366 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef83d80-db89-4f1c-badc-022b75ec840f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:29.042097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:29.049570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef83d80-db89-4f1c-badc-022b75ec840f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:29.085190 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cdef3-884c-4d19-b413-6caafb7d05f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:29.086269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cdef3-884c-4d19-b413-6caafb7d05f1 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:29.086612 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cdef3-884c-4d19-b413-6caafb7d05f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:29.086998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cdef3-884c-4d19-b413-6caafb7d05f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:29.097449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cdef3-884c-4d19-b413-6caafb7d05f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:29.099502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cdef3-884c-4d19-b413-6caafb7d05f1 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:29.119552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-4b5cdef3-884c-4d19-b413-6caafb7d05f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 21:51:29.119552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:29.119552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:29.119552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:29.119552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:29.119552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:29.119552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:29.119552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:29.119552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:29.119552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:29.119552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:29.119552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:29.119552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:51:29.119552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:51:29.119552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:51:29.119552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:29.120860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:29.122050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:29.122050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:29.122050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:51:29.122050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:51:29.122050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:51:29.122050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:51:29.122050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:51:29.122050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:51:29.122050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 21:51:29.122050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:29.122050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 617/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:51:29.127947 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752e0f5-5dc7-4c85-a942-61438fc02cc2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:29.189095 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:29.246888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752e0f5-5dc7-4c85-a942-61438fc02cc2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:29.284469 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7c15a-1a2e-4e21-90c1-ef2e970a39ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:29.285568 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7c15a-1a2e-4e21-90c1-ef2e970a39ec None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:29.285864 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7c15a-1a2e-4e21-90c1-ef2e970a39ec None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:29.286275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7c15a-1a2e-4e21-90c1-ef2e970a39ec None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:29.287840 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7c15a-1a2e-4e21-90c1-ef2e970a39ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:29.288306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7c15a-1a2e-4e21-90c1-ef2e970a39ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:29.290370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7c15a-1a2e-4e21-90c1-ef2e970a39ec None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:29.309634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 610/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jun 7 21:51:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:29.316623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cdef3-884c-4d19-b413-6caafb7d05f1 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:29.423688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cdef3-884c-4d19-b413-6caafb7d05f1 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:29.460359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898395a-15c9-4325-85d3-dd5c05a166b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:29.461073 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898395a-15c9-4325-85d3-dd5c05a166b0 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:29.461353 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898395a-15c9-4325-85d3-dd5c05a166b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:29.461625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898395a-15c9-4325-85d3-dd5c05a166b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:29.472878 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898395a-15c9-4325-85d3-dd5c05a166b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:29.474994 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898395a-15c9-4325-85d3-dd5c05a166b0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:29.492105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-a898395a-15c9-4325-85d3-dd5c05a166b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:29.492105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:29.492105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:29.492105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:29.492105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:29.492105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:29.492105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:29.492105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:29.492105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:29.492105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:29.492105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:29.492105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:29.492105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:51:29.492105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:51:29.492105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:51:29.493421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:51:29.493421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:29.493421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:29.493421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:29.493421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:29.493421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:29.493421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:29.493421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:29.493421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:29.493421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:29.493421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:29.493421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:29.493421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:29.493421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:29.493421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:29.493421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:29.493421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:29.494701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:51:29.494701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:51:29.494701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:29.494701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:29.494701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 618/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:29.499040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7c15a-1a2e-4e21-90c1-ef2e970a39ec None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:29.604496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7c15a-1a2e-4e21-90c1-ef2e970a39ec None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:29.607029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:29.643252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea3288-fbb9-4c7a-9622-9d9c4a476569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:29.643834 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea3288-fbb9-4c7a-9622-9d9c4a476569 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:29.644223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea3288-fbb9-4c7a-9622-9d9c4a476569 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:29.644420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea3288-fbb9-4c7a-9622-9d9c4a476569 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:29.645129 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea3288-fbb9-4c7a-9622-9d9c4a476569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:29.645431 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea3288-fbb9-4c7a-9622-9d9c4a476569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:29.647955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea3288-fbb9-4c7a-9622-9d9c4a476569 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:29.660913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 611/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:51:29.666638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898395a-15c9-4325-85d3-dd5c05a166b0 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:29.676589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:29.776882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898395a-15c9-4325-85d3-dd5c05a166b0 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:29.812281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f43e8-150d-4a98-b0d9-d479b6c71a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:29.813071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f43e8-150d-4a98-b0d9-d479b6c71a9b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:29.813347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f43e8-150d-4a98-b0d9-d479b6c71a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:29.813616 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f43e8-150d-4a98-b0d9-d479b6c71a9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:29.822345 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f43e8-150d-4a98-b0d9-d479b6c71a9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:29.823765 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f43e8-150d-4a98-b0d9-d479b6c71a9b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:29.838474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-f80f43e8-150d-4a98-b0d9-d479b6c71a9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:51:29.838474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:29.838474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:29.838474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:29.838474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:29.838474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:29.838474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:29.838474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:29.838474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:29.838474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:29.838474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:29.838474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:29.838474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:51:29.838474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:51:29.838474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:51:29.839586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:51:29.839586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:29.839586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:29.839586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:29.839586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:29.839586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:29.839586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:29.839586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:29.839586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:29.839586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:29.839586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:29.839586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:29.839586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:29.839586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:29.839586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:29.839586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:29.839586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:29.840684 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:51:29.840684 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:51:29.840684 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:51:29.840684 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:51:29.840684 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:51:29.840684 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:51:29.840684 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:51:29.840684 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:29.840684 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 619/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:51:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:29.845440 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea3288-fbb9-4c7a-9622-9d9c4a476569 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:29.957989 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea3288-fbb9-4c7a-9622-9d9c4a476569 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:29.996201 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ba59e-e0c7-4fb6-b77a-24365efa62ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:29.996973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ba59e-e0c7-4fb6-b77a-24365efa62ee None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:29.997284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ba59e-e0c7-4fb6-b77a-24365efa62ee None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:29.997622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ba59e-e0c7-4fb6-b77a-24365efa62ee None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:29.998448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ba59e-e0c7-4fb6-b77a-24365efa62ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:29.998762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ba59e-e0c7-4fb6-b77a-24365efa62ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:30.000191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ba59e-e0c7-4fb6-b77a-24365efa62ee None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:30.014686 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 612/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:51:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:30.020623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f43e8-150d-4a98-b0d9-d479b6c71a9b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:30.094796 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:30.138506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f43e8-150d-4a98-b0d9-d479b6c71a9b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:30.175472 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a0fd8-fc96-4786-8a51-04c0af76195b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:30.176458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a0fd8-fc96-4786-8a51-04c0af76195b None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:30.176780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a0fd8-fc96-4786-8a51-04c0af76195b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:30.177626 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a0fd8-fc96-4786-8a51-04c0af76195b None admin] PATH_INFO: `/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/90facf92f97d435dbe8a001759a8fe0c/roles/382652f08fc24ce39f91164181237006` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:30.193654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a0fd8-fc96-4786-8a51-04c0af76195b None admin] RBAC: Authorizing `identity:create_grant(project_id=eca8f481deb242789622ebb10aa2c5da, user_id=90facf92f97d435dbe8a001759a8fe0c, role_id=382652f08fc24ce39f91164181237006)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:30.195310 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a0fd8-fc96-4786-8a51-04c0af76195b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:30.208619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 620/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:51:30 2022] PUT /identity/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/90facf92f97d435dbe8a001759a8fe0c/roles/382652f08fc24ce39f91164181237006 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:51:32.690155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de2ad3-96b4-4d32-9ae5-5cb22652d87e None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:32.690694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de2ad3-96b4-4d32-9ae5-5cb22652d87e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:32.690784 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de2ad3-96b4-4d32-9ae5-5cb22652d87e None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:32.692603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 613/1233] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:51:32.697689 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d3e9c-d785-4593-97c8-b5898eced90e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:32.698124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d3e9c-d785-4593-97c8-b5898eced90e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:32.698281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d3e9c-d785-4593-97c8-b5898eced90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:32.715210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5b8d3e9c-d785-4593-97c8-b5898eced90e None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:51:32.716415 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5b8d3e9c-d785-4593-97c8-b5898eced90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:51:32.793861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 621/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:51:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:51:32.821164 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de2ad3-96b4-4d32-9ae5-5cb22652d87e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:32.851135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:32.946276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de2ad3-96b4-4d32-9ae5-5cb22652d87e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:32.986557 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca65f9-8ef9-4ede-93d0-d3989b7f75e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:32.987352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca65f9-8ef9-4ede-93d0-d3989b7f75e3 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:32.987660 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca65f9-8ef9-4ede-93d0-d3989b7f75e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:32.987900 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca65f9-8ef9-4ede-93d0-d3989b7f75e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:33.000397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca65f9-8ef9-4ede-93d0-d3989b7f75e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:51:33.009460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-f0ca65f9-8ef9-4ede-93d0-d3989b7f75e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:51:33.009460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:33.009460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:33.009460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:33.009460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:33.009460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:33.009460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:33.009460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:33.009460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:33.009460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:33.009460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:33.009460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:33.009460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:51:33.009460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:51:33.009460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:51:33.009460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:51:33.010504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:51:33.010504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:51:33.010504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:51:33.010504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:51:33.010504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:33.010504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:33.010504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:33.010504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:33.010504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:33.010504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:33.010504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:33.010504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:33.010504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:33.010504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:33.010504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:33.010504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:33.014842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:33.014842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:33.014842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:33.014842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:33.014842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:51:33.014842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:51:33.014842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:51:33.014842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:51:33.014842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:51:33.014842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:51:33.014842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 21:51:33.014842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:51:33.014842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 614/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 7 21:51:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:33.016840 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d3e9c-d785-4593-97c8-b5898eced90e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:33.067872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:33.130607 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d3e9c-d785-4593-97c8-b5898eced90e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:33.172358 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18ba8c-5e6d-42f0-8205-cefedeb8257e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:33.173099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18ba8c-5e6d-42f0-8205-cefedeb8257e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:33.173404 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18ba8c-5e6d-42f0-8205-cefedeb8257e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:33.173679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18ba8c-5e6d-42f0-8205-cefedeb8257e None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:33.174531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18ba8c-5e6d-42f0-8205-cefedeb8257e None admin] RBAC: Adding query filter params (name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:33.174853 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18ba8c-5e6d-42f0-8205-cefedeb8257e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:33.176408 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18ba8c-5e6d-42f0-8205-cefedeb8257e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:33.186469 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 622/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 7 21:51:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:33.192153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca65f9-8ef9-4ede-93d0-d3989b7f75e3 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:33.289832 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:33.308360 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca65f9-8ef9-4ede-93d0-d3989b7f75e3 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:33.349010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107e8a8-7beb-46b0-906c-e51ef5e1bb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:33.349794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107e8a8-7beb-46b0-906c-e51ef5e1bb11 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:33.350110 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107e8a8-7beb-46b0-906c-e51ef5e1bb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:33.350410 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107e8a8-7beb-46b0-906c-e51ef5e1bb11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:33.362762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107e8a8-7beb-46b0-906c-e51ef5e1bb11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:33.364263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107e8a8-7beb-46b0-906c-e51ef5e1bb11 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:33.382418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-7107e8a8-7beb-46b0-906c-e51ef5e1bb11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:33.382418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:33.382418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:33.382418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:33.382418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:33.382418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:33.382418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:33.382418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:33.382418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:33.382418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:33.382418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:33.382418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:33.382418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:51:33.382418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:51:33.382418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:51:33.383676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:51:33.383676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:33.383676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:33.383676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:33.383676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:33.383676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:33.383676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:33.383676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:33.383676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:33.383676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:33.383676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:33.383676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:33.383676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:33.383676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:33.383676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:33.383676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:33.383676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:33.384630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:51:33.384630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:51:33.384630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:33.384630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:51:33.384630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 615/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:33.389466 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18ba8c-5e6d-42f0-8205-cefedeb8257e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:33.495185 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18ba8c-5e6d-42f0-8205-cefedeb8257e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:33.507872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:33.538923 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b8183-7964-4220-8878-91f498335eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:33.539594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b8183-7964-4220-8878-91f498335eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:33.539935 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b8183-7964-4220-8878-91f498335eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:33.540230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b8183-7964-4220-8878-91f498335eb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:33.541124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b8183-7964-4220-8878-91f498335eb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:33.541513 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b8183-7964-4220-8878-91f498335eb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:33.544038 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b8183-7964-4220-8878-91f498335eb5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:33.557507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 623/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:33.563143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107e8a8-7beb-46b0-906c-e51ef5e1bb11 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:33.669069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107e8a8-7beb-46b0-906c-e51ef5e1bb11 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:33.704141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f6a68-fb36-4511-bc8c-b2028c482eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:33.705008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f6a68-fb36-4511-bc8c-b2028c482eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:33.705289 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f6a68-fb36-4511-bc8c-b2028c482eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:33.705566 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f6a68-fb36-4511-bc8c-b2028c482eb0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:33.709166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:33.714687 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f6a68-fb36-4511-bc8c-b2028c482eb0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:33.716263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f6a68-fb36-4511-bc8c-b2028c482eb0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:33.731554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-740f6a68-fb36-4511-bc8c-b2028c482eb0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 21:51:33.731554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:33.731554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:33.731554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:33.731554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:33.731554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:33.731554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:33.731554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:33.731554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:33.731554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:33.731554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:33.731554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:33.731554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:51:33.731554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:51:33.731554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:51:33.731554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:33.732805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:33.733769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:33.733769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:33.733769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:51:33.733769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:51:33.733769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:51:33.733769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:51:33.733769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:51:33.733769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:51:33.733769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 21:51:33.733769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:51:33.733769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 616/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:33.740321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b8183-7964-4220-8878-91f498335eb5 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:33.845374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b8183-7964-4220-8878-91f498335eb5 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:33.883764 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab913a8-e1fa-422e-8b0b-ab792ce46637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:33.884452 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab913a8-e1fa-422e-8b0b-ab792ce46637 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:33.884733 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab913a8-e1fa-422e-8b0b-ab792ce46637 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:33.885010 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab913a8-e1fa-422e-8b0b-ab792ce46637 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:33.885841 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab913a8-e1fa-422e-8b0b-ab792ce46637 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:33.886176 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab913a8-e1fa-422e-8b0b-ab792ce46637 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:33.887600 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab913a8-e1fa-422e-8b0b-ab792ce46637 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:33.905878 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 624/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jun 7 21:51:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:33.911722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f6a68-fb36-4511-bc8c-b2028c482eb0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:34.021067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f6a68-fb36-4511-bc8c-b2028c482eb0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:34.061997 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70ff58-4de6-4e83-b26f-b8f263daa422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:34.062855 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70ff58-4de6-4e83-b26f-b8f263daa422 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:34.063264 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70ff58-4de6-4e83-b26f-b8f263daa422 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:34.063663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70ff58-4de6-4e83-b26f-b8f263daa422 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:34.135095 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:34.143477 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70ff58-4de6-4e83-b26f-b8f263daa422 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:34.145165 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70ff58-4de6-4e83-b26f-b8f263daa422 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:34.267490 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 617/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:51:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:51:34.273749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab913a8-e1fa-422e-8b0b-ab792ce46637 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:34.306138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:34.394098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab913a8-e1fa-422e-8b0b-ab792ce46637 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:34.436577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3893d1-4fc1-481c-a74c-9e26020a8c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:34.437419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3893d1-4fc1-481c-a74c-9e26020a8c30 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:34.437729 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3893d1-4fc1-481c-a74c-9e26020a8c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:34.438053 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3893d1-4fc1-481c-a74c-9e26020a8c30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:34.449781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3893d1-4fc1-481c-a74c-9e26020a8c30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:34.451389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3893d1-4fc1-481c-a74c-9e26020a8c30 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:34.470226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-aa3893d1-4fc1-481c-a74c-9e26020a8c30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:34.470226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:34.470226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:34.470226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:34.470226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:34.470226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:34.470226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:34.470226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:34.470226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:34.470226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:34.470226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:34.470226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:34.470226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:51:34.470226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:51:34.470226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:51:34.471400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:51:34.471400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:34.471400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:34.471400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:34.471400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:34.471400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:34.471400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:34.471400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:34.471400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:34.471400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:34.471400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:34.471400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:34.471400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:34.471400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:34.471400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:34.471400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:34.471400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:34.472674 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:51:34.472674 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:51:34.472674 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:34.472674 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:34.472674 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 625/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:34.477994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70ff58-4de6-4e83-b26f-b8f263daa422 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:34.575040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:34.581000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70ff58-4de6-4e83-b26f-b8f263daa422 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:34.617167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411184d-9e86-4f4a-aa42-649938f345e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:34.617827 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411184d-9e86-4f4a-aa42-649938f345e0 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:34.618126 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411184d-9e86-4f4a-aa42-649938f345e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:34.618397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411184d-9e86-4f4a-aa42-649938f345e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:34.619112 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411184d-9e86-4f4a-aa42-649938f345e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:34.619452 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411184d-9e86-4f4a-aa42-649938f345e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:34.620767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411184d-9e86-4f4a-aa42-649938f345e0 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:34.633973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 618/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:51:34.638650 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3893d1-4fc1-481c-a74c-9e26020a8c30 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:34.732530 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:34.757046 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3893d1-4fc1-481c-a74c-9e26020a8c30 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:34.797253 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357bd17-cb6f-4c0b-9a02-2fb7d8c2cc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:34.798249 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357bd17-cb6f-4c0b-9a02-2fb7d8c2cc7f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:34.798676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357bd17-cb6f-4c0b-9a02-2fb7d8c2cc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:34.799011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357bd17-cb6f-4c0b-9a02-2fb7d8c2cc7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:34.807060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357bd17-cb6f-4c0b-9a02-2fb7d8c2cc7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:34.808647 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357bd17-cb6f-4c0b-9a02-2fb7d8c2cc7f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:34.824602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c357bd17-cb6f-4c0b-9a02-2fb7d8c2cc7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:51:34.824602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:34.824602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:34.824602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:34.824602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:34.824602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:34.824602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:34.824602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:34.824602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:34.824602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:34.824602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:34.824602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:34.824602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:51:34.824602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:51:34.824602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:51:34.825701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:51:34.825701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:34.825701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:34.825701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:34.825701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:34.825701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:34.825701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:34.825701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:34.825701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:34.825701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:34.825701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:34.825701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:34.825701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:34.825701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:34.825701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:34.825701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:34.825701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:34.826809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:51:34.826809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:51:34.826809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:51:34.826809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:51:34.826809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:51:34.826809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:51:34.826809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:51:34.826809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:34.826809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 626/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:51:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:51:34.831924 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411184d-9e86-4f4a-aa42-649938f345e0 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:34.945537 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411184d-9e86-4f4a-aa42-649938f345e0 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:34.984466 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32d4dc-3cc1-48ce-a643-43c0de630aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:34.984959 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32d4dc-3cc1-48ce-a643-43c0de630aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:34.985235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32d4dc-3cc1-48ce-a643-43c0de630aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:34.985506 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32d4dc-3cc1-48ce-a643-43c0de630aa6 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:34.986310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32d4dc-3cc1-48ce-a643-43c0de630aa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:34.986615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32d4dc-3cc1-48ce-a643-43c0de630aa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:34.988028 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32d4dc-3cc1-48ce-a643-43c0de630aa6 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:35.000114 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 619/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:51:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:35.006930 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357bd17-cb6f-4c0b-9a02-2fb7d8c2cc7f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:35.128646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357bd17-cb6f-4c0b-9a02-2fb7d8c2cc7f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:35.172741 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e1929-1c03-479e-aa5a-68f921e4a82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:35.173450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e1929-1c03-479e-aa5a-68f921e4a82c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:35.173816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e1929-1c03-479e-aa5a-68f921e4a82c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:35.174035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e1929-1c03-479e-aa5a-68f921e4a82c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:35.174962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e1929-1c03-479e-aa5a-68f921e4a82c None admin] RBAC: Adding query filter params (role.id=382652f08fc24ce39f91164181237006, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=90facf92f97d435dbe8a001759a8fe0c) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:35.175437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e1929-1c03-479e-aa5a-68f921e4a82c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:35.177224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e1929-1c03-479e-aa5a-68f921e4a82c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:35.183949 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 627/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:51:35 2022] GET /identity/v3/role_assignments?user.id=90facf92f97d435dbe8a001759a8fe0c&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=382652f08fc24ce39f91164181237006 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:37.703060 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cef6e7-16eb-4c5c-9fe7-57acee08fc24 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:37.703586 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cef6e7-16eb-4c5c-9fe7-57acee08fc24 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:37.703586 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cef6e7-16eb-4c5c-9fe7-57acee08fc24 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:37.704899 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 620/1247] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:51:37.711098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607f31c-86f6-4c68-9efd-48a17a461b5d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:37.711555 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607f31c-86f6-4c68-9efd-48a17a461b5d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:37.711642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607f31c-86f6-4c68-9efd-48a17a461b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:37.717206 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:37.731273 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4607f31c-86f6-4c68-9efd-48a17a461b5d None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:51:37.732662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4607f31c-86f6-4c68-9efd-48a17a461b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:51:37.809880 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 628/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:51:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:51:37.834214 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cef6e7-16eb-4c5c-9fe7-57acee08fc24 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:37.852193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:37.943732 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cef6e7-16eb-4c5c-9fe7-57acee08fc24 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:37.983619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c81af2-3ab4-4490-8caa-59efc55cfe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:37.984528 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c81af2-3ab4-4490-8caa-59efc55cfe00 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:37.984873 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c81af2-3ab4-4490-8caa-59efc55cfe00 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:37.985157 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c81af2-3ab4-4490-8caa-59efc55cfe00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:37.996263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c81af2-3ab4-4490-8caa-59efc55cfe00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:51:38.004474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-70c81af2-3ab4-4490-8caa-59efc55cfe00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:51:38.004474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:38.004474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:38.004474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:38.004474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:38.004474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:38.004474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:38.004474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:38.004474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:38.004474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:38.004474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:38.004474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:38.004474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:51:38.004474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:51:38.004474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:51:38.004474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:51:38.006073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:51:38.006073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:51:38.006073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:51:38.006073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:51:38.006073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:38.006073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:38.006073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:38.006073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:38.006073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:38.006073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:38.006073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:38.006073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:38.006073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:38.006073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:38.006073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:38.006073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:38.006918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:38.006918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:38.006918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:38.006918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:38.006918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:51:38.006918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:51:38.006918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:51:38.006918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:51:38.006918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:51:38.006918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:51:38.006918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:51:38.006918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:51:38.006918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 621/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:51:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:38.012628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607f31c-86f6-4c68-9efd-48a17a461b5d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:38.121627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607f31c-86f6-4c68-9efd-48a17a461b5d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:38.152696 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:38.158372 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b09f4d-e694-4878-bbc1-f69078daa4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:38.159079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b09f4d-e694-4878-bbc1-f69078daa4ca None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:38.159364 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b09f4d-e694-4878-bbc1-f69078daa4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:38.159651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b09f4d-e694-4878-bbc1-f69078daa4ca None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:38.160413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b09f4d-e694-4878-bbc1-f69078daa4ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:38.160688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b09f4d-e694-4878-bbc1-f69078daa4ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:38.162717 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b09f4d-e694-4878-bbc1-f69078daa4ca None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:38.171701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 629/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:51:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:38.177635 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c81af2-3ab4-4490-8caa-59efc55cfe00 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:38.256576 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:38.279755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c81af2-3ab4-4490-8caa-59efc55cfe00 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:38.313478 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1b640-8ed6-41de-9f6d-296ff4818ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:38.314289 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1b640-8ed6-41de-9f6d-296ff4818ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:38.314569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1b640-8ed6-41de-9f6d-296ff4818ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:38.314843 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1b640-8ed6-41de-9f6d-296ff4818ad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:38.326290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1b640-8ed6-41de-9f6d-296ff4818ad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:38.327730 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1b640-8ed6-41de-9f6d-296ff4818ad2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:38.344639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-f7c1b640-8ed6-41de-9f6d-296ff4818ad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:38.344639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:38.344639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:38.344639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:38.344639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:38.344639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:38.344639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:38.344639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:38.344639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:38.344639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:38.344639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:38.344639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:38.344639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:51:38.344639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:51:38.344639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:51:38.345762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:51:38.345762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:38.345762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:38.345762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:38.345762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:38.345762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:38.345762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:38.345762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:38.345762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:38.345762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:38.345762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:38.345762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:38.345762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:38.345762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:38.345762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:38.345762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:38.345762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:38.346885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:51:38.346885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:51:38.346885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:38.346885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:51:38.346885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 622/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:38.351829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b09f4d-e694-4878-bbc1-f69078daa4ca None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:38.466870 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b09f4d-e694-4878-bbc1-f69078daa4ca None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:38.501582 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10972361-073e-4673-ab46-a6843f3a5b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:38.502248 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10972361-073e-4673-ab46-a6843f3a5b2a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:38.502526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10972361-073e-4673-ab46-a6843f3a5b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:38.502797 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10972361-073e-4673-ab46-a6843f3a5b2a None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:38.503502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10972361-073e-4673-ab46-a6843f3a5b2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:38.503802 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10972361-073e-4673-ab46-a6843f3a5b2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:38.505230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10972361-073e-4673-ab46-a6843f3a5b2a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:38.517076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 630/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:38.522773 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1b640-8ed6-41de-9f6d-296ff4818ad2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:38.626984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1b640-8ed6-41de-9f6d-296ff4818ad2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:38.655949 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:38.664483 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ebae5-3660-4e8c-a9e9-e3c109e0bd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:38.665307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ebae5-3660-4e8c-a9e9-e3c109e0bd97 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:38.665586 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ebae5-3660-4e8c-a9e9-e3c109e0bd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:38.665849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ebae5-3660-4e8c-a9e9-e3c109e0bd97 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:38.673632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ebae5-3660-4e8c-a9e9-e3c109e0bd97 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:38.675092 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ebae5-3660-4e8c-a9e9-e3c109e0bd97 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:38.690130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-b48ebae5-3660-4e8c-a9e9-e3c109e0bd97 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 21:51:38.690130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:38.690130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:38.690130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:38.690130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:38.690130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:38.690130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:38.690130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:38.690130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:38.690130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:38.690130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:38.690130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:38.690130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:51:38.690130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:51:38.690130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:51:38.690130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:38.691308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:38.693169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:38.693169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:38.693169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:51:38.693169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:51:38.693169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:51:38.693169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:51:38.693169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:51:38.693169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:51:38.693169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 21:51:38.693169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:51:38.693169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 623/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:38.699041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10972361-073e-4673-ab46-a6843f3a5b2a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:38.767689 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:38.813920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10972361-073e-4673-ab46-a6843f3a5b2a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:38.848456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c598ce-a127-4994-a525-346642eb7bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:38.849662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c598ce-a127-4994-a525-346642eb7bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:38.850031 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c598ce-a127-4994-a525-346642eb7bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:38.850237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c598ce-a127-4994-a525-346642eb7bd7 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:38.851075 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c598ce-a127-4994-a525-346642eb7bd7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:38.851379 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c598ce-a127-4994-a525-346642eb7bd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:38.853088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c598ce-a127-4994-a525-346642eb7bd7 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:38.872288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 631/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jun 7 21:51:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:38.878151 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ebae5-3660-4e8c-a9e9-e3c109e0bd97 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:38.984135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ebae5-3660-4e8c-a9e9-e3c109e0bd97 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:39.020713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946ac30-16e0-4eb1-abab-788bb682b3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:39.021283 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946ac30-16e0-4eb1-abab-788bb682b3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:39.021565 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946ac30-16e0-4eb1-abab-788bb682b3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:39.021838 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946ac30-16e0-4eb1-abab-788bb682b3e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:39.080692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:39.094460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946ac30-16e0-4eb1-abab-788bb682b3e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:39.095930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946ac30-16e0-4eb1-abab-788bb682b3e2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:39.211573 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 624/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:51:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 21:51:39.217411 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c598ce-a127-4994-a525-346642eb7bd7 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:39.324490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c598ce-a127-4994-a525-346642eb7bd7 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:39.337576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:39.363642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7b541-66b9-4a67-a685-fa3d87175748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:39.365014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7b541-66b9-4a67-a685-fa3d87175748 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:39.365637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7b541-66b9-4a67-a685-fa3d87175748 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:39.365637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7b541-66b9-4a67-a685-fa3d87175748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:39.376035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7b541-66b9-4a67-a685-fa3d87175748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:39.377489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7b541-66b9-4a67-a685-fa3d87175748 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:39.395129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-25b7b541-66b9-4a67-a685-fa3d87175748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:39.395129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:39.395129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:39.395129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:39.395129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:39.395129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:39.395129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:39.395129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:39.395129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:39.395129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:39.395129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:39.395129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:39.395129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:51:39.395129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:51:39.395129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:51:39.396252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:51:39.396252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:39.396252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:39.396252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:39.396252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:39.396252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:39.396252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:39.396252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:39.396252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:39.396252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:39.396252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:39.396252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:39.396252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:39.396252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:39.396252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:39.396252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:39.396252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:39.397442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:51:39.397442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:51:39.397442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:39.397442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:39.397442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 632/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:39.402073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946ac30-16e0-4eb1-abab-788bb682b3e2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:39.486148 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:39.500299 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946ac30-16e0-4eb1-abab-788bb682b3e2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:39.532097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e2f95-40f6-4076-b4c7-07bf07776e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:39.532743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e2f95-40f6-4076-b4c7-07bf07776e5c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:39.533023 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e2f95-40f6-4076-b4c7-07bf07776e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:39.533297 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e2f95-40f6-4076-b4c7-07bf07776e5c None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:39.534032 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e2f95-40f6-4076-b4c7-07bf07776e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:39.534340 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e2f95-40f6-4076-b4c7-07bf07776e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:39.535694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e2f95-40f6-4076-b4c7-07bf07776e5c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:39.546945 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 625/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:39.553199 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7b541-66b9-4a67-a685-fa3d87175748 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:39.647947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7b541-66b9-4a67-a685-fa3d87175748 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:39.680061 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35d36c-61d9-484d-b8f0-ca5156b2670e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:39.680825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35d36c-61d9-484d-b8f0-ca5156b2670e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:39.681104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35d36c-61d9-484d-b8f0-ca5156b2670e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:39.681376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35d36c-61d9-484d-b8f0-ca5156b2670e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:39.687769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35d36c-61d9-484d-b8f0-ca5156b2670e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:39.689194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35d36c-61d9-484d-b8f0-ca5156b2670e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:39.702537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-2f35d36c-61d9-484d-b8f0-ca5156b2670e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:51:39.702537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:39.702537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:39.702537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:39.702537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:39.702537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:39.702537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:39.702537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:39.702537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:39.702537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:39.702537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:39.702537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:39.702537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:51:39.702537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:51:39.702537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:51:39.703569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:51:39.703569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:39.703569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:39.703569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:39.703569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:39.703569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:39.703569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:39.703569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:39.703569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:39.703569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:39.703569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:39.703569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:39.703569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:39.703569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:39.703569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:39.703569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:39.703569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:39.704678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:51:39.704678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:51:39.704678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:51:39.704678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:51:39.704678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:51:39.704678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:51:39.704678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:51:39.704678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:39.704678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 633/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:51:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 21:51:39.709880 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e2f95-40f6-4076-b4c7-07bf07776e5c None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:39.805037 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e2f95-40f6-4076-b4c7-07bf07776e5c None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:39.836652 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabea6d-172e-45c9-a75a-f08fd02131b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:39.837279 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabea6d-172e-45c9-a75a-f08fd02131b7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:39.837561 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabea6d-172e-45c9-a75a-f08fd02131b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:39.837833 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabea6d-172e-45c9-a75a-f08fd02131b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:39.838633 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabea6d-172e-45c9-a75a-f08fd02131b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:39.838939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabea6d-172e-45c9-a75a-f08fd02131b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:39.840350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabea6d-172e-45c9-a75a-f08fd02131b7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:39.852351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 626/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:51:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:51:39.858411 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35d36c-61d9-484d-b8f0-ca5156b2670e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:39.882997 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:39.954552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35d36c-61d9-484d-b8f0-ca5156b2670e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:39.987237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66806d21-63be-4048-a128-be2566d7db17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:39.987864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66806d21-63be-4048-a128-be2566d7db17 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:39.988144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66806d21-63be-4048-a128-be2566d7db17 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:39.988420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66806d21-63be-4048-a128-be2566d7db17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:39.989239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66806d21-63be-4048-a128-be2566d7db17 None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=90facf92f97d435dbe8a001759a8fe0c) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:39.989543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66806d21-63be-4048-a128-be2566d7db17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:39.990977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66806d21-63be-4048-a128-be2566d7db17 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:39.996202 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 634/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:51:39 2022] GET /identity/v3/role_assignments?user.id=90facf92f97d435dbe8a001759a8fe0c&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=8f58ef9d28494d97a68de20b84355450 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:42.180304 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ac122-1777-424c-a6af-124a8e298755 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:42.180837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ac122-1777-424c-a6af-124a8e298755 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:42.180837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ac122-1777-424c-a6af-124a8e298755 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:42.182256 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 627/1261] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:51:42.187259 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91209c2-409d-4720-ae95-dc7b38ec71ea None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:42.187662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91209c2-409d-4720-ae95-dc7b38ec71ea None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:42.187799 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91209c2-409d-4720-ae95-dc7b38ec71ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:42.204061 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-a91209c2-409d-4720-ae95-dc7b38ec71ea None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:51:42.205214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a91209c2-409d-4720-ae95-dc7b38ec71ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:51:42.269254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 635/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:51:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 21:51:42.291932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ac122-1777-424c-a6af-124a8e298755 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:42.302469 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:42.390476 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ac122-1777-424c-a6af-124a8e298755 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:42.422811 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98055d-d050-440d-9448-4a36788a1128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:42.423583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98055d-d050-440d-9448-4a36788a1128 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:42.423863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98055d-d050-440d-9448-4a36788a1128 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:42.424135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98055d-d050-440d-9448-4a36788a1128 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:42.433829 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98055d-d050-440d-9448-4a36788a1128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:51:42.441294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-bd98055d-d050-440d-9448-4a36788a1128 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:51:42.441294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:42.441294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:42.441294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:42.441294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:42.441294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:42.441294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:42.441294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:42.441294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:42.441294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:42.441294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:42.441294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:42.441294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:51:42.441294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:51:42.441294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:51:42.441294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:51:42.442994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:51:42.442994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:51:42.442994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:51:42.442994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:51:42.442994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:42.442994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:42.442994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:42.442994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:42.442994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:42.442994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:42.442994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:42.442994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:42.442994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:42.442994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:42.442994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:42.442994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:42.443847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:42.443847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:42.443847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:42.443847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:42.443847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:51:42.443847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:51:42.443847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:51:42.443847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:51:42.443847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:51:42.443847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:51:42.443847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:51:42.443847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:51:42.443847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 628/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:51:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:42.448999 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91209c2-409d-4720-ae95-dc7b38ec71ea None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:42.467315 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:42.544715 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91209c2-409d-4720-ae95-dc7b38ec71ea None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:42.577298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1bdba-dd1c-44d2-9427-91c8ee60de26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:42.577964 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1bdba-dd1c-44d2-9427-91c8ee60de26 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:42.578253 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1bdba-dd1c-44d2-9427-91c8ee60de26 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:42.578532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1bdba-dd1c-44d2-9427-91c8ee60de26 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:42.579267 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1bdba-dd1c-44d2-9427-91c8ee60de26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:42.579575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1bdba-dd1c-44d2-9427-91c8ee60de26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:42.580945 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1bdba-dd1c-44d2-9427-91c8ee60de26 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:42.588755 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 636/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:51:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:42.594398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98055d-d050-440d-9448-4a36788a1128 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:42.659291 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:42.690955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98055d-d050-440d-9448-4a36788a1128 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:42.722866 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e59830-37b4-433d-aaa7-2f1e79214e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:42.724155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e59830-37b4-433d-aaa7-2f1e79214e21 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:42.724433 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e59830-37b4-433d-aaa7-2f1e79214e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:42.724702 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e59830-37b4-433d-aaa7-2f1e79214e21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:42.734540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e59830-37b4-433d-aaa7-2f1e79214e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:42.735959 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e59830-37b4-433d-aaa7-2f1e79214e21 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:42.752670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e1e59830-37b4-433d-aaa7-2f1e79214e21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:42.752670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:42.752670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:42.752670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:42.752670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:42.752670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:42.752670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:42.752670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:42.752670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:42.752670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:42.752670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:42.752670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:42.752670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:51:42.752670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:51:42.752670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:51:42.753692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:51:42.753692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:42.753692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:42.753692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:42.753692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:42.753692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:42.753692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:42.753692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:42.753692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:42.753692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:42.753692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:42.753692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:42.753692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:42.753692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:42.753692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:42.753692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:42.753692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:42.754826 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:51:42.754826 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:51:42.754826 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:42.754826 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:51:42.754826 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 629/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:42.759501 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1bdba-dd1c-44d2-9427-91c8ee60de26 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:42.838653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:42.857865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1bdba-dd1c-44d2-9427-91c8ee60de26 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:42.889597 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46ff2b-584c-47d2-8480-9a37586befbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:42.890268 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46ff2b-584c-47d2-8480-9a37586befbf None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:42.890550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46ff2b-584c-47d2-8480-9a37586befbf None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:42.890823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46ff2b-584c-47d2-8480-9a37586befbf None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:42.891538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46ff2b-584c-47d2-8480-9a37586befbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:42.891844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46ff2b-584c-47d2-8480-9a37586befbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:42.893207 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46ff2b-584c-47d2-8480-9a37586befbf None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:42.905102 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 637/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:42.910643 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e59830-37b4-433d-aaa7-2f1e79214e21 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:43.006890 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e59830-37b4-433d-aaa7-2f1e79214e21 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:43.026229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:43.039735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69357053-c706-4fdf-a184-314ab7755706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:43.040510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69357053-c706-4fdf-a184-314ab7755706 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:43.040790 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69357053-c706-4fdf-a184-314ab7755706 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:43.041061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69357053-c706-4fdf-a184-314ab7755706 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:43.047772 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69357053-c706-4fdf-a184-314ab7755706 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:43.049209 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69357053-c706-4fdf-a184-314ab7755706 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:43.063392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-69357053-c706-4fdf-a184-314ab7755706 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 21:51:43.063392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:43.063392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:43.063392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:43.063392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:43.063392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:43.063392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:43.063392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:43.063392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:43.063392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:43.063392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:43.063392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:43.063392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:51:43.063392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:51:43.063392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:51:43.063392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:43.064502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:43.065596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:43.065596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:43.065596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:51:43.065596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:51:43.065596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:51:43.065596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:51:43.065596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:51:43.065596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:51:43.065596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 21:51:43.065596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:51:43.065596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 630/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:43.070749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46ff2b-584c-47d2-8480-9a37586befbf None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:43.172215 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46ff2b-584c-47d2-8480-9a37586befbf None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:43.206576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34a64f-ed16-4522-946d-59969f5771ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:43.207230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34a64f-ed16-4522-946d-59969f5771ad None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:43.207505 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34a64f-ed16-4522-946d-59969f5771ad None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:43.207812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34a64f-ed16-4522-946d-59969f5771ad None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:43.209137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34a64f-ed16-4522-946d-59969f5771ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:43.209442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34a64f-ed16-4522-946d-59969f5771ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:43.210878 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34a64f-ed16-4522-946d-59969f5771ad None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:43.219142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:43.227438 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 638/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jun 7 21:51:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:43.233280 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69357053-c706-4fdf-a184-314ab7755706 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:43.329503 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69357053-c706-4fdf-a184-314ab7755706 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:43.362212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed632f0d-56b8-4cb2-80cd-2bd630c9362d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:43.362994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed632f0d-56b8-4cb2-80cd-2bd630c9362d None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:43.363273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed632f0d-56b8-4cb2-80cd-2bd630c9362d None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:43.363579 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed632f0d-56b8-4cb2-80cd-2bd630c9362d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:43.373802 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed632f0d-56b8-4cb2-80cd-2bd630c9362d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:43.375251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed632f0d-56b8-4cb2-80cd-2bd630c9362d None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:43.392489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-ed632f0d-56b8-4cb2-80cd-2bd630c9362d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:43.392489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:43.392489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:43.392489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:43.392489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:43.392489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:43.392489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:43.392489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:43.392489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:43.392489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:43.392489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:43.392489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:43.392489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:51:43.392489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:51:43.392489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:51:43.393350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:51:43.393350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:43.393350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:43.393350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:43.393350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:43.393350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:43.393350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:43.393350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:43.393350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:43.393350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:43.393350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:43.393350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:43.393350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:43.393350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:43.393350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:43.393350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:43.393350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:43.394287 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:51:43.394287 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:51:43.394287 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:43.394287 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:51:43.394287 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 631/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:43.399250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34a64f-ed16-4522-946d-59969f5771ad None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:43.493639 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34a64f-ed16-4522-946d-59969f5771ad None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:43.525607 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc176ef-32b4-441a-ae0d-897bd691b2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:43.526264 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc176ef-32b4-441a-ae0d-897bd691b2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:43.526541 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc176ef-32b4-441a-ae0d-897bd691b2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:43.526809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc176ef-32b4-441a-ae0d-897bd691b2e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:43.527511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc176ef-32b4-441a-ae0d-897bd691b2e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:43.527812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc176ef-32b4-441a-ae0d-897bd691b2e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:43.529155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc176ef-32b4-441a-ae0d-897bd691b2e8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:43.539888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 639/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:43.545264 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed632f0d-56b8-4cb2-80cd-2bd630c9362d None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:43.575943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:43.641628 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed632f0d-56b8-4cb2-80cd-2bd630c9362d None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:43.673353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c15c90-d9a9-4f3a-a810-e11287daa9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:43.674141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c15c90-d9a9-4f3a-a810-e11287daa9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:43.674428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c15c90-d9a9-4f3a-a810-e11287daa9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:43.674699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c15c90-d9a9-4f3a-a810-e11287daa9f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:43.681571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c15c90-d9a9-4f3a-a810-e11287daa9f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:43.683085 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c15c90-d9a9-4f3a-a810-e11287daa9f2 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:43.696872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-14c15c90-d9a9-4f3a-a810-e11287daa9f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:51:43.696872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:43.696872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:43.696872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:43.696872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:43.696872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:43.696872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:43.696872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:43.696872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:43.696872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:43.696872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:43.696872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:43.696872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:51:43.696872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:51:43.696872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:51:43.698030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:51:43.698030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:43.698030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:43.698030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:43.698030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:43.698030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:43.698030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:43.698030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:43.698030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:43.698030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:43.698030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:43.698030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:43.698030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:43.698030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:43.698030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:43.698030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:43.698030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:43.698993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:51:43.698993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:51:43.698993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:51:43.698993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:51:43.698993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:51:43.698993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:51:43.698993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:51:43.698993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:51:43.698993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 632/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:51:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:43.703613 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc176ef-32b4-441a-ae0d-897bd691b2e8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:43.760989 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:43.801342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc176ef-32b4-441a-ae0d-897bd691b2e8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:43.833577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec500b-0f43-4bf9-b826-1c7827ccb8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:43.834245 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec500b-0f43-4bf9-b826-1c7827ccb8ea None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:43.834532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec500b-0f43-4bf9-b826-1c7827ccb8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:43.834811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec500b-0f43-4bf9-b826-1c7827ccb8ea None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:43.835586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec500b-0f43-4bf9-b826-1c7827ccb8ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:43.835898 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec500b-0f43-4bf9-b826-1c7827ccb8ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:43.837321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec500b-0f43-4bf9-b826-1c7827ccb8ea None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:43.849389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 640/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:51:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:43.855550 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c15c90-d9a9-4f3a-a810-e11287daa9f2 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:43.944668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:43.953761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c15c90-d9a9-4f3a-a810-e11287daa9f2 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:43.986403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7736c17-17d0-4f51-a619-961af6a78200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:43.987258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7736c17-17d0-4f51-a619-961af6a78200 None admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:43.987536 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7736c17-17d0-4f51-a619-961af6a78200 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:43.987807 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7736c17-17d0-4f51-a619-961af6a78200 None admin] PATH_INFO: `/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/90facf92f97d435dbe8a001759a8fe0c/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:43.990258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7736c17-17d0-4f51-a619-961af6a78200 None admin] RBAC: Authorizing `identity:create_grant(project_id=eca8f481deb242789622ebb10aa2c5da, user_id=90facf92f97d435dbe8a001759a8fe0c, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:43.991669 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7736c17-17d0-4f51-a619-961af6a78200 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:44.004460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 633/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 7 21:51:43 2022] PUT /identity/v3/projects/eca8f481deb242789622ebb10aa2c5da/users/90facf92f97d435dbe8a001759a8fe0c/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 21:51:46.204829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bfff7-4056-4f06-83e1-4e54a95efe83 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:46.205361 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bfff7-4056-4f06-83e1-4e54a95efe83 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:46.205361 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bfff7-4056-4f06-83e1-4e54a95efe83 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:46.206760 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 641/1274] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:51:46.211888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffa0f8-a714-4846-bd6b-3eee21d4ac48 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:46.212264 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffa0f8-a714-4846-bd6b-3eee21d4ac48 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:46.212450 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffa0f8-a714-4846-bd6b-3eee21d4ac48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:46.229519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-23ffa0f8-a714-4846-bd6b-3eee21d4ac48 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:51:46.230728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-23ffa0f8-a714-4846-bd6b-3eee21d4ac48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:51:46.294813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 634/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:51:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:51:46.318404 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bfff7-4056-4f06-83e1-4e54a95efe83 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:46.417844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bfff7-4056-4f06-83e1-4e54a95efe83 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:46.434173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:46.450385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fb9c8-2bf6-4dc3-bf5b-78468155128b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:46.451160 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb9c8-2bf6-4dc3-bf5b-78468155128b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:46.451442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb9c8-2bf6-4dc3-bf5b-78468155128b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:46.451715 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb9c8-2bf6-4dc3-bf5b-78468155128b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:46.462015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fb9c8-2bf6-4dc3-bf5b-78468155128b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 21:51:46.469426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-328fb9c8-2bf6-4dc3-bf5b-78468155128b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:51:46.469426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:46.469426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:46.469426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:46.469426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:46.469426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:46.469426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:46.469426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:46.469426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:46.469426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:46.469426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:46.469426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:46.469426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 21:51:46.469426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 21:51:46.469426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 21:51:46.469426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 21:51:46.470499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 21:51:46.470499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 21:51:46.470499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 21:51:46.470499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 21:51:46.470499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:46.470499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:46.470499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:46.470499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:46.470499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:46.470499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:46.470499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:46.470499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:46.470499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:46.470499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:46.470499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:46.470499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:46.471525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:46.471525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:46.471525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:46.471525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:46.471525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 21:51:46.471525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 21:51:46.471525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 21:51:46.471525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 21:51:46.471525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 21:51:46.471525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 21:51:46.471525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 21:51:46.471525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:46.471525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 642/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 7 21:51:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:46.477123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffa0f8-a714-4846-bd6b-3eee21d4ac48 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:46.553910 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:46.572045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffa0f8-a714-4846-bd6b-3eee21d4ac48 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:46.604700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e15d4-bff9-4c26-b92a-641b3ede68b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:46.605349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e15d4-bff9-4c26-b92a-641b3ede68b5 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:46.605639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e15d4-bff9-4c26-b92a-641b3ede68b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:46.605917 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e15d4-bff9-4c26-b92a-641b3ede68b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:46.606684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e15d4-bff9-4c26-b92a-641b3ede68b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:46.606994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e15d4-bff9-4c26-b92a-641b3ede68b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:46.608351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e15d4-bff9-4c26-b92a-641b3ede68b5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:46.616740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 635/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 7 21:51:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:46.622182 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fb9c8-2bf6-4dc3-bf5b-78468155128b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:46.718165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fb9c8-2bf6-4dc3-bf5b-78468155128b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:46.749996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ceb6b1-cf7d-4e28-b000-9735cca20b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:46.750756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceb6b1-cf7d-4e28-b000-9735cca20b1a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:46.751034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceb6b1-cf7d-4e28-b000-9735cca20b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:46.751303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceb6b1-cf7d-4e28-b000-9735cca20b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:46.761953 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ceb6b1-cf7d-4e28-b000-9735cca20b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:46.763372 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ceb6b1-cf7d-4e28-b000-9735cca20b1a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:46.779618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-b3ceb6b1-cf7d-4e28-b000-9735cca20b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:46.779618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:46.779618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:46.779618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:46.779618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:46.779618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:46.779618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:46.779618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:46.779618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:46.779618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:46.779618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:46.779618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:46.779618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:51:46.779618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:51:46.779618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:51:46.780621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:51:46.780621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:46.780621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:46.780621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:46.780621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:46.780621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:46.780621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:46.780621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:46.780621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:46.780621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:46.780621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:46.780621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:46.780621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:46.780621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:46.780621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:46.780621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:46.780621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:46.781563 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:51:46.781563 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:51:46.781563 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:46.781563 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:46.781563 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 643/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:46.786900 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e15d4-bff9-4c26-b92a-641b3ede68b5 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:46.900499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e15d4-bff9-4c26-b92a-641b3ede68b5 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:46.940816 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53445a5-c0ef-4872-8797-f55aa9d63335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:46.941458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53445a5-c0ef-4872-8797-f55aa9d63335 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:46.941736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53445a5-c0ef-4872-8797-f55aa9d63335 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:46.942034 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53445a5-c0ef-4872-8797-f55aa9d63335 None admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:46.942771 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53445a5-c0ef-4872-8797-f55aa9d63335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:46.943071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53445a5-c0ef-4872-8797-f55aa9d63335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:46.944422 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53445a5-c0ef-4872-8797-f55aa9d63335 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:46.959519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 636/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:46.965152 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ceb6b1-cf7d-4e28-b000-9735cca20b1a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:46.996205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:47.062627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ceb6b1-cf7d-4e28-b000-9735cca20b1a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:47.094201 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b3bef-c406-4f20-b0bd-55b9656bfc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:47.094981 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b3bef-c406-4f20-b0bd-55b9656bfc85 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:47.095256 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b3bef-c406-4f20-b0bd-55b9656bfc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:47.095522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b3bef-c406-4f20-b0bd-55b9656bfc85 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:47.103537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b3bef-c406-4f20-b0bd-55b9656bfc85 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:47.104973 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b3bef-c406-4f20-b0bd-55b9656bfc85 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:47.123009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-d30b3bef-c406-4f20-b0bd-55b9656bfc85 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 21:51:47.123009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:47.123009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:47.123009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:47.123009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:47.123009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:47.123009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:47.123009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:47.123009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:47.123009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:47.123009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:47.123009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:47.123009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 21:51:47.123009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 21:51:47.123009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 21:51:47.123009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:47.124044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:47.125269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:47.125269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:47.125269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 21:51:47.125269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 21:51:47.125269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 21:51:47.125269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 21:51:47.125269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 21:51:47.125269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 21:51:47.125269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 21:51:47.125269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:47.125269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 644/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:47.130966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53445a5-c0ef-4872-8797-f55aa9d63335 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:47.137796 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:47.239988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53445a5-c0ef-4872-8797-f55aa9d63335 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:47.272970 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da776b9-252f-49f3-a160-9d5df114bade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:47.273562 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da776b9-252f-49f3-a160-9d5df114bade None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:47.273843 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da776b9-252f-49f3-a160-9d5df114bade None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:47.274146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da776b9-252f-49f3-a160-9d5df114bade None admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:47.274974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da776b9-252f-49f3-a160-9d5df114bade None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:47.275283 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da776b9-252f-49f3-a160-9d5df114bade None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:47.276711 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da776b9-252f-49f3-a160-9d5df114bade None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:47.294387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 637/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jun 7 21:51:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:47.300156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b3bef-c406-4f20-b0bd-55b9656bfc85 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:47.389287 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:47.399498 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b3bef-c406-4f20-b0bd-55b9656bfc85 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:47.432194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046483a-6df0-4e73-97af-0cdace0fd202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:47.432823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046483a-6df0-4e73-97af-0cdace0fd202 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:47.433101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046483a-6df0-4e73-97af-0cdace0fd202 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:47.433370 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046483a-6df0-4e73-97af-0cdace0fd202 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:47.498067 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046483a-6df0-4e73-97af-0cdace0fd202 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:47.499505 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046483a-6df0-4e73-97af-0cdace0fd202 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:47.583841 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:47.594160 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 645/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 7 21:51:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 07 21:51:47.599893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da776b9-252f-49f3-a160-9d5df114bade None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:47.659594 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:47.698422 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da776b9-252f-49f3-a160-9d5df114bade None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:47.735388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0159c60-6702-4cf4-b146-ed94c8946326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:47.736175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0159c60-6702-4cf4-b146-ed94c8946326 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:47.736454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0159c60-6702-4cf4-b146-ed94c8946326 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:47.736731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0159c60-6702-4cf4-b146-ed94c8946326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:47.747619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0159c60-6702-4cf4-b146-ed94c8946326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:47.749045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0159c60-6702-4cf4-b146-ed94c8946326 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:47.766175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-e0159c60-6702-4cf4-b146-ed94c8946326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:47.766175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:47.766175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:47.766175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:47.766175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:47.766175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:47.766175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:47.766175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:47.766175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:47.766175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:47.766175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:47.766175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:47.766175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 21:51:47.766175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 21:51:47.766175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 21:51:47.767223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 21:51:47.767223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:47.767223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:47.767223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:47.767223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:47.767223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:47.767223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:47.767223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:47.767223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:47.767223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:47.767223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:47.767223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:47.767223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:47.767223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:47.767223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:47.767223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:47.767223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:47.768166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 21:51:47.768166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 21:51:47.768166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 21:51:47.768166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:51:47.768166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 638/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:47.773061 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046483a-6df0-4e73-97af-0cdace0fd202 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:47.868565 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046483a-6df0-4e73-97af-0cdace0fd202 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:47.901312 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983550c-dac4-4ef3-a6e2-8faa63fc6c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:47.901954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983550c-dac4-4ef3-a6e2-8faa63fc6c8b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:47.902239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983550c-dac4-4ef3-a6e2-8faa63fc6c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:47.902509 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983550c-dac4-4ef3-a6e2-8faa63fc6c8b None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:47.903206 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983550c-dac4-4ef3-a6e2-8faa63fc6c8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:47.903505 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983550c-dac4-4ef3-a6e2-8faa63fc6c8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:47.904854 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983550c-dac4-4ef3-a6e2-8faa63fc6c8b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:47.916109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 646/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 7 21:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:47.921494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0159c60-6702-4cf4-b146-ed94c8946326 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:48.014398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0159c60-6702-4cf4-b146-ed94c8946326 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:48.027924 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:48.047426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c131a6-129a-4912-95f0-68ff8ef5da88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:48.048186 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c131a6-129a-4912-95f0-68ff8ef5da88 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:48.048460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c131a6-129a-4912-95f0-68ff8ef5da88 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:48.048726 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c131a6-129a-4912-95f0-68ff8ef5da88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:48.055114 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c131a6-129a-4912-95f0-68ff8ef5da88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:48.056518 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c131a6-129a-4912-95f0-68ff8ef5da88 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:48.069572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application [None req-99c131a6-129a-4912-95f0-68ff8ef5da88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:51:48.069572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:48.069572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:48.069572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:48.069572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:48.069572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:48.069572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:48.069572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:48.069572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:48.069572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:48.069572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:48.069572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:48.069572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 21:51:48.069572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 21:51:48.069572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 21:51:48.070609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 21:51:48.070609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:48.070609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:48.070609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:48.070609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:48.070609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:48.070609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:48.070609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:48.070609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:48.070609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:48.070609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:48.070609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:48.070609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:48.070609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:48.070609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:48.070609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:48.070609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:48.071721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 21:51:48.071721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 21:51:48.071721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 21:51:48.071721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 21:51:48.071721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 21:51:48.071721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 21:51:48.071721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 21:51:48.071721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: ERROR keystone.server.flask.application Jun 07 21:51:48.071721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 639/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 7 21:51:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:48.076357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983550c-dac4-4ef3-a6e2-8faa63fc6c8b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:48.128668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:48.177148 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983550c-dac4-4ef3-a6e2-8faa63fc6c8b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:48.209244 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd99318-5785-46cb-9db7-b469c441112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:48.209886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd99318-5785-46cb-9db7-b469c441112a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:48.210200 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd99318-5785-46cb-9db7-b469c441112a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:48.210474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd99318-5785-46cb-9db7-b469c441112a None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:48.211242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd99318-5785-46cb-9db7-b469c441112a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:48.211548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd99318-5785-46cb-9db7-b469c441112a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:48.212973 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd99318-5785-46cb-9db7-b469c441112a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:48.225055 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 647/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 7 21:51:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:48.231265 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c131a6-129a-4912-95f0-68ff8ef5da88 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:48.325941 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c131a6-129a-4912-95f0-68ff8ef5da88 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:48.357837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c5866-39df-427d-9f31-f4bb14a10f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:48.358495 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c5866-39df-427d-9f31-f4bb14a10f63 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:48.358770 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c5866-39df-427d-9f31-f4bb14a10f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:48.359038 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c5866-39df-427d-9f31-f4bb14a10f63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:48.359888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c5866-39df-427d-9f31-f4bb14a10f63 None admin] RBAC: Adding query filter params (role.id=8f58ef9d28494d97a68de20b84355450, scope.project.id=eca8f481deb242789622ebb10aa2c5da, user.id=90facf92f97d435dbe8a001759a8fe0c) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:48.360195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c5866-39df-427d-9f31-f4bb14a10f63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:48.361603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c5866-39df-427d-9f31-f4bb14a10f63 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:48.367364 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 640/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 7 21:51:48 2022] GET /identity/v3/role_assignments?user.id=90facf92f97d435dbe8a001759a8fe0c&scope.project.id=eca8f481deb242789622ebb10aa2c5da&role.id=8f58ef9d28494d97a68de20b84355450 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:50.578855 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace17d88-b817-44e3-9c25-cf0799214b2f None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:50.579402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace17d88-b817-44e3-9c25-cf0799214b2f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:50.579402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace17d88-b817-44e3-9c25-cf0799214b2f None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:50.580740 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 648/1288] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:51:50.586367 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd511d0-d678-41bc-8383-06cbadd585c6 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:50.586772 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd511d0-d678-41bc-8383-06cbadd585c6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:50.586921 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd511d0-d678-41bc-8383-06cbadd585c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:50.603472 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-afd511d0-d678-41bc-8383-06cbadd585c6 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:51:50.604623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-afd511d0-d678-41bc-8383-06cbadd585c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:51:50.632768 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:50.668583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 641/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:51:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:51:50.690111 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace17d88-b817-44e3-9c25-cf0799214b2f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:50.787227 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace17d88-b817-44e3-9c25-cf0799214b2f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:50.797320 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:50.820182 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa2246-08db-4d9b-be32-5c9f1a0fd899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:50.820946 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa2246-08db-4d9b-be32-5c9f1a0fd899 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:50.821221 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa2246-08db-4d9b-be32-5c9f1a0fd899 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:50.821491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa2246-08db-4d9b-be32-5c9f1a0fd899 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:50.822159 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa2246-08db-4d9b-be32-5c9f1a0fd899 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:50.823511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa2246-08db-4d9b-be32-5c9f1a0fd899 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:50.835453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-b5aa2246-08db-4d9b-be32-5c9f1a0fd899 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 21:51:50.835453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:50.835453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:51:50.835453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:51:50.835453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:51:50.835453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:51:50.835453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:51:50.835453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:51:50.835453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 21:51:50.835453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:50.835453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:51:50.835453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:50.835453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:50.835453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:50.835453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:50.835453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:50.835453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:50.836624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:50.836624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:50.836624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:50.836624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:50.836624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:50.836624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:50.836624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:51:50.836624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:51:50.836624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:51:50.836624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:51:50.836624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:50.836624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:50.836624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:50.836624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:50.836624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:50.836624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:50.837496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:50.837496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:50.837496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:50.837496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:50.837496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:50.837496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:50.837496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:50.837496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:50.837496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:50.837496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:50.837496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:51:50.837496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:51:50.837496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 21:51:50.837496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:50.837496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 649/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 7 21:51:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:50.842362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd511d0-d678-41bc-8383-06cbadd585c6 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:50.935948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd511d0-d678-41bc-8383-06cbadd585c6 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:50.967842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919f5c6-72ed-465c-8865-253a5b8a173c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:50.968477 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919f5c6-72ed-465c-8865-253a5b8a173c None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:50.968755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919f5c6-72ed-465c-8865-253a5b8a173c None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:50.969024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919f5c6-72ed-465c-8865-253a5b8a173c None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:50.969721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919f5c6-72ed-465c-8865-253a5b8a173c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:50.970050 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919f5c6-72ed-465c-8865-253a5b8a173c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:50.971386 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919f5c6-72ed-465c-8865-253a5b8a173c None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:50.976028 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 642/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jun 7 21:51:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:50.981578 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa2246-08db-4d9b-be32-5c9f1a0fd899 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:51.077520 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa2246-08db-4d9b-be32-5c9f1a0fd899 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:51.110622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f6cf2-dae8-4171-b91f-dcdcd5247352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:51.111436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f6cf2-dae8-4171-b91f-dcdcd5247352 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:51.111868 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f6cf2-dae8-4171-b91f-dcdcd5247352 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:51.112155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f6cf2-dae8-4171-b91f-dcdcd5247352 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:51.113026 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f6cf2-dae8-4171-b91f-dcdcd5247352 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:51.113458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f6cf2-dae8-4171-b91f-dcdcd5247352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:51.115698 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f6cf2-dae8-4171-b91f-dcdcd5247352 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:51.121763 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 650/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jun 7 21:51:50 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:53.299204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713a19a-7ff7-45f2-b818-a52081feae1c None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:53.299812 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713a19a-7ff7-45f2-b818-a52081feae1c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:53.299812 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713a19a-7ff7-45f2-b818-a52081feae1c None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:53.301127 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 643/1293] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:51:53.306669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dac69-229a-4634-acfc-0771376f9cfa None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:53.307053 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dac69-229a-4634-acfc-0771376f9cfa None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:53.307218 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dac69-229a-4634-acfc-0771376f9cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:53.323981 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-9b0dac69-229a-4634-acfc-0771376f9cfa None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:51:53.325130 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9b0dac69-229a-4634-acfc-0771376f9cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:51:53.353401 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:53.391880 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 651/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:51:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:51:53.414463 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713a19a-7ff7-45f2-b818-a52081feae1c None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:53.445306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:53.514168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713a19a-7ff7-45f2-b818-a52081feae1c None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:53.547025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4633e-da4b-4da9-b700-4a55ae7d66f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:53.547672 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4633e-da4b-4da9-b700-4a55ae7d66f5 None admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:53.547955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4633e-da4b-4da9-b700-4a55ae7d66f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:53.548229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4633e-da4b-4da9-b700-4a55ae7d66f5 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:53.548940 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4633e-da4b-4da9-b700-4a55ae7d66f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:53.550388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4633e-da4b-4da9-b700-4a55ae7d66f5 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:53.564049 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 644/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 7 21:51:53 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:51:55.772121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3f314-faae-439b-b084-f136683bc5ff None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:55.772621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3f314-faae-439b-b084-f136683bc5ff None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:55.772621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3f314-faae-439b-b084-f136683bc5ff None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:55.773982 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 652/1296] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:51:55.779038 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed5e66-8905-4910-bf2f-fb56d066347c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:55.779485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed5e66-8905-4910-bf2f-fb56d066347c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:55.779592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed5e66-8905-4910-bf2f-fb56d066347c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:55.797219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4eed5e66-8905-4910-bf2f-fb56d066347c None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:51:55.798436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4eed5e66-8905-4910-bf2f-fb56d066347c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:51:55.868132 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 645/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:51:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:51:55.890084 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3f314-faae-439b-b084-f136683bc5ff None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:55.988433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3f314-faae-439b-b084-f136683bc5ff None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:56.021421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b20ac4-7f94-430b-8d5c-7e22e2274b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:56.022274 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b20ac4-7f94-430b-8d5c-7e22e2274b0e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:56.022508 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b20ac4-7f94-430b-8d5c-7e22e2274b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:56.022781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b20ac4-7f94-430b-8d5c-7e22e2274b0e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:56.023428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b20ac4-7f94-430b-8d5c-7e22e2274b0e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:56.024787 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b20ac4-7f94-430b-8d5c-7e22e2274b0e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:56.037000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-99b20ac4-7f94-430b-8d5c-7e22e2274b0e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 21:51:56.037000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:56.037000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:51:56.037000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:51:56.037000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:51:56.037000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:51:56.037000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:51:56.037000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:51:56.037000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 21:51:56.037000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:56.037000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:51:56.037000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:56.037000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:56.037000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:56.037000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:56.037000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:56.037000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:56.038184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:56.038184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:56.038184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:56.038184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:56.038184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:56.038184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:56.038184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:51:56.038184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:51:56.038184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:51:56.038184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:51:56.038184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:56.038184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:56.038184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:56.038184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:56.038184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:56.038184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:56.039247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:56.039247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:56.039247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:56.039247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:56.039247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:56.039247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:56.039247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:56.039247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:56.039247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:56.039247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:56.039247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:51:56.039247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:51:56.039247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 21:51:56.039247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:56.039247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 653/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 7 21:51:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:56.044121 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed5e66-8905-4910-bf2f-fb56d066347c None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:56.062423 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:56.144934 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed5e66-8905-4910-bf2f-fb56d066347c None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:56.180776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452e865-abf9-4546-a92b-048173a418f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:56.181426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452e865-abf9-4546-a92b-048173a418f7 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:56.181708 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452e865-abf9-4546-a92b-048173a418f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:56.182007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452e865-abf9-4546-a92b-048173a418f7 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:56.182709 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452e865-abf9-4546-a92b-048173a418f7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:56.183011 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452e865-abf9-4546-a92b-048173a418f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:56.184370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452e865-abf9-4546-a92b-048173a418f7 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:56.189356 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 646/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jun 7 21:51:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:56.195466 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b20ac4-7f94-430b-8d5c-7e22e2274b0e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:56.227035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:56.292584 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b20ac4-7f94-430b-8d5c-7e22e2274b0e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:56.323866 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330354a-8d1d-479e-bea2-a03f7ba8c56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:56.324498 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330354a-8d1d-479e-bea2-a03f7ba8c56f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:56.324778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330354a-8d1d-479e-bea2-a03f7ba8c56f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:56.325052 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330354a-8d1d-479e-bea2-a03f7ba8c56f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:56.325826 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330354a-8d1d-479e-bea2-a03f7ba8c56f None admin] RBAC: Adding query filter params (interface=public, service_id=44ccca4014d74ca6b41bb6d0ac1edb14, region_id=RegionOne) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:56.326169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330354a-8d1d-479e-bea2-a03f7ba8c56f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:56.327522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330354a-8d1d-479e-bea2-a03f7ba8c56f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:56.332368 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 654/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jun 7 21:51:56 2022] GET /identity/v3/endpoints?service_id=44ccca4014d74ca6b41bb6d0ac1edb14&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:56.338309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452e865-abf9-4546-a92b-048173a418f7 None admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:56.418569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:56.435892 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452e865-abf9-4546-a92b-048173a418f7 None admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:56.468093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbfef6-fa26-4e98-a985-38fbf8187d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:56.468744 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbfef6-fa26-4e98-a985-38fbf8187d66 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:56.469030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbfef6-fa26-4e98-a985-38fbf8187d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:56.469306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbfef6-fa26-4e98-a985-38fbf8187d66 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:56.470006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbfef6-fa26-4e98-a985-38fbf8187d66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:56.471365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbfef6-fa26-4e98-a985-38fbf8187d66 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:56.478883 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 647/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 7 21:51:56 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 21:51:58.648359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178a222-ea70-4cd1-b15b-facf82490ec1 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:58.648849 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178a222-ea70-4cd1-b15b-facf82490ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:58.648849 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178a222-ea70-4cd1-b15b-facf82490ec1 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:58.650190 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 655/1302] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:51:58.655227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a453a9e-8a1a-463d-ad6d-aa129c2fd9a5 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:58.655609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a453a9e-8a1a-463d-ad6d-aa129c2fd9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:58.655788 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a453a9e-8a1a-463d-ad6d-aa129c2fd9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:58.672591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4a453a9e-8a1a-463d-ad6d-aa129c2fd9a5 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:51:58.673756 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4a453a9e-8a1a-463d-ad6d-aa129c2fd9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:51:58.737913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 648/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:51:58 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 21:51:58.760500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178a222-ea70-4cd1-b15b-facf82490ec1 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:58.851519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:58.858855 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178a222-ea70-4cd1-b15b-facf82490ec1 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:58.890833 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7769b4-6b3d-4466-a99e-f56030bcd674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:58.891599 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7769b4-6b3d-4466-a99e-f56030bcd674 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:58.891874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7769b4-6b3d-4466-a99e-f56030bcd674 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:58.892142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7769b4-6b3d-4466-a99e-f56030bcd674 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:58.892775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7769b4-6b3d-4466-a99e-f56030bcd674 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:58.894144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7769b4-6b3d-4466-a99e-f56030bcd674 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:58.906257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-3c7769b4-6b3d-4466-a99e-f56030bcd674 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 21:51:58.906257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:58.906257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 21:51:58.906257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 21:51:58.906257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 21:51:58.906257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 21:51:58.906257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 21:51:58.906257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:51:58.906257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 21:51:58.906257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:58.906257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 21:51:58.906257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:58.906257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 21:51:58.906257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 21:51:58.906257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 21:51:58.906257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 21:51:58.906257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 21:51:58.907409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 21:51:58.907409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 21:51:58.907409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 21:51:58.907409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 21:51:58.907409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 21:51:58.907409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 21:51:58.907409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 21:51:58.907409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 21:51:58.907409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 21:51:58.907409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 21:51:58.907409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 21:51:58.907409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 21:51:58.907409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 21:51:58.907409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 21:51:58.907409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 21:51:58.907409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 21:51:58.908522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 21:51:58.908522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 07 21:51:58.908522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 21:51:58.908522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 07 21:51:58.908522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 21:51:58.908522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 21:51:58.908522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 21:51:58.908522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 07 21:51:58.908522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 21:51:58.908522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 07 21:51:58.908522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 21:51:58.908522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 21:51:58.908522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 21:51:58.908522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 07 21:51:58.908522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 656/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 7 21:51:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 21:51:58.913206 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a453a9e-8a1a-463d-ad6d-aa129c2fd9a5 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:58.986098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:51:59.008463 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a453a9e-8a1a-463d-ad6d-aa129c2fd9a5 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:59.040693 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c0ca7-4ebe-4640-a34c-fa3980f8d8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:59.041336 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c0ca7-4ebe-4640-a34c-fa3980f8d8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:59.041619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c0ca7-4ebe-4640-a34c-fa3980f8d8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:59.041896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c0ca7-4ebe-4640-a34c-fa3980f8d8a8 None admin] PATH_INFO: `/v3/services` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:59.042631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c0ca7-4ebe-4640-a34c-fa3980f8d8a8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:51:59.042936 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c0ca7-4ebe-4640-a34c-fa3980f8d8a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:59.044284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c0ca7-4ebe-4640-a34c-fa3980f8d8a8 None admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:59.049262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 649/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jun 7 21:51:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:51:59.054730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7769b4-6b3d-4466-a99e-f56030bcd674 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:51:59.150358 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7769b4-6b3d-4466-a99e-f56030bcd674 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:51:59.181852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc3534-f162-449d-ad4d-c9f152960e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:51:59.182443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3534-f162-449d-ad4d-c9f152960e1d None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:51:59.182720 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3534-f162-449d-ad4d-c9f152960e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:51:59.182986 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3534-f162-449d-ad4d-c9f152960e1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:51:59.183704 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc3534-f162-449d-ad4d-c9f152960e1d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:51:59.185043 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc3534-f162-449d-ad4d-c9f152960e1d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:51:59.202905 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 657/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 7 21:51:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:52:09.046682 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=30 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:52:09.198577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:02.040341 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111cfbf-46b4-4fbc-97a4-11affc6ebb4d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:02.040913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111cfbf-46b4-4fbc-97a4-11affc6ebb4d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:02.040913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111cfbf-46b4-4fbc-97a4-11affc6ebb4d None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:02.046216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 650/1307] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:53:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:02.047790 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ce5d9-ffde-4d3c-acb7-57d8cb92c117 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:02.048234 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ce5d9-ffde-4d3c-acb7-57d8cb92c117 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:02.048318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ce5d9-ffde-4d3c-acb7-57d8cb92c117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:02.128328 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b10ce5d9-ffde-4d3c-acb7-57d8cb92c117 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:02.129651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b10ce5d9-ffde-4d3c-acb7-57d8cb92c117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:02.346165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 658/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 21:53:02.411817 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83dcae-7485-4bdf-bcfb-d8f49c9b331e None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:02.412115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83dcae-7485-4bdf-bcfb-d8f49c9b331e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:02.412403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83dcae-7485-4bdf-bcfb-d8f49c9b331e None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:02.413793 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 651/1309] 10.222.0.18 () {54 vars in 964 bytes} [Tue Jun 7 21:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:02.422833 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c14af-0e1d-422e-b399-3c2d8cc9a665 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:02.423355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c14af-0e1d-422e-b399-3c2d8cc9a665 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:02.423822 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c14af-0e1d-422e-b399-3c2d8cc9a665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:02.537996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-671c14af-0e1d-422e-b399-3c2d8cc9a665 None None] MFA Rules not processed for user `aab50bc9064e444184afb1b4c585ce39`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:02.539910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-671c14af-0e1d-422e-b399-3c2d8cc9a665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:02.564097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:02.641716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 659/1310] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Jun 7 21:53:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:53:02.642562 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83dcae-7485-4bdf-bcfb-d8f49c9b331e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:53:02.644376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fe83dcae-7485-4bdf-bcfb-d8f49c9b331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:02.773401 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83dcae-7485-4bdf-bcfb-d8f49c9b331e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:53:02.854726 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c8943-d673-4341-8846-8f103583f0d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:53:02.855635 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c8943-d673-4341-8846-8f103583f0d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:02.856095 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c8943-d673-4341-8846-8f103583f0d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:02.856535 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c8943-d673-4341-8846-8f103583f0d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:02.858337 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7d9c8943-d673-4341-8846-8f103583f0d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:02.914527 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:02.974150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c8943-d673-4341-8846-8f103583f0d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:53:02.975974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c8943-d673-4341-8846-8f103583f0d8 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:53:02.997121 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 652/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:53:05.608899 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a7634-d693-4724-9d8f-f91f4a4c98d8 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:05.609422 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a7634-d693-4724-9d8f-f91f4a4c98d8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:05.609506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a7634-d693-4724-9d8f-f91f4a4c98d8 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:05.615386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 660/1312] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:53:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:05.616837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239e5ff-4260-4e86-9b90-20a928f8569a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:05.617269 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239e5ff-4260-4e86-9b90-20a928f8569a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:05.617400 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239e5ff-4260-4e86-9b90-20a928f8569a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:05.713740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c239e5ff-4260-4e86-9b90-20a928f8569a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:05.714981 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c239e5ff-4260-4e86-9b90-20a928f8569a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:05.819647 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 653/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 21:53:05.858084 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a7634-d693-4724-9d8f-f91f4a4c98d8 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:53:05.859634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-417a7634-d693-4724-9d8f-f91f4a4c98d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:05.965549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a7634-d693-4724-9d8f-f91f4a4c98d8 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:53:06.035828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:06.038498 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb957b-dd3d-43f5-81ae-7190261f6563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:53:06.039333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb957b-dd3d-43f5-81ae-7190261f6563 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:06.039779 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb957b-dd3d-43f5-81ae-7190261f6563 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:06.040247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb957b-dd3d-43f5-81ae-7190261f6563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:06.041876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-38cb957b-dd3d-43f5-81ae-7190261f6563 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:06.150621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb957b-dd3d-43f5-81ae-7190261f6563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:53:06.152060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb957b-dd3d-43f5-81ae-7190261f6563 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:53:06.171521 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 661/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:53:08.713355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3f235-44d1-4724-a154-8a6622701ed2 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:08.713990 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3f235-44d1-4724-a154-8a6622701ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:08.713990 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3f235-44d1-4724-a154-8a6622701ed2 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:08.715298 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 654/1315] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:08.720571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44ec6b-85af-4f37-8548-ce8971258579 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:08.720976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44ec6b-85af-4f37-8548-ce8971258579 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:08.721611 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44ec6b-85af-4f37-8548-ce8971258579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:08.784528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1c44ec6b-85af-4f37-8548-ce8971258579 None None] MFA Rules not processed for user `9bcbcac888534699a368bba89ae10030`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:08.785741 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1c44ec6b-85af-4f37-8548-ce8971258579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:08.842407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:08.892927 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 662/1316] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:53:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:53:08.932886 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3f235-44d1-4724-a154-8a6622701ed2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:53:08.934426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e2c3f235-44d1-4724-a154-8a6622701ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:08.943980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:09.035840 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3f235-44d1-4724-a154-8a6622701ed2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:53:09.105803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f33ea4-18dc-4d33-babd-3be66ed04c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:53:09.106464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f33ea4-18dc-4d33-babd-3be66ed04c3f service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:09.106749 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f33ea4-18dc-4d33-babd-3be66ed04c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:09.107025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f33ea4-18dc-4d33-babd-3be66ed04c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:09.108645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-69f33ea4-18dc-4d33-babd-3be66ed04c3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:09.169771 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:09.214518 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f33ea4-18dc-4d33-babd-3be66ed04c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:53:09.215940 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f33ea4-18dc-4d33-babd-3be66ed04c3f service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:53:09.234503 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 655/1317] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:53:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:53:12.009635 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403e210-00b5-47cc-a481-bb4c0af8d22a None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:12.010201 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403e210-00b5-47cc-a481-bb4c0af8d22a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:12.010201 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403e210-00b5-47cc-a481-bb4c0af8d22a None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:12.011605 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 663/1318] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:12.016839 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a5583-2bf2-4087-a05d-8afb0f93871e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:12.017212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a5583-2bf2-4087-a05d-8afb0f93871e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:12.017398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a5583-2bf2-4087-a05d-8afb0f93871e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:12.080399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-640a5583-2bf2-4087-a05d-8afb0f93871e None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:12.081581 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-640a5583-2bf2-4087-a05d-8afb0f93871e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:12.177296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 656/1319] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:53:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:53:12.231030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e171107-1718-49f1-9691-2a1fcf5ab118 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:12.231311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e171107-1718-49f1-9691-2a1fcf5ab118 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:12.231584 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e171107-1718-49f1-9691-2a1fcf5ab118 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:12.232941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 664/1320] 10.222.0.18 () {54 vars in 964 bytes} [Tue Jun 7 21:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:12.239366 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b94ce1-ef5a-4523-b806-ffed9f4ae77d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:12.239655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b94ce1-ef5a-4523-b806-ffed9f4ae77d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:12.239932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b94ce1-ef5a-4523-b806-ffed9f4ae77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:12.260779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:12.313677 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a4b94ce1-ef5a-4523-b806-ffed9f4ae77d None None] MFA Rules not processed for user `aab50bc9064e444184afb1b4c585ce39`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:12.314919 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a4b94ce1-ef5a-4523-b806-ffed9f4ae77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:12.391023 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 657/1321] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Jun 7 21:53:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:53:12.400050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e171107-1718-49f1-9691-2a1fcf5ab118 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:53:12.401537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9e171107-1718-49f1-9691-2a1fcf5ab118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:12.501254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e171107-1718-49f1-9691-2a1fcf5ab118 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:53:12.570864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6e4e4-358d-4b78-86f3-71797b1cd5e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:53:12.571486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6e4e4-358d-4b78-86f3-71797b1cd5e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:12.571762 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6e4e4-358d-4b78-86f3-71797b1cd5e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:12.572029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6e4e4-358d-4b78-86f3-71797b1cd5e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:12.573598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-30c6e4e4-358d-4b78-86f3-71797b1cd5e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:12.581251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:12.681390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6e4e4-358d-4b78-86f3-71797b1cd5e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:53:12.682842 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6e4e4-358d-4b78-86f3-71797b1cd5e4 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:53:12.700369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 665/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:53:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:53:16.010079 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062c9ec-8e2a-4ac3-9922-642b012cbaf6 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:16.010638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062c9ec-8e2a-4ac3-9922-642b012cbaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:16.010638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062c9ec-8e2a-4ac3-9922-642b012cbaf6 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:16.012003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 658/1323] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:16.017172 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfa073-5f78-4b13-8e02-978ac1eff711 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:16.017558 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfa073-5f78-4b13-8e02-978ac1eff711 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:16.018073 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfa073-5f78-4b13-8e02-978ac1eff711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:16.081653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-eacfa073-5f78-4b13-8e02-978ac1eff711 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:16.082878 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-eacfa073-5f78-4b13-8e02-978ac1eff711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:16.140645 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:16.180781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 666/1324] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:53:16.215855 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062c9ec-8e2a-4ac3-9922-642b012cbaf6 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:53:16.217372 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5062c9ec-8e2a-4ac3-9922-642b012cbaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:16.323001 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062c9ec-8e2a-4ac3-9922-642b012cbaf6 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:53:16.334886 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:16.400430 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d52fbe-daa9-408d-bac4-80d32c18e99b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:53:16.401075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d52fbe-daa9-408d-bac4-80d32c18e99b service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:16.401361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d52fbe-daa9-408d-bac4-80d32c18e99b service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:16.401637 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d52fbe-daa9-408d-bac4-80d32c18e99b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:16.403286 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f4d52fbe-daa9-408d-bac4-80d32c18e99b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:16.512500 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d52fbe-daa9-408d-bac4-80d32c18e99b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:53:16.513918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d52fbe-daa9-408d-bac4-80d32c18e99b service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:53:16.532381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 659/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:53:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:53:18.811688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08be18-8209-41b3-a233-a93ee4cfd8d0 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:18.812204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08be18-8209-41b3-a233-a93ee4cfd8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:18.812204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08be18-8209-41b3-a233-a93ee4cfd8d0 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:18.813508 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 667/1326] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:18.818735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580cb4c-a0e6-44a2-93f0-699547587056 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:18.819149 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580cb4c-a0e6-44a2-93f0-699547587056 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:18.819293 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580cb4c-a0e6-44a2-93f0-699547587056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:18.867468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:18.886545 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-9580cb4c-a0e6-44a2-93f0-699547587056 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:18.887753 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9580cb4c-a0e6-44a2-93f0-699547587056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:19.002871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 660/1327] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:53:19.038286 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08be18-8209-41b3-a233-a93ee4cfd8d0 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:53:19.039862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4f08be18-8209-41b3-a233-a93ee4cfd8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:19.148645 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08be18-8209-41b3-a233-a93ee4cfd8d0 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:53:19.220428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218bf3a-e9d3-4047-b754-09351abd5bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:53:19.221112 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218bf3a-e9d3-4047-b754-09351abd5bda service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:19.221393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218bf3a-e9d3-4047-b754-09351abd5bda service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:19.221667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218bf3a-e9d3-4047-b754-09351abd5bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:19.223336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0218bf3a-e9d3-4047-b754-09351abd5bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:19.239943 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:19.333167 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218bf3a-e9d3-4047-b754-09351abd5bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:53:19.334629 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218bf3a-e9d3-4047-b754-09351abd5bda service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:53:19.354764 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 668/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:53:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:53:21.657084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1afa-1ecc-400d-b8bd-2a30b6aeb2b1 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:21.657601 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1afa-1ecc-400d-b8bd-2a30b6aeb2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:21.657601 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1afa-1ecc-400d-b8bd-2a30b6aeb2b1 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:21.659515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 661/1329] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:53:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:21.664745 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bea418-b5c8-424a-9340-94c64a1d8bf1 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:21.665186 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bea418-b5c8-424a-9340-94c64a1d8bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:21.665313 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bea418-b5c8-424a-9340-94c64a1d8bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:21.730430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e1bea418-b5c8-424a-9340-94c64a1d8bf1 None None] MFA Rules not processed for user `9bcbcac888534699a368bba89ae10030`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:21.731630 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e1bea418-b5c8-424a-9340-94c64a1d8bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:21.795001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:21.828686 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 669/1330] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:53:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:53:21.866724 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e1afa-1ecc-400d-b8bd-2a30b6aeb2b1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:53:21.868243 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-966e1afa-1ecc-400d-b8bd-2a30b6aeb2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:21.972647 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e1afa-1ecc-400d-b8bd-2a30b6aeb2b1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:53:21.992788 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:22.051328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70722de8-fb3e-448f-87a7-01e0bf69b212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:53:22.052027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70722de8-fb3e-448f-87a7-01e0bf69b212 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:22.052306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70722de8-fb3e-448f-87a7-01e0bf69b212 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:22.052578 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70722de8-fb3e-448f-87a7-01e0bf69b212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:22.054236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-70722de8-fb3e-448f-87a7-01e0bf69b212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:22.159198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70722de8-fb3e-448f-87a7-01e0bf69b212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:53:22.160624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70722de8-fb3e-448f-87a7-01e0bf69b212 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:53:22.179084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 662/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:53:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:53:24.653708 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0eec1e-9cd0-4a83-b90d-f31171b89543 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:24.654250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0eec1e-9cd0-4a83-b90d-f31171b89543 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:24.654344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0eec1e-9cd0-4a83-b90d-f31171b89543 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:24.655653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 670/1332] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:24.661538 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b6aae-95e6-45ec-8000-05d1c147dcac None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:24.662035 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b6aae-95e6-45ec-8000-05d1c147dcac None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:24.662127 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b6aae-95e6-45ec-8000-05d1c147dcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:24.727071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:24.730579 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b13b6aae-95e6-45ec-8000-05d1c147dcac None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:24.732221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b13b6aae-95e6-45ec-8000-05d1c147dcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:24.826832 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 663/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:53:24.866436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0eec1e-9cd0-4a83-b90d-f31171b89543 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:53:24.867957 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5a0eec1e-9cd0-4a83-b90d-f31171b89543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:24.972003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0eec1e-9cd0-4a83-b90d-f31171b89543 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:53:25.045777 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6652b-c3c2-434f-bea3-bf545618e226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:53:25.046446 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6652b-c3c2-434f-bea3-bf545618e226 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:25.046730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6652b-c3c2-434f-bea3-bf545618e226 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:25.047004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6652b-c3c2-434f-bea3-bf545618e226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:25.048656 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c6e6652b-c3c2-434f-bea3-bf545618e226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:25.204005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:25.291081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6652b-c3c2-434f-bea3-bf545618e226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:53:25.292526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6652b-c3c2-434f-bea3-bf545618e226 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:53:25.311404 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 671/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:53:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:53:27.607128 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b06ff-1e98-47e1-b151-b6f52bbe207b None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:27.607609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b06ff-1e98-47e1-b151-b6f52bbe207b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:27.607609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b06ff-1e98-47e1-b151-b6f52bbe207b None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:27.608968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 664/1335] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:27.614741 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123624b-f7ce-49cf-935c-16ab28196f54 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:27.615180 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123624b-f7ce-49cf-935c-16ab28196f54 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:27.615275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123624b-f7ce-49cf-935c-16ab28196f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:27.678267 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1123624b-f7ce-49cf-935c-16ab28196f54 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:27.679450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1123624b-f7ce-49cf-935c-16ab28196f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:27.750855 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:27.773375 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 672/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:53:27.812804 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b06ff-1e98-47e1-b151-b6f52bbe207b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:53:27.814453 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-015b06ff-1e98-47e1-b151-b6f52bbe207b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:27.914266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b06ff-1e98-47e1-b151-b6f52bbe207b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:53:27.940928 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:27.984695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0d40d-30df-419c-898b-1305313906a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:53:27.985326 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d40d-30df-419c-898b-1305313906a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:27.985602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d40d-30df-419c-898b-1305313906a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:27.985870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d40d-30df-419c-898b-1305313906a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:27.987507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0bd0d40d-30df-419c-898b-1305313906a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:28.093154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0d40d-30df-419c-898b-1305313906a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:53:28.094603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0d40d-30df-419c-898b-1305313906a8 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:53:28.112474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 665/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:53:30.749457 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f318359-4750-4317-91c3-c1f8eb8f831d None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:30.750035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f318359-4750-4317-91c3-c1f8eb8f831d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:30.750035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f318359-4750-4317-91c3-c1f8eb8f831d None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:30.751397 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 673/1338] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:30.756674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7296949-ab95-423d-8f33-3b57a03bcdde None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:30.757091 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7296949-ab95-423d-8f33-3b57a03bcdde None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:30.757247 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7296949-ab95-423d-8f33-3b57a03bcdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:30.821198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f7296949-ab95-423d-8f33-3b57a03bcdde None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:30.822414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f7296949-ab95-423d-8f33-3b57a03bcdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:30.830989 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:30.917400 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 666/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:53:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:53:30.952614 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f318359-4750-4317-91c3-c1f8eb8f831d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:53:30.954132 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0f318359-4750-4317-91c3-c1f8eb8f831d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:31.054633 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f318359-4750-4317-91c3-c1f8eb8f831d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:53:31.125869 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b90c4-3aa3-4b6c-92a5-06ee4a11634a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:53:31.127060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b90c4-3aa3-4b6c-92a5-06ee4a11634a service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:31.127337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b90c4-3aa3-4b6c-92a5-06ee4a11634a service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:31.127625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b90c4-3aa3-4b6c-92a5-06ee4a11634a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:31.129241 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-719b90c4-3aa3-4b6c-92a5-06ee4a11634a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:31.164556 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:31.236242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b90c4-3aa3-4b6c-92a5-06ee4a11634a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:53:31.237663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b90c4-3aa3-4b6c-92a5-06ee4a11634a service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:53:31.256056 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 674/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:53:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:53:35.348095 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651729f-e399-442c-b678-a8cb26e1815a None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:35.350161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651729f-e399-442c-b678-a8cb26e1815a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:35.350474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651729f-e399-442c-b678-a8cb26e1815a None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:35.352052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 667/1341] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:53:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:35.357537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaa5cc-5790-4648-ba69-9e6a8323842c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:35.358008 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaa5cc-5790-4648-ba69-9e6a8323842c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:35.358106 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaa5cc-5790-4648-ba69-9e6a8323842c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:35.430637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-06eaa5cc-5790-4648-ba69-9e6a8323842c None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:35.431805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-06eaa5cc-5790-4648-ba69-9e6a8323842c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:35.520530 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:35.533938 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 675/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 21:53:35.573334 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651729f-e399-442c-b678-a8cb26e1815a None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:53:35.575810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0651729f-e399-442c-b678-a8cb26e1815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:35.674767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651729f-e399-442c-b678-a8cb26e1815a None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:53:35.678232 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8f4e0-af72-4dba-bb2a-e3e399ab0223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:53:35.678872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8f4e0-af72-4dba-bb2a-e3e399ab0223 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:35.679153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8f4e0-af72-4dba-bb2a-e3e399ab0223 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:35.679425 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8f4e0-af72-4dba-bb2a-e3e399ab0223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:35.688417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8f4e0-af72-4dba-bb2a-e3e399ab0223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:53:35.689884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8f4e0-af72-4dba-bb2a-e3e399ab0223 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:53:35.699268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 668/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:53:38.483519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ab8d9-1ecf-4eb1-8f0a-41a51e422c98 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:38.484079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ab8d9-1ecf-4eb1-8f0a-41a51e422c98 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:38.484079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ab8d9-1ecf-4eb1-8f0a-41a51e422c98 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:38.485405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 676/1344] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:38.490934 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49449ae1-bc5c-4ddd-b05b-bc25d1e09116 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:38.491346 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49449ae1-bc5c-4ddd-b05b-bc25d1e09116 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:38.491639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49449ae1-bc5c-4ddd-b05b-bc25d1e09116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:38.519806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-49449ae1-bc5c-4ddd-b05b-bc25d1e09116 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:38.520915 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-49449ae1-bc5c-4ddd-b05b-bc25d1e09116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:38.547751 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:38.598025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 669/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:53:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:53:38.635242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ab8d9-1ecf-4eb1-8f0a-41a51e422c98 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:53:38.646367 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ab8d9-1ecf-4eb1-8f0a-41a51e422c98 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:53:38.649884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36c1d8-4e0c-4c0e-8089-4ee9be88a673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:53:38.650537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36c1d8-4e0c-4c0e-8089-4ee9be88a673 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:38.650816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36c1d8-4e0c-4c0e-8089-4ee9be88a673 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:38.651088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36c1d8-4e0c-4c0e-8089-4ee9be88a673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:38.659742 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36c1d8-4e0c-4c0e-8089-4ee9be88a673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:53:38.661162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36c1d8-4e0c-4c0e-8089-4ee9be88a673 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:53:38.670349 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 677/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:53:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:53:42.872611 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d68f-11bc-47b3-b973-85c28aed933f None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:42.873142 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d68f-11bc-47b3-b973-85c28aed933f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:42.873142 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d68f-11bc-47b3-b973-85c28aed933f None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:42.874564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 670/1347] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:42.879804 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f2778-6cb5-4b55-8a10-48774879313b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:42.880242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f2778-6cb5-4b55-8a10-48774879313b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:42.880357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f2778-6cb5-4b55-8a10-48774879313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:42.898853 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c48f2778-6cb5-4b55-8a10-48774879313b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:42.900029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c48f2778-6cb5-4b55-8a10-48774879313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:42.908212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 678/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:53:42.944745 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639d68f-11bc-47b3-b973-85c28aed933f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:53:42.955952 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639d68f-11bc-47b3-b973-85c28aed933f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:53:42.959448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a46e2-fe9c-4e1b-a23b-029cdf072b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:53:42.960081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a46e2-fe9c-4e1b-a23b-029cdf072b29 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:42.960364 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a46e2-fe9c-4e1b-a23b-029cdf072b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:42.960640 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a46e2-fe9c-4e1b-a23b-029cdf072b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:42.969446 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a46e2-fe9c-4e1b-a23b-029cdf072b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:53:42.971530 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a46e2-fe9c-4e1b-a23b-029cdf072b29 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:53:42.981269 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 671/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:53:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:53:48.298738 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54822b-4a01-45ad-80b3-fc4b681c41b6 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:48.299227 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54822b-4a01-45ad-80b3-fc4b681c41b6 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:48.299632 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54822b-4a01-45ad-80b3-fc4b681c41b6 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:48.302516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 679/1350] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 7 21:53:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:48.308579 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f80dc-6170-4b50-9b3a-3f422ccc16a4 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:48.309475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f80dc-6170-4b50-9b3a-3f422ccc16a4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:48.309882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f80dc-6170-4b50-9b3a-3f422ccc16a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:48.414468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-972f80dc-6170-4b50-9b3a-3f422ccc16a4 None None] MFA Rules not processed for user `90facf92f97d435dbe8a001759a8fe0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:48.417432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-972f80dc-6170-4b50-9b3a-3f422ccc16a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:48.526345 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 672/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 7 21:53:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 21:53:52.798612 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dd390-0cd0-447b-94c2-1d32a9139e69 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:52.799145 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dd390-0cd0-447b-94c2-1d32a9139e69 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:52.799145 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dd390-0cd0-447b-94c2-1d32a9139e69 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:52.801948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 680/1352] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 7 21:53:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:52.808602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8b762-df67-42fe-8d19-b0c44fa8268a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:52.809483 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8b762-df67-42fe-8d19-b0c44fa8268a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:52.809770 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8b762-df67-42fe-8d19-b0c44fa8268a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:52.829246 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-27d8b762-df67-42fe-8d19-b0c44fa8268a None None] MFA Rules not processed for user `90facf92f97d435dbe8a001759a8fe0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:52.830469 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-27d8b762-df67-42fe-8d19-b0c44fa8268a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:52.839222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 673/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 7 21:53:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:53:52.893443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=13 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:54.404243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127c12-4f42-419e-bfa6-33f3f52cc5a3 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:54.404905 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127c12-4f42-419e-bfa6-33f3f52cc5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:54.404905 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127c12-4f42-419e-bfa6-33f3f52cc5a3 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:54.406152 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 681/1354] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 7 21:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:54.411097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd294599-74c4-4d6e-bd62-6beaee9cbf94 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:54.411502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd294599-74c4-4d6e-bd62-6beaee9cbf94 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:54.411774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd294599-74c4-4d6e-bd62-6beaee9cbf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:54.429601 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-dd294599-74c4-4d6e-bd62-6beaee9cbf94 None None] MFA Rules not processed for user `90facf92f97d435dbe8a001759a8fe0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:54.430941 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-dd294599-74c4-4d6e-bd62-6beaee9cbf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:54.440133 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 674/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 7 21:53:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:53:58.401310 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986659cf-008e-470f-8b18-720c3440df0f None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:58.401843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986659cf-008e-470f-8b18-720c3440df0f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:58.401843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986659cf-008e-470f-8b18-720c3440df0f None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:58.403311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 682/1356] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:58.408545 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1cf07-7aa3-4298-b9de-56f3fe0b78ae None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:58.408972 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1cf07-7aa3-4298-b9de-56f3fe0b78ae None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:58.409396 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1cf07-7aa3-4298-b9de-56f3fe0b78ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:58.428912 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-afe1cf07-7aa3-4298-b9de-56f3fe0b78ae None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:58.430128 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-afe1cf07-7aa3-4298-b9de-56f3fe0b78ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:58.438563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 675/1357] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:53:58.495271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a51895-4b39-407b-9394-f9e94652f1b5 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:58.496378 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a51895-4b39-407b-9394-f9e94652f1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:58.497198 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a51895-4b39-407b-9394-f9e94652f1b5 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:58.499585 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 683/1358] 10.222.0.18 () {54 vars in 961 bytes} [Tue Jun 7 21:53:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:53:58.509236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf6de5-4318-4796-ac03-e052faae1da9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:58.510325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf6de5-4318-4796-ac03-e052faae1da9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:58.511036 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf6de5-4318-4796-ac03-e052faae1da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:58.556783 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:53:58.566281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-25cf6de5-4318-4796-ac03-e052faae1da9 None None] MFA Rules not processed for user `1d5760a3f9f946978b1251d3e2aaa943`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:53:58.567674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-25cf6de5-4318-4796-ac03-e052faae1da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:53:58.652890 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 676/1359] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jun 7 21:53:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 21:53:58.661954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a51895-4b39-407b-9394-f9e94652f1b5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:53:58.676326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a51895-4b39-407b-9394-f9e94652f1b5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:53:58.682331 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88f145-e8e0-4b1a-b7c2-181435f1e16b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:53:58.683072 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88f145-e8e0-4b1a-b7c2-181435f1e16b service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:53:58.683439 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88f145-e8e0-4b1a-b7c2-181435f1e16b service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:53:58.683812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88f145-e8e0-4b1a-b7c2-181435f1e16b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:53:58.692788 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88f145-e8e0-4b1a-b7c2-181435f1e16b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:53:58.694531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88f145-e8e0-4b1a-b7c2-181435f1e16b service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:53:58.704928 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 684/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:53:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:01.182524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46caed-01c6-4e38-b918-beab4520cd4a None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:01.183446 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46caed-01c6-4e38-b918-beab4520cd4a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:01.183924 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46caed-01c6-4e38-b918-beab4520cd4a None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:01.185774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 677/1361] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:54:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:01.190823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498cd87-7230-4f31-869f-84597b1e64c6 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:01.191268 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498cd87-7230-4f31-869f-84597b1e64c6 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:01.191378 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498cd87-7230-4f31-869f-84597b1e64c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:01.210292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d498cd87-7230-4f31-869f-84597b1e64c6 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:01.211475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d498cd87-7230-4f31-869f-84597b1e64c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:01.219828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 685/1362] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:01.264340 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46caed-01c6-4e38-b918-beab4520cd4a None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:01.280265 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46caed-01c6-4e38-b918-beab4520cd4a None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:01.287134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085fec8-3c29-4589-bb00-33dcf9e79808 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:01.287872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085fec8-3c29-4589-bb00-33dcf9e79808 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:01.288156 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085fec8-3c29-4589-bb00-33dcf9e79808 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:01.288430 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085fec8-3c29-4589-bb00-33dcf9e79808 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:01.297984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085fec8-3c29-4589-bb00-33dcf9e79808 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:01.299911 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085fec8-3c29-4589-bb00-33dcf9e79808 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:01.325579 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 678/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:03.873765 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dde2f-8a52-4a16-9b4f-78cb111a731b None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:03.874820 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dde2f-8a52-4a16-9b4f-78cb111a731b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:03.875914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dde2f-8a52-4a16-9b4f-78cb111a731b None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:03.877832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 686/1364] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:54:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:03.883805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3202884-621d-4b7e-9b93-49cb8db28f4b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:03.884691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3202884-621d-4b7e-9b93-49cb8db28f4b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:03.885189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3202884-621d-4b7e-9b93-49cb8db28f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:03.904204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d3202884-621d-4b7e-9b93-49cb8db28f4b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:03.905470 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d3202884-621d-4b7e-9b93-49cb8db28f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:03.913311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 679/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:03.959492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6b85a-943f-4c54-8f59-ddf698971f4d None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:03.959801 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6b85a-943f-4c54-8f59-ddf698971f4d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:03.960115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6b85a-943f-4c54-8f59-ddf698971f4d None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:03.961493 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 687/1366] 10.222.0.18 () {54 vars in 961 bytes} [Tue Jun 7 21:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:03.966781 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776bbeb-9ce2-4633-924b-9e1db34521da None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:03.967068 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776bbeb-9ce2-4633-924b-9e1db34521da None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:03.967361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776bbeb-9ce2-4633-924b-9e1db34521da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:03.986417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a776bbeb-9ce2-4633-924b-9e1db34521da None None] MFA Rules not processed for user `1d5760a3f9f946978b1251d3e2aaa943`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:03.987611 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a776bbeb-9ce2-4633-924b-9e1db34521da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:03.996887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 680/1367] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jun 7 21:54:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 21:54:04.004918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6b85a-943f-4c54-8f59-ddf698971f4d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:04.019238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6b85a-943f-4c54-8f59-ddf698971f4d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:04.024633 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948f525-01af-4574-89a3-dc98d5f2bef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:04.025286 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948f525-01af-4574-89a3-dc98d5f2bef8 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:04.025572 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948f525-01af-4574-89a3-dc98d5f2bef8 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:04.025982 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948f525-01af-4574-89a3-dc98d5f2bef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:04.034789 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948f525-01af-4574-89a3-dc98d5f2bef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:04.036487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948f525-01af-4574-89a3-dc98d5f2bef8 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:04.048206 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 688/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:06.352461 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652364b7-eb6b-4bec-9321-beac3c1a9441 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:06.353570 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652364b7-eb6b-4bec-9321-beac3c1a9441 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:06.354055 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652364b7-eb6b-4bec-9321-beac3c1a9441 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:06.355590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 681/1369] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:06.361549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c5964-6aaf-48e7-b8b8-8225c298880b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:06.362325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c5964-6aaf-48e7-b8b8-8225c298880b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:06.364109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c5964-6aaf-48e7-b8b8-8225c298880b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:06.382496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-801c5964-6aaf-48e7-b8b8-8225c298880b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:06.383679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-801c5964-6aaf-48e7-b8b8-8225c298880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:06.391525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 689/1370] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 21:54:06.442887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652364b7-eb6b-4bec-9321-beac3c1a9441 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:06.457727 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652364b7-eb6b-4bec-9321-beac3c1a9441 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:06.463151 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc24e1-c7d9-4806-8d88-01ea6e8b3fb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:06.463792 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc24e1-c7d9-4806-8d88-01ea6e8b3fb0 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:06.464135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc24e1-c7d9-4806-8d88-01ea6e8b3fb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:06.464419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc24e1-c7d9-4806-8d88-01ea6e8b3fb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:06.473293 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc24e1-c7d9-4806-8d88-01ea6e8b3fb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:06.474942 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc24e1-c7d9-4806-8d88-01ea6e8b3fb0 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:06.485781 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 682/1371] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:06.585488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1ae88-821d-4e77-9375-d19670c3561b None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:06.586136 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1ae88-821d-4e77-9375-d19670c3561b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:06.586508 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1ae88-821d-4e77-9375-d19670c3561b None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:06.588285 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 690/1372] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:06.595670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081922-c9b2-465f-866c-f411682f7a45 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:06.596584 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081922-c9b2-465f-866c-f411682f7a45 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:06.596941 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081922-c9b2-465f-866c-f411682f7a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:06.620524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c2081922-c9b2-465f-866c-f411682f7a45 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:06.622447 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c2081922-c9b2-465f-866c-f411682f7a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:06.633966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 683/1373] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:06.943443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f9164-9e29-4382-b40f-bbb33cd96eb4 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:06.943849 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f9164-9e29-4382-b40f-bbb33cd96eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:06.944324 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f9164-9e29-4382-b40f-bbb33cd96eb4 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:06.946603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 691/1374] 10.222.0.18 () {54 vars in 963 bytes} [Tue Jun 7 21:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:06.951613 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999ba96-167a-46d3-98a8-b0ca04a2eb20 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:06.951909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999ba96-167a-46d3-98a8-b0ca04a2eb20 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:06.952186 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999ba96-167a-46d3-98a8-b0ca04a2eb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:07.003901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1999ba96-167a-46d3-98a8-b0ca04a2eb20 None None] MFA Rules not processed for user `5688ba6551834757b7eeef45a15f16e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:07.005173 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1999ba96-167a-46d3-98a8-b0ca04a2eb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:07.069899 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 684/1375] 10.222.0.18 () {58 vars in 1060 bytes} [Tue Jun 7 21:54:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:07.077382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f9164-9e29-4382-b40f-bbb33cd96eb4 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:07.089321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f9164-9e29-4382-b40f-bbb33cd96eb4 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:07.093158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fc804-c02b-4f03-b96a-8aa520f9895f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:07.093901 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fc804-c02b-4f03-b96a-8aa520f9895f service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:07.094320 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fc804-c02b-4f03-b96a-8aa520f9895f service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:07.094694 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fc804-c02b-4f03-b96a-8aa520f9895f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:07.104868 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fc804-c02b-4f03-b96a-8aa520f9895f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:07.106477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fc804-c02b-4f03-b96a-8aa520f9895f service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:07.116393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 692/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:08.789119 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ad348-99bb-4ee2-9f00-7cd85ecb3d86 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:08.789724 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ad348-99bb-4ee2-9f00-7cd85ecb3d86 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:08.789724 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ad348-99bb-4ee2-9f00-7cd85ecb3d86 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:08.791109 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 685/1377] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:08.796599 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d7d68-4484-4477-82cb-b53d960c6763 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:08.797614 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d7d68-4484-4477-82cb-b53d960c6763 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:08.797808 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d7d68-4484-4477-82cb-b53d960c6763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:08.816843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8e4d7d68-4484-4477-82cb-b53d960c6763 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:08.818119 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8e4d7d68-4484-4477-82cb-b53d960c6763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:08.826525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 693/1378] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:08.873483 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ad348-99bb-4ee2-9f00-7cd85ecb3d86 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:08.888329 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ad348-99bb-4ee2-9f00-7cd85ecb3d86 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:08.894550 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14850cc9-c17d-4afe-8713-7bc16865efba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:08.895217 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14850cc9-c17d-4afe-8713-7bc16865efba service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:08.895504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14850cc9-c17d-4afe-8713-7bc16865efba service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:08.895784 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14850cc9-c17d-4afe-8713-7bc16865efba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:08.905139 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14850cc9-c17d-4afe-8713-7bc16865efba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:08.907417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14850cc9-c17d-4afe-8713-7bc16865efba service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:08.911832 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:54:08.919289 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 686/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:11.215293 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c595e4-b319-4072-8f92-021ef450984e None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:11.215879 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c595e4-b319-4072-8f92-021ef450984e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:11.215879 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c595e4-b319-4072-8f92-021ef450984e None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:11.217400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 694/1380] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:11.223212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e2f56-9cbc-45ce-b6e1-f517937b5096 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:11.223990 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e2f56-9cbc-45ce-b6e1-f517937b5096 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:11.224270 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e2f56-9cbc-45ce-b6e1-f517937b5096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:11.242551 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0c1e2f56-9cbc-45ce-b6e1-f517937b5096 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:11.244094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0c1e2f56-9cbc-45ce-b6e1-f517937b5096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:11.252268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 687/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:11.296679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c595e4-b319-4072-8f92-021ef450984e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:11.311216 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c595e4-b319-4072-8f92-021ef450984e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:11.316669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284e5d6-c707-4ea5-97b1-9b1b96f9fb4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:11.317299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284e5d6-c707-4ea5-97b1-9b1b96f9fb4b service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:11.317593 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284e5d6-c707-4ea5-97b1-9b1b96f9fb4b service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:11.317857 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284e5d6-c707-4ea5-97b1-9b1b96f9fb4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:11.326361 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284e5d6-c707-4ea5-97b1-9b1b96f9fb4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:11.328445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284e5d6-c707-4ea5-97b1-9b1b96f9fb4b service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:11.338390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 695/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:13.611661 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80df9d6-e4f1-4c29-ade4-3b106f442971 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:13.612231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80df9d6-e4f1-4c29-ade4-3b106f442971 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:13.612231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80df9d6-e4f1-4c29-ade4-3b106f442971 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:13.613689 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 688/1383] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:13.619786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79260b91-6b5b-4ca3-b105-fdf856c1b038 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:13.620336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79260b91-6b5b-4ca3-b105-fdf856c1b038 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:13.620336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79260b91-6b5b-4ca3-b105-fdf856c1b038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:13.638859 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-79260b91-6b5b-4ca3-b105-fdf856c1b038 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:13.640034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-79260b91-6b5b-4ca3-b105-fdf856c1b038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:13.648198 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 696/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:13.690174 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80df9d6-e4f1-4c29-ade4-3b106f442971 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:13.704370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80df9d6-e4f1-4c29-ade4-3b106f442971 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:13.709679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27967cf3-3d98-407d-9691-16a7eac00968 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:13.710339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27967cf3-3d98-407d-9691-16a7eac00968 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:13.710620 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27967cf3-3d98-407d-9691-16a7eac00968 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:13.710885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27967cf3-3d98-407d-9691-16a7eac00968 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:13.719808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27967cf3-3d98-407d-9691-16a7eac00968 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:13.721417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27967cf3-3d98-407d-9691-16a7eac00968 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:13.731874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 689/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:16.228792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69956738-cd26-4be9-86d7-ea5e691f8ba7 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:16.229348 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69956738-cd26-4be9-86d7-ea5e691f8ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:16.229348 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69956738-cd26-4be9-86d7-ea5e691f8ba7 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:16.230781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 697/1386] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:16.238229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a0470-888e-4932-8f2e-8371685850f4 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:16.238670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a0470-888e-4932-8f2e-8371685850f4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:16.238926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a0470-888e-4932-8f2e-8371685850f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:16.258055 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-235a0470-888e-4932-8f2e-8371685850f4 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:16.259244 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-235a0470-888e-4932-8f2e-8371685850f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:16.267021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 690/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:16.321371 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69956738-cd26-4be9-86d7-ea5e691f8ba7 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:16.335843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69956738-cd26-4be9-86d7-ea5e691f8ba7 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:16.341204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726eca6-e415-4017-af2d-14ef81bab804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:16.341841 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726eca6-e415-4017-af2d-14ef81bab804 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:16.342152 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726eca6-e415-4017-af2d-14ef81bab804 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:16.342427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726eca6-e415-4017-af2d-14ef81bab804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:16.352146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726eca6-e415-4017-af2d-14ef81bab804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:16.354582 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726eca6-e415-4017-af2d-14ef81bab804 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:16.368337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 698/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:18.688774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643d9dd-cb9d-42f5-8caa-818a88edfa28 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:18.689311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643d9dd-cb9d-42f5-8caa-818a88edfa28 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:18.689311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643d9dd-cb9d-42f5-8caa-818a88edfa28 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:18.690809 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 691/1389] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:54:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:18.696094 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabe754-3022-49e0-bcf2-5a57903a2384 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:18.696497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabe754-3022-49e0-bcf2-5a57903a2384 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:18.696654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabe754-3022-49e0-bcf2-5a57903a2384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:18.715356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8aabe754-3022-49e0-bcf2-5a57903a2384 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:18.716497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8aabe754-3022-49e0-bcf2-5a57903a2384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:18.724295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 699/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:18.796247 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643d9dd-cb9d-42f5-8caa-818a88edfa28 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:18.813325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643d9dd-cb9d-42f5-8caa-818a88edfa28 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:18.819786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053a68d-6aae-4e80-bcd5-70a0f22b4649 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:18.820439 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053a68d-6aae-4e80-bcd5-70a0f22b4649 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:18.820721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053a68d-6aae-4e80-bcd5-70a0f22b4649 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:18.820992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053a68d-6aae-4e80-bcd5-70a0f22b4649 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:18.830647 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053a68d-6aae-4e80-bcd5-70a0f22b4649 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:18.832246 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053a68d-6aae-4e80-bcd5-70a0f22b4649 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:18.842372 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 692/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:21.370408 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c10d08-8af0-4e85-9b8d-dfc7f533800a None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:21.370928 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c10d08-8af0-4e85-9b8d-dfc7f533800a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:21.371035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c10d08-8af0-4e85-9b8d-dfc7f533800a None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:21.372321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 700/1392] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:21.377778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366fae0-e1d8-4f68-a834-32c318cdf05e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:21.378242 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366fae0-e1d8-4f68-a834-32c318cdf05e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:21.378377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366fae0-e1d8-4f68-a834-32c318cdf05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:21.397756 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-9366fae0-e1d8-4f68-a834-32c318cdf05e None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:21.398976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9366fae0-e1d8-4f68-a834-32c318cdf05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:21.407281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 693/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:21.450978 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c10d08-8af0-4e85-9b8d-dfc7f533800a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:21.466508 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c10d08-8af0-4e85-9b8d-dfc7f533800a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:21.471839 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b7c5b-fa5b-45d4-8e7d-9220c1c6946a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:21.472476 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b7c5b-fa5b-45d4-8e7d-9220c1c6946a service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:21.472759 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b7c5b-fa5b-45d4-8e7d-9220c1c6946a service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:21.473033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b7c5b-fa5b-45d4-8e7d-9220c1c6946a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:21.481740 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b7c5b-fa5b-45d4-8e7d-9220c1c6946a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:21.483350 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b7c5b-fa5b-45d4-8e7d-9220c1c6946a service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:21.493175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 701/1394] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:22.906961 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dce378-fdb5-4cc4-8550-3aa9c87caca4 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:22.907544 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dce378-fdb5-4cc4-8550-3aa9c87caca4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:22.907544 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dce378-fdb5-4cc4-8550-3aa9c87caca4 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:22.908885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 694/1395] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:54:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:22.914228 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675178de-79be-4fa5-bc9c-e7fee692e538 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:22.914650 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675178de-79be-4fa5-bc9c-e7fee692e538 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:22.914810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675178de-79be-4fa5-bc9c-e7fee692e538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:22.920960 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=52 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:54:22.933242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-675178de-79be-4fa5-bc9c-e7fee692e538 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:22.934426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-675178de-79be-4fa5-bc9c-e7fee692e538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:22.942054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 702/1396] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:22.997249 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa603700-3a7c-45a7-a6f4-45b9ef7e50dc None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:22.997535 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa603700-3a7c-45a7-a6f4-45b9ef7e50dc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:22.997811 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa603700-3a7c-45a7-a6f4-45b9ef7e50dc None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:22.999488 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 695/1397] 10.222.0.18 () {54 vars in 962 bytes} [Tue Jun 7 21:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:23.004464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8882c2-6e1f-4688-a6df-82ce44656de9 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:23.004813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8882c2-6e1f-4688-a6df-82ce44656de9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:23.005148 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8882c2-6e1f-4688-a6df-82ce44656de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:23.052679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ed8882c2-6e1f-4688-a6df-82ce44656de9 None None] MFA Rules not processed for user `1a3c022963e74e989a703938ff057757`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:23.053846 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ed8882c2-6e1f-4688-a6df-82ce44656de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:23.113066 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 703/1398] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jun 7 21:54:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:23.120721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa603700-3a7c-45a7-a6f4-45b9ef7e50dc None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:23.131503 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa603700-3a7c-45a7-a6f4-45b9ef7e50dc None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:23.135142 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c497cac-63d8-4155-8623-d47b3c13fcc5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a3c022963e74e989a703938ff057757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:23.135845 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497cac-63d8-4155-8623-d47b3c13fcc5 service glance] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:23.136196 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497cac-63d8-4155-8623-d47b3c13fcc5 service glance] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:23.136539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497cac-63d8-4155-8623-d47b3c13fcc5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:23.146337 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c497cac-63d8-4155-8623-d47b3c13fcc5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:23.147835 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c497cac-63d8-4155-8623-d47b3c13fcc5 service glance] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:23.157918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 696/1399] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:23.677912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627881d-ea8c-4994-8536-ee120685a226 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:23.678254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627881d-ea8c-4994-8536-ee120685a226 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:23.678550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627881d-ea8c-4994-8536-ee120685a226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:23.726542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c627881d-ea8c-4994-8536-ee120685a226 None None] MFA Rules not processed for user `4fc55e3a9107489a9b24385ac5379ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:23.727711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c627881d-ea8c-4994-8536-ee120685a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:23.737837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb0bdd-3b10-4fe6-85da-87c651721080 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:23.738156 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb0bdd-3b10-4fe6-85da-87c651721080 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:23.738440 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb0bdd-3b10-4fe6-85da-87c651721080 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:23.739820 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 697/1400] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:54:23.744814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f8de0-e758-4851-9c60-8d7b77c89cc2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:23.745242 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f8de0-e758-4851-9c60-8d7b77c89cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:23.745532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f8de0-e758-4851-9c60-8d7b77c89cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:23.763320 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8d8f8de0-e758-4851-9c60-8d7b77c89cc2 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:23.764603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8d8f8de0-e758-4851-9c60-8d7b77c89cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:23.773014 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 698/1401] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 21:54:23.794551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 704/1402] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 7 21:54:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:23.818644 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f8de0-e758-4851-9c60-8d7b77c89cc2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:23.831864 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f8de0-e758-4851-9c60-8d7b77c89cc2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:23.837286 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbde62-fa51-4f69-80d5-e5a98c158e43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:23.837957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbde62-fa51-4f69-80d5-e5a98c158e43 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:23.838244 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbde62-fa51-4f69-80d5-e5a98c158e43 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:23.838529 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbde62-fa51-4f69-80d5-e5a98c158e43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:23.838815 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0646089-e989-4023-b217-d77271aea47d None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:23.839117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0646089-e989-4023-b217-d77271aea47d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:23.839390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0646089-e989-4023-b217-d77271aea47d None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:23.840800 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 705/1403] 10.222.0.18 () {54 vars in 942 bytes} [Tue Jun 7 21:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:54:23.846742 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d10946-03c3-4da2-be6d-4f25d49cba57 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:23.847160 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d10946-03c3-4da2-be6d-4f25d49cba57 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:23.847438 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d10946-03c3-4da2-be6d-4f25d49cba57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:23.848057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbde62-fa51-4f69-80d5-e5a98c158e43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:23.849722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbde62-fa51-4f69-80d5-e5a98c158e43 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:23.860213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 699/1404] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:23.896904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f5d10946-03c3-4da2-be6d-4f25d49cba57 None None] MFA Rules not processed for user `a4b69c708fbc470aae3e3954e21a1e88`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:23.898127 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f5d10946-03c3-4da2-be6d-4f25d49cba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:23.910833 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:54:23.976206 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 706/1405] 10.222.0.18 () {58 vars in 1039 bytes} [Tue Jun 7 21:54:23 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 21:54:23.987298 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbde62-fa51-4f69-80d5-e5a98c158e43 service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:23.999018 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbde62-fa51-4f69-80d5-e5a98c158e43 service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:24.004315 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c242ed-ed37-4298-bc66-3e3659ed91fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b69c708fbc470aae3e3954e21a1e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:24.005096 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c242ed-ed37-4298-bc66-3e3659ed91fa service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:24.005447 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c242ed-ed37-4298-bc66-3e3659ed91fa service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:24.005792 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c242ed-ed37-4298-bc66-3e3659ed91fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:24.015486 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c242ed-ed37-4298-bc66-3e3659ed91fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:24.017220 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c242ed-ed37-4298-bc66-3e3659ed91fa service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:24.026239 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 700/1406] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 7 21:54:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 21:54:26.168907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa950f01-553b-42e9-9f6f-f2b0769e5293 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:26.169465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa950f01-553b-42e9-9f6f-f2b0769e5293 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:26.169465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa950f01-553b-42e9-9f6f-f2b0769e5293 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:26.170843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 707/1407] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:26.176913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285d4b6-1237-43f2-9f4a-d7daca0fa20a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:26.177461 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285d4b6-1237-43f2-9f4a-d7daca0fa20a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:26.177461 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285d4b6-1237-43f2-9f4a-d7daca0fa20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:26.196703 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-7285d4b6-1237-43f2-9f4a-d7daca0fa20a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:26.197912 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7285d4b6-1237-43f2-9f4a-d7daca0fa20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:26.206454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 701/1408] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:26.256468 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa950f01-553b-42e9-9f6f-f2b0769e5293 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:26.271088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa950f01-553b-42e9-9f6f-f2b0769e5293 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:26.279095 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a376e2f-69f3-4707-a7d7-60eb4c961305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:26.279736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a376e2f-69f3-4707-a7d7-60eb4c961305 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:26.280017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a376e2f-69f3-4707-a7d7-60eb4c961305 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:26.280292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a376e2f-69f3-4707-a7d7-60eb4c961305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:26.289546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a376e2f-69f3-4707-a7d7-60eb4c961305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:26.291158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a376e2f-69f3-4707-a7d7-60eb4c961305 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:26.300550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 708/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:36.193954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=46 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:54:36.296351 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=30 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:54:47.086623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a0cf0-ec2b-44d7-a9b4-d51aae5a98fb None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:47.087241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a0cf0-ec2b-44d7-a9b4-d51aae5a98fb None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:47.087241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a0cf0-ec2b-44d7-a9b4-d51aae5a98fb None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:47.088609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 702/1410] 10.222.0.18 () {54 vars in 918 bytes} [Tue Jun 7 21:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:47.093552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803919b9-03a2-4434-941d-3dbdd0289b84 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:47.094000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803919b9-03a2-4434-941d-3dbdd0289b84 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:47.094122 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803919b9-03a2-4434-941d-3dbdd0289b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:47.112327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-803919b9-03a2-4434-941d-3dbdd0289b84 None None] MFA Rules not processed for user `90facf92f97d435dbe8a001759a8fe0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:47.113534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-803919b9-03a2-4434-941d-3dbdd0289b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:47.121914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 709/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Jun 7 21:54:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:47.136263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efa49a-0c52-44f7-a028-fd86533d93ba None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:47.136546 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efa49a-0c52-44f7-a028-fd86533d93ba None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:47.136819 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efa49a-0c52-44f7-a028-fd86533d93ba None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:47.138182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 703/1412] 10.222.0.18 () {54 vars in 918 bytes} [Tue Jun 7 21:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:47.142527 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567332b5-1200-4339-9e00-66e871dce3e2 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:47.142809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567332b5-1200-4339-9e00-66e871dce3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:47.143079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567332b5-1200-4339-9e00-66e871dce3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:47.160868 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-567332b5-1200-4339-9e00-66e871dce3e2 None None] MFA Rules not processed for user `1d5760a3f9f946978b1251d3e2aaa943`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:47.162049 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-567332b5-1200-4339-9e00-66e871dce3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:47.171365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 710/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Jun 7 21:54:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:49.902602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631c4eb-8717-453b-97ea-5fe40a9871e4 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:49.903196 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631c4eb-8717-453b-97ea-5fe40a9871e4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:49.903306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631c4eb-8717-453b-97ea-5fe40a9871e4 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:49.905176 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 21:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:49.910532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ebce0-8500-4ffd-a618-d6b3935ab5f8 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:49.910960 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ebce0-8500-4ffd-a618-d6b3935ab5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:49.911073 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ebce0-8500-4ffd-a618-d6b3935ab5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:49.928896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-878ebce0-8500-4ffd-a618-d6b3935ab5f8 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:49.930088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-878ebce0-8500-4ffd-a618-d6b3935ab5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:49.937614 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 21:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:49.980816 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631c4eb-8717-453b-97ea-5fe40a9871e4 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:49.996470 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631c4eb-8717-453b-97ea-5fe40a9871e4 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:50.001828 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7228fe-410f-4235-b781-46d2e8838ed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:50.002482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7228fe-410f-4235-b781-46d2e8838ed5 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:50.002760 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7228fe-410f-4235-b781-46d2e8838ed5 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:50.003028 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7228fe-410f-4235-b781-46d2e8838ed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:50.010949 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7228fe-410f-4235-b781-46d2e8838ed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:50.012504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7228fe-410f-4235-b781-46d2e8838ed5 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:50.021907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 705/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:51.019562 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c732d-ba37-447b-bf7b-3f80e984a9ab None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:51.020103 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c732d-ba37-447b-bf7b-3f80e984a9ab None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:51.020103 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c732d-ba37-447b-bf7b-3f80e984a9ab None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:51.021472 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 21:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:51.026428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a78903-5243-4003-b57b-1358471567d1 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:51.026802 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a78903-5243-4003-b57b-1358471567d1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:51.026989 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a78903-5243-4003-b57b-1358471567d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:51.045088 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-12a78903-5243-4003-b57b-1358471567d1 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:51.046348 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-12a78903-5243-4003-b57b-1358471567d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:51.054258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 21:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:51.227423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c732d-ba37-447b-bf7b-3f80e984a9ab None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:51.241688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c732d-ba37-447b-bf7b-3f80e984a9ab None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:51.246918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d777bf6-47d6-47a7-8dc1-4614526dbfed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:51.247536 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d777bf6-47d6-47a7-8dc1-4614526dbfed service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:51.247814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d777bf6-47d6-47a7-8dc1-4614526dbfed service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:51.248089 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d777bf6-47d6-47a7-8dc1-4614526dbfed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:51.256423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d777bf6-47d6-47a7-8dc1-4614526dbfed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:51.258030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d777bf6-47d6-47a7-8dc1-4614526dbfed service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:51.267757 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 713/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:52.197617 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69836b99-784f-4a6a-b079-fe2ee10f6752 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:52.198238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69836b99-784f-4a6a-b079-fe2ee10f6752 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:52.198238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69836b99-784f-4a6a-b079-fe2ee10f6752 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:52.199564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 21:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:52.204545 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ab0aa-721c-4de2-b611-41da3868d952 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:52.204958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ab0aa-721c-4de2-b611-41da3868d952 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:52.205072 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ab0aa-721c-4de2-b611-41da3868d952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:52.223017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1b5ab0aa-721c-4de2-b611-41da3868d952 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:52.224180 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1b5ab0aa-721c-4de2-b611-41da3868d952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:52.231991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 21:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:52.381066 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69836b99-784f-4a6a-b079-fe2ee10f6752 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:52.395817 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69836b99-784f-4a6a-b079-fe2ee10f6752 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:52.401134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ae58c-6170-409b-9e5b-0f4999865ff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:52.401764 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ae58c-6170-409b-9e5b-0f4999865ff2 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:52.402096 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ae58c-6170-409b-9e5b-0f4999865ff2 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:52.402358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ae58c-6170-409b-9e5b-0f4999865ff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:52.410923 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ae58c-6170-409b-9e5b-0f4999865ff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:52.412498 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ae58c-6170-409b-9e5b-0f4999865ff2 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:52.421983 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 708/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:53.323363 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1aa873-f66c-471a-beb8-aa374aef104e None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:53.323909 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1aa873-f66c-471a-beb8-aa374aef104e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:53.323909 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1aa873-f66c-471a-beb8-aa374aef104e None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:53.325259 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 21:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:53.330346 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f427bc3-166b-4071-bd60-db44c8d1ac2c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:53.330751 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f427bc3-166b-4071-bd60-db44c8d1ac2c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:53.330903 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f427bc3-166b-4071-bd60-db44c8d1ac2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:53.348441 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1f427bc3-166b-4071-bd60-db44c8d1ac2c None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:53.349630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1f427bc3-166b-4071-bd60-db44c8d1ac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:53.358193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 21:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:53.507392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1aa873-f66c-471a-beb8-aa374aef104e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:53.521301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1aa873-f66c-471a-beb8-aa374aef104e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:53.526522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48e590-0b83-4abd-bcc5-05366063b85c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:53.527136 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48e590-0b83-4abd-bcc5-05366063b85c service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:53.527413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48e590-0b83-4abd-bcc5-05366063b85c service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:53.527682 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48e590-0b83-4abd-bcc5-05366063b85c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:53.536051 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48e590-0b83-4abd-bcc5-05366063b85c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:53.537613 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48e590-0b83-4abd-bcc5-05366063b85c service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:53.547292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 716/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:54.453942 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9331c9-1f1d-4235-843b-9cdf3e840692 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:54.454487 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9331c9-1f1d-4235-843b-9cdf3e840692 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:54.454584 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9331c9-1f1d-4235-843b-9cdf3e840692 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:54.455900 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 21:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:54.460742 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74422b78-364d-4d5e-84b6-d8bd7905d550 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:54.461178 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74422b78-364d-4d5e-84b6-d8bd7905d550 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:54.461309 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74422b78-364d-4d5e-84b6-d8bd7905d550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:54.479586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-74422b78-364d-4d5e-84b6-d8bd7905d550 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:54.480751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-74422b78-364d-4d5e-84b6-d8bd7905d550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:54.489256 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 21:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:54.636838 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9331c9-1f1d-4235-843b-9cdf3e840692 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:54.651425 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9331c9-1f1d-4235-843b-9cdf3e840692 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:54.657335 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e889b5-f035-47c7-b01c-68eb037f8484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:54.657987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e889b5-f035-47c7-b01c-68eb037f8484 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:54.658276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e889b5-f035-47c7-b01c-68eb037f8484 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:54.658550 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e889b5-f035-47c7-b01c-68eb037f8484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:54.666541 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e889b5-f035-47c7-b01c-68eb037f8484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:54.668116 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e889b5-f035-47c7-b01c-68eb037f8484 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:54.677869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 711/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:55.515607 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4704ba5-b40a-4c32-9943-0543ff882204 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:55.516157 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4704ba5-b40a-4c32-9943-0543ff882204 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:55.516157 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4704ba5-b40a-4c32-9943-0543ff882204 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:55.517515 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 21:54:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:55.522614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109900a-34d7-429a-9fb1-36dd2a3fcbe1 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:55.523034 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109900a-34d7-429a-9fb1-36dd2a3fcbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:55.523229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109900a-34d7-429a-9fb1-36dd2a3fcbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:55.541285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1109900a-34d7-429a-9fb1-36dd2a3fcbe1 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:55.542488 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1109900a-34d7-429a-9fb1-36dd2a3fcbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:55.550467 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 21:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 21:54:55.697584 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4704ba5-b40a-4c32-9943-0543ff882204 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:55.712093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4704ba5-b40a-4c32-9943-0543ff882204 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:55.717883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831561bd-1a83-4e30-bc30-721e98862ef6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:55.718562 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831561bd-1a83-4e30-bc30-721e98862ef6 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:55.718842 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831561bd-1a83-4e30-bc30-721e98862ef6 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:55.719114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831561bd-1a83-4e30-bc30-721e98862ef6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:55.727054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831561bd-1a83-4e30-bc30-721e98862ef6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:55.728873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831561bd-1a83-4e30-bc30-721e98862ef6 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:55.738063 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 719/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:56.578882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73d6cd-0709-446e-b9e6-cb743f949e4b None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:56.579431 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73d6cd-0709-446e-b9e6-cb743f949e4b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:56.579431 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73d6cd-0709-446e-b9e6-cb743f949e4b None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:56.580846 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 21:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:56.585789 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f03ef-ed7c-4154-86c0-dc28a1445b14 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:56.586225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f03ef-ed7c-4154-86c0-dc28a1445b14 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:56.586344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f03ef-ed7c-4154-86c0-dc28a1445b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:56.603977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ba4f03ef-ed7c-4154-86c0-dc28a1445b14 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:56.605142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ba4f03ef-ed7c-4154-86c0-dc28a1445b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:56.612770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 21:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:56.759829 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73d6cd-0709-446e-b9e6-cb743f949e4b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:56.774323 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73d6cd-0709-446e-b9e6-cb743f949e4b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:56.779603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b0711-505c-4f3c-95de-44105849a76b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:56.780223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b0711-505c-4f3c-95de-44105849a76b service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:56.780501 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b0711-505c-4f3c-95de-44105849a76b service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:56.780769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b0711-505c-4f3c-95de-44105849a76b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:56.788651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b0711-505c-4f3c-95de-44105849a76b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:56.790237 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b0711-505c-4f3c-95de-44105849a76b service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:56.799441 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 714/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:57.643700 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e3ef7-7602-4c90-94b6-1f291c41db27 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:57.644239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e3ef7-7602-4c90-94b6-1f291c41db27 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:57.644239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e3ef7-7602-4c90-94b6-1f291c41db27 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:57.645539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 21:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 21:54:57.650416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc4af3-df07-4b20-9499-75561f6b7e7b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:57.650802 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc4af3-df07-4b20-9499-75561f6b7e7b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:57.651033 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc4af3-df07-4b20-9499-75561f6b7e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:57.669270 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6dfc4af3-df07-4b20-9499-75561f6b7e7b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:57.670473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6dfc4af3-df07-4b20-9499-75561f6b7e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:57.678118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 21:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:57.827257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e3ef7-7602-4c90-94b6-1f291c41db27 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:57.841270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e3ef7-7602-4c90-94b6-1f291c41db27 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:57.847054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbc476-bfc5-4465-9c44-239760263e58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:57.847676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbc476-bfc5-4465-9c44-239760263e58 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:57.847959 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbc476-bfc5-4465-9c44-239760263e58 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:57.848227 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbc476-bfc5-4465-9c44-239760263e58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:57.856286 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbbc476-bfc5-4465-9c44-239760263e58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:57.857838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbbc476-bfc5-4465-9c44-239760263e58 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:57.867821 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 722/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:54:58.715191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c1d7-e01d-4272-ba61-385c106ec762 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:58.715737 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c1d7-e01d-4272-ba61-385c106ec762 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:58.715737 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c1d7-e01d-4272-ba61-385c106ec762 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:58.717174 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 21:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:54:58.722088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da441d-65a9-4727-be2d-3535811f0d50 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:58.722510 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da441d-65a9-4727-be2d-3535811f0d50 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:58.722620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da441d-65a9-4727-be2d-3535811f0d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:58.740765 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e7da441d-65a9-4727-be2d-3535811f0d50 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:54:58.741948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e7da441d-65a9-4727-be2d-3535811f0d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:54:58.750194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 21:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:54:58.896301 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1c1d7-e01d-4272-ba61-385c106ec762 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:54:58.911052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1c1d7-e01d-4272-ba61-385c106ec762 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:54:58.916351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9b61b-14a5-457f-a5af-de3154c884aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:54:58.916975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b61b-14a5-457f-a5af-de3154c884aa service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:54:58.917253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b61b-14a5-457f-a5af-de3154c884aa service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:54:58.917524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b61b-14a5-457f-a5af-de3154c884aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:54:58.926028 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9b61b-14a5-457f-a5af-de3154c884aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:54:58.927593 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9b61b-14a5-457f-a5af-de3154c884aa service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:54:58.936721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 717/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:54:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:55:01.037587 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909df082-a320-4372-9ecd-c2292576c0ee None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:01.038124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909df082-a320-4372-9ecd-c2292576c0ee None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:01.038220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909df082-a320-4372-9ecd-c2292576c0ee None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:01.039538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 21:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:55:01.044748 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eabb9-b41e-4a0b-8561-727001069c4c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:01.045732 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eabb9-b41e-4a0b-8561-727001069c4c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:01.045949 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eabb9-b41e-4a0b-8561-727001069c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:01.063301 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-620eabb9-b41e-4a0b-8561-727001069c4c None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:55:01.064480 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-620eabb9-b41e-4a0b-8561-727001069c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:55:01.072202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 21:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:55:01.111992 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909df082-a320-4372-9ecd-c2292576c0ee None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:55:01.122730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909df082-a320-4372-9ecd-c2292576c0ee None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:55:01.126385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e705b59-11d0-4fae-8bdc-4e5856533739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:55:01.127055 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e705b59-11d0-4fae-8bdc-4e5856533739 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:01.127368 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e705b59-11d0-4fae-8bdc-4e5856533739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:01.127628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e705b59-11d0-4fae-8bdc-4e5856533739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:01.136523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e705b59-11d0-4fae-8bdc-4e5856533739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:55:01.137942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e705b59-11d0-4fae-8bdc-4e5856533739 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:55:01.147051 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 725/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:55:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:55:03.521571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bc9cb-f068-409a-8b18-1a5b6d66a17d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:03.522151 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bc9cb-f068-409a-8b18-1a5b6d66a17d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:03.522151 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bc9cb-f068-409a-8b18-1a5b6d66a17d None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:03.523518 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 21:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:55:03.528692 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5244d2-bc03-4bf2-9e52-5d65571808f8 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:03.529095 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5244d2-bc03-4bf2-9e52-5d65571808f8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:03.529417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5244d2-bc03-4bf2-9e52-5d65571808f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:03.546685 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-cb5244d2-bc03-4bf2-9e52-5d65571808f8 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:55:03.547876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-cb5244d2-bc03-4bf2-9e52-5d65571808f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:55:03.555570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 21:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:55:03.593779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bc9cb-f068-409a-8b18-1a5b6d66a17d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:55:03.604771 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bc9cb-f068-409a-8b18-1a5b6d66a17d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:55:03.608835 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e78ef7-d9cb-43f4-aa02-d1c0e1630871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:55:03.609466 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e78ef7-d9cb-43f4-aa02-d1c0e1630871 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:03.609751 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e78ef7-d9cb-43f4-aa02-d1c0e1630871 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:03.610064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e78ef7-d9cb-43f4-aa02-d1c0e1630871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:03.618921 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e78ef7-d9cb-43f4-aa02-d1c0e1630871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:55:03.620276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e78ef7-d9cb-43f4-aa02-d1c0e1630871 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:55:03.630181 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 720/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:55:06.146440 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b32c-ab2f-4fb4-97f7-5a0fba31b6a9 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:06.147027 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b32c-ab2f-4fb4-97f7-5a0fba31b6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:06.147126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b32c-ab2f-4fb4-97f7-5a0fba31b6a9 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:06.148462 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 21:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:55:06.153795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21a4c1-bdd8-4f35-ad3c-2d7e242bb1f8 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:06.154310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21a4c1-bdd8-4f35-ad3c-2d7e242bb1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:06.154417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21a4c1-bdd8-4f35-ad3c-2d7e242bb1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:06.172066 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-5d21a4c1-bdd8-4f35-ad3c-2d7e242bb1f8 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:55:06.173242 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5d21a4c1-bdd8-4f35-ad3c-2d7e242bb1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:55:06.181527 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 21:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:55:06.219661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36b32c-ab2f-4fb4-97f7-5a0fba31b6a9 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:55:06.230442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36b32c-ab2f-4fb4-97f7-5a0fba31b6a9 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:55:06.234440 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652da1a-df94-490d-aed3-c16b2de4a16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:55:06.235071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652da1a-df94-490d-aed3-c16b2de4a16d service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:06.235356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652da1a-df94-490d-aed3-c16b2de4a16d service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:06.235633 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652da1a-df94-490d-aed3-c16b2de4a16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:06.244468 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652da1a-df94-490d-aed3-c16b2de4a16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:55:06.245949 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652da1a-df94-490d-aed3-c16b2de4a16d service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:55:06.255956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 728/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:55:08.608093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bbc1a-0862-46cc-b58a-3003bbb1440d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:08.608698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bbc1a-0862-46cc-b58a-3003bbb1440d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:08.608698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bbc1a-0862-46cc-b58a-3003bbb1440d None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:08.610087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 21:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:55:08.615303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193dfe3c-5f87-44a4-8826-96594c219408 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:08.615768 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193dfe3c-5f87-44a4-8826-96594c219408 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:08.615882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193dfe3c-5f87-44a4-8826-96594c219408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:08.633632 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-193dfe3c-5f87-44a4-8826-96594c219408 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:55:08.634832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-193dfe3c-5f87-44a4-8826-96594c219408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:55:08.643073 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 21:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:55:08.680329 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bbc1a-0862-46cc-b58a-3003bbb1440d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:55:08.691560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bbc1a-0862-46cc-b58a-3003bbb1440d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:55:08.694980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252f005-72fc-4d95-987f-7a94beaf930c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:55:08.695629 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252f005-72fc-4d95-987f-7a94beaf930c service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:08.695910 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252f005-72fc-4d95-987f-7a94beaf930c service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:08.696185 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252f005-72fc-4d95-987f-7a94beaf930c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:08.705733 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252f005-72fc-4d95-987f-7a94beaf930c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:55:08.707183 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252f005-72fc-4d95-987f-7a94beaf930c service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:55:08.716326 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 723/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:55:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:55:10.974301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f95a7-4ec5-4908-9263-030a94d155d0 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:10.974882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f95a7-4ec5-4908-9263-030a94d155d0 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:10.974882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f95a7-4ec5-4908-9263-030a94d155d0 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:10.976198 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 21:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:55:10.981657 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e2756-343c-4829-8c5c-bb849aae26a3 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:10.982146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e2756-343c-4829-8c5c-bb849aae26a3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:10.982271 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e2756-343c-4829-8c5c-bb849aae26a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:11.000329 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4a0e2756-343c-4829-8c5c-bb849aae26a3 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:55:11.001498 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4a0e2756-343c-4829-8c5c-bb849aae26a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:55:11.009093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 21:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:55:11.046200 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f95a7-4ec5-4908-9263-030a94d155d0 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:55:11.056575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f95a7-4ec5-4908-9263-030a94d155d0 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:55:11.060019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67ad61-073c-437f-93f1-97e7944d3284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:55:11.061150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67ad61-073c-437f-93f1-97e7944d3284 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:11.061426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67ad61-073c-437f-93f1-97e7944d3284 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:11.061694 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67ad61-073c-437f-93f1-97e7944d3284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:11.070341 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67ad61-073c-437f-93f1-97e7944d3284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:55:11.071744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67ad61-073c-437f-93f1-97e7944d3284 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:55:11.081405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 731/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:55:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:55:13.350723 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3491c-e35b-4662-bb5f-93f6e69d42a6 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:13.351261 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3491c-e35b-4662-bb5f-93f6e69d42a6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:13.351352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3491c-e35b-4662-bb5f-93f6e69d42a6 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:13.352796 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 21:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:55:13.359203 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c509e-bd45-476a-a1b6-a71963ee5be0 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:13.359612 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c509e-bd45-476a-a1b6-a71963ee5be0 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:13.359758 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c509e-bd45-476a-a1b6-a71963ee5be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:13.377276 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-bf6c509e-bd45-476a-a1b6-a71963ee5be0 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:55:13.378492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bf6c509e-bd45-476a-a1b6-a71963ee5be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:55:13.386471 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 21:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:55:13.424265 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3491c-e35b-4662-bb5f-93f6e69d42a6 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:55:13.434721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3491c-e35b-4662-bb5f-93f6e69d42a6 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:55:13.438966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4dac2-5632-4f76-ab9c-5eccebdae186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:55:13.439601 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4dac2-5632-4f76-ab9c-5eccebdae186 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:13.439881 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4dac2-5632-4f76-ab9c-5eccebdae186 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:13.440161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4dac2-5632-4f76-ab9c-5eccebdae186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:13.449057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4dac2-5632-4f76-ab9c-5eccebdae186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:55:13.450505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4dac2-5632-4f76-ab9c-5eccebdae186 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:55:13.459774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 726/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:55:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:55:15.747622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f311fb1-d7e5-4cf0-b3db-120504846206 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:15.748144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f311fb1-d7e5-4cf0-b3db-120504846206 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:15.748144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f311fb1-d7e5-4cf0-b3db-120504846206 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:15.749484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 21:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:55:15.754791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c58dc-2a7b-495b-b686-424b00a1ec44 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:15.755194 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c58dc-2a7b-495b-b686-424b00a1ec44 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:15.755352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c58dc-2a7b-495b-b686-424b00a1ec44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:15.773247 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-947c58dc-2a7b-495b-b686-424b00a1ec44 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:55:15.774472 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-947c58dc-2a7b-495b-b686-424b00a1ec44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:55:15.782819 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 21:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:55:15.818797 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f311fb1-d7e5-4cf0-b3db-120504846206 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:55:15.829670 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f311fb1-d7e5-4cf0-b3db-120504846206 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:55:15.833114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bc3e7-ba5b-4a27-88ba-bea090f4d443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:55:15.833732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bc3e7-ba5b-4a27-88ba-bea090f4d443 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:15.834040 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bc3e7-ba5b-4a27-88ba-bea090f4d443 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:15.834311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bc3e7-ba5b-4a27-88ba-bea090f4d443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:15.843470 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bc3e7-ba5b-4a27-88ba-bea090f4d443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:55:15.844879 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bc3e7-ba5b-4a27-88ba-bea090f4d443 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:55:15.854310 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 734/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:55:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:55:18.115030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c106d-0a76-449a-be44-06cdf96c3ad1 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:18.115611 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c106d-0a76-449a-be44-06cdf96c3ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:18.115611 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c106d-0a76-449a-be44-06cdf96c3ad1 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:18.116956 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 21:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:55:18.122200 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25c7e2-2561-4e6a-b54e-ba616c55e874 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:18.122644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25c7e2-2561-4e6a-b54e-ba616c55e874 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:18.122761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25c7e2-2561-4e6a-b54e-ba616c55e874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:18.128790 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=79 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:55:18.141694 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1f25c7e2-2561-4e6a-b54e-ba616c55e874 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:55:18.142914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1f25c7e2-2561-4e6a-b54e-ba616c55e874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:55:18.150666 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 21:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:55:18.189499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c106d-0a76-449a-be44-06cdf96c3ad1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:55:18.191207 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e08c106d-0a76-449a-be44-06cdf96c3ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:55:18.198986 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=73 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:55:18.205150 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c106d-0a76-449a-be44-06cdf96c3ad1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:55:18.208667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c0edb-c5a0-4b8c-81cf-11bd6679a31b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:55:18.209295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c0edb-c5a0-4b8c-81cf-11bd6679a31b service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:18.209593 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c0edb-c5a0-4b8c-81cf-11bd6679a31b service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:18.209846 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c0edb-c5a0-4b8c-81cf-11bd6679a31b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:18.218627 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c0edb-c5a0-4b8c-81cf-11bd6679a31b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:55:18.220029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c0edb-c5a0-4b8c-81cf-11bd6679a31b service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:55:18.229389 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 729/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:55:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:55:20.495962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446b070-1ec0-49e5-8696-399e2ceb4cda None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:20.496482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446b070-1ec0-49e5-8696-399e2ceb4cda None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:20.496610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446b070-1ec0-49e5-8696-399e2ceb4cda None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:20.498453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 21:55:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:55:20.503608 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9c47-9804-406c-92d9-4eb165d3d99f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:20.504006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9c47-9804-406c-92d9-4eb165d3d99f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:20.504161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9c47-9804-406c-92d9-4eb165d3d99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:20.521390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ad7a9c47-9804-406c-92d9-4eb165d3d99f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:55:20.522591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ad7a9c47-9804-406c-92d9-4eb165d3d99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:55:20.530688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 21:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:55:20.566285 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446b070-1ec0-49e5-8696-399e2ceb4cda None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:55:20.577115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446b070-1ec0-49e5-8696-399e2ceb4cda None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:55:20.580631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935c125-dce8-4157-9cfa-86e06c18410b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:55:20.581252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935c125-dce8-4157-9cfa-86e06c18410b service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:20.581580 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935c125-dce8-4157-9cfa-86e06c18410b service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:20.581853 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935c125-dce8-4157-9cfa-86e06c18410b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:20.590647 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935c125-dce8-4157-9cfa-86e06c18410b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:55:20.592615 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935c125-dce8-4157-9cfa-86e06c18410b service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:55:20.601820 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 737/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:55:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:55:22.891521 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54451b9-2108-4b13-8bb1-6f2686c5f595 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:22.892065 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54451b9-2108-4b13-8bb1-6f2686c5f595 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:22.892065 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54451b9-2108-4b13-8bb1-6f2686c5f595 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:22.893480 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 21:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:55:22.898690 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c363557-d824-46ec-bcab-d391f163a8c2 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:22.899144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c363557-d824-46ec-bcab-d391f163a8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:22.899243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c363557-d824-46ec-bcab-d391f163a8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:22.916514 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3c363557-d824-46ec-bcab-d391f163a8c2 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:55:22.917689 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3c363557-d824-46ec-bcab-d391f163a8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:55:22.925330 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 21:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:55:22.962620 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54451b9-2108-4b13-8bb1-6f2686c5f595 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:55:22.973182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54451b9-2108-4b13-8bb1-6f2686c5f595 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:55:22.976648 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf6e3e-3383-4ec3-a0aa-2eb86cbcf609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:55:22.977273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf6e3e-3383-4ec3-a0aa-2eb86cbcf609 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:22.977557 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf6e3e-3383-4ec3-a0aa-2eb86cbcf609 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:22.977831 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf6e3e-3383-4ec3-a0aa-2eb86cbcf609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:22.986901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf6e3e-3383-4ec3-a0aa-2eb86cbcf609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:55:22.988321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf6e3e-3383-4ec3-a0aa-2eb86cbcf609 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:55:22.998382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 732/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:55:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:55:32.911432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=11 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:55:32.993576 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=14 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:55:54.317691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b9d2-c4c4-4b49-9ce5-90745a96a26b None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:54.318206 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b9d2-c4c4-4b49-9ce5-90745a96a26b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:54.318299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b9d2-c4c4-4b49-9ce5-90745a96a26b None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:54.319676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 739/1471] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:55:54.325061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d85476-f1cf-4dd6-a3be-c35f81d2ae22 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:54.325489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d85476-f1cf-4dd6-a3be-c35f81d2ae22 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:54.325595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d85476-f1cf-4dd6-a3be-c35f81d2ae22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:54.344248 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-77d85476-f1cf-4dd6-a3be-c35f81d2ae22 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:55:54.345417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-77d85476-f1cf-4dd6-a3be-c35f81d2ae22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:55:54.353140 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 733/1472] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:55:54.399426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29845e3-5f1b-42e9-8dd6-a131a69a21f8 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:54.399715 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29845e3-5f1b-42e9-8dd6-a131a69a21f8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:54.399991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29845e3-5f1b-42e9-8dd6-a131a69a21f8 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:54.401331 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 740/1473] 10.222.0.18 () {54 vars in 962 bytes} [Tue Jun 7 21:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:55:54.406519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bba18-816d-4eca-bc38-2e1f290d06e4 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:54.406808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bba18-816d-4eca-bc38-2e1f290d06e4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:54.407081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bba18-816d-4eca-bc38-2e1f290d06e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:54.425167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-572bba18-816d-4eca-bc38-2e1f290d06e4 None None] MFA Rules not processed for user `1a3c022963e74e989a703938ff057757`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:55:54.426355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-572bba18-816d-4eca-bc38-2e1f290d06e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:55:54.432608 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 734/1474] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jun 7 21:55:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:55:54.439517 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29845e3-5f1b-42e9-8dd6-a131a69a21f8 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:55:54.449916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29845e3-5f1b-42e9-8dd6-a131a69a21f8 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:55:54.453356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae5b7f-4429-4c31-890b-8b67880797f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a3c022963e74e989a703938ff057757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:55:54.453995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae5b7f-4429-4c31-890b-8b67880797f5 service glance] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:54.454279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae5b7f-4429-4c31-890b-8b67880797f5 service glance] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:54.454554 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae5b7f-4429-4c31-890b-8b67880797f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:54.463291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae5b7f-4429-4c31-890b-8b67880797f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:55:54.464713 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae5b7f-4429-4c31-890b-8b67880797f5 service glance] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:55:54.474365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 741/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:55:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 21:55:56.797147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73d91f-15c4-4ac3-999f-f41499451d21 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:56.797741 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73d91f-15c4-4ac3-999f-f41499451d21 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:56.797741 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73d91f-15c4-4ac3-999f-f41499451d21 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:56.799109 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 735/1476] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:55:56.804356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330e640-10ed-4c9b-9767-96900b8d2f76 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:56.804755 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330e640-10ed-4c9b-9767-96900b8d2f76 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:56.804908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330e640-10ed-4c9b-9767-96900b8d2f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:56.822060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3330e640-10ed-4c9b-9767-96900b8d2f76 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:55:56.823229 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3330e640-10ed-4c9b-9767-96900b8d2f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:55:56.830853 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 742/1477] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:55:56.854302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73d91f-15c4-4ac3-999f-f41499451d21 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:55:56.867079 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73d91f-15c4-4ac3-999f-f41499451d21 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:55:56.871668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d36be4-8ee9-4f1f-9474-040224f95db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:55:56.872311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d36be4-8ee9-4f1f-9474-040224f95db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:56.872589 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d36be4-8ee9-4f1f-9474-040224f95db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:56.872861 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d36be4-8ee9-4f1f-9474-040224f95db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:56.873618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d36be4-8ee9-4f1f-9474-040224f95db4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:55:56.875385 dv-cinder-835525-4-smb devstack@keystone.service[80404]: WARNING py.warnings [None req-e9d36be4-8ee9-4f1f-9474-040224f95db4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 21:55:56.875385 dv-cinder-835525-4-smb devstack@keystone.service[80404]: warnings.warn(msg) Jun 07 21:55:56.875385 dv-cinder-835525-4-smb devstack@keystone.service[80404]: Jun 07 21:55:56.876545 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d36be4-8ee9-4f1f-9474-040224f95db4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:55:56.895945 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 736/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 7 21:55:56 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 21:55:59.128823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244ecd6-519c-4a7e-a9c7-6595e1023f29 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:59.129270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244ecd6-519c-4a7e-a9c7-6595e1023f29 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:59.129423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244ecd6-519c-4a7e-a9c7-6595e1023f29 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:59.130986 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 743/1479] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:55:59.137113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37049a1e-69cc-4867-91b5-30e8882335ee None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:59.137550 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37049a1e-69cc-4867-91b5-30e8882335ee None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:59.137696 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37049a1e-69cc-4867-91b5-30e8882335ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:59.155892 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-37049a1e-69cc-4867-91b5-30e8882335ee None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:55:59.157077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-37049a1e-69cc-4867-91b5-30e8882335ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:55:59.164830 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 737/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:55:59.208042 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244ecd6-519c-4a7e-a9c7-6595e1023f29 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:55:59.222298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244ecd6-519c-4a7e-a9c7-6595e1023f29 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:55:59.228157 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8a5c8-7aaf-4334-b3fb-236d48028108 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:55:59.229047 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a5c8-7aaf-4334-b3fb-236d48028108 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:55:59.229328 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a5c8-7aaf-4334-b3fb-236d48028108 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:55:59.229603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a5c8-7aaf-4334-b3fb-236d48028108 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:55:59.238341 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8a5c8-7aaf-4334-b3fb-236d48028108 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:55:59.239913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8a5c8-7aaf-4334-b3fb-236d48028108 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:55:59.249723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 744/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:56:01.650726 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af65ef-0e2b-4b66-a9f0-6af791835f42 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:56:01.651251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af65ef-0e2b-4b66-a9f0-6af791835f42 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:56:01.651251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af65ef-0e2b-4b66-a9f0-6af791835f42 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:56:01.652749 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 738/1482] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:56:01.657845 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed014c-2bff-4883-82f1-50be67f19a24 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:56:01.658286 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed014c-2bff-4883-82f1-50be67f19a24 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:56:01.658448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed014c-2bff-4883-82f1-50be67f19a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:56:01.676670 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-14ed014c-2bff-4883-82f1-50be67f19a24 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:56:01.677835 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-14ed014c-2bff-4883-82f1-50be67f19a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:56:01.686117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 745/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:56:01.721166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af65ef-0e2b-4b66-a9f0-6af791835f42 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:56:01.732587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af65ef-0e2b-4b66-a9f0-6af791835f42 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:56:01.736194 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2dccd-b2d0-4730-b41b-32abab937ffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:56:01.736823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2dccd-b2d0-4730-b41b-32abab937ffb service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:56:01.737106 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2dccd-b2d0-4730-b41b-32abab937ffb service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:56:01.737382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2dccd-b2d0-4730-b41b-32abab937ffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:56:01.746846 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2dccd-b2d0-4730-b41b-32abab937ffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:56:01.748274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2dccd-b2d0-4730-b41b-32abab937ffb service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:56:01.757666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 739/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:56:04.008667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a242b9-acf0-4f46-a94b-4637a530296d None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:56:04.009214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a242b9-acf0-4f46-a94b-4637a530296d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:56:04.009214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a242b9-acf0-4f46-a94b-4637a530296d None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:56:04.010589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 746/1485] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:56:04.015903 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7e8b8-f8e0-4fd1-ba40-30c1e050afc5 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:56:04.016333 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7e8b8-f8e0-4fd1-ba40-30c1e050afc5 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:56:04.016445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7e8b8-f8e0-4fd1-ba40-30c1e050afc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:56:04.034225 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-20b7e8b8-f8e0-4fd1-ba40-30c1e050afc5 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:56:04.035391 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-20b7e8b8-f8e0-4fd1-ba40-30c1e050afc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:56:04.043600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 740/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:56:04.080739 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a242b9-acf0-4f46-a94b-4637a530296d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:56:04.091893 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a242b9-acf0-4f46-a94b-4637a530296d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:56:04.095358 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716b7ff-0861-4c49-8731-43661a2beedf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:56:04.096008 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716b7ff-0861-4c49-8731-43661a2beedf service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:56:04.096282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716b7ff-0861-4c49-8731-43661a2beedf service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:56:04.096550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716b7ff-0861-4c49-8731-43661a2beedf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:56:04.106022 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716b7ff-0861-4c49-8731-43661a2beedf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:56:04.107432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716b7ff-0861-4c49-8731-43661a2beedf service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:56:04.116495 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 747/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:56:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:56:06.416738 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e41a-fadf-4196-9b46-1404fef65b2d None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:56:06.417277 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e41a-fadf-4196-9b46-1404fef65b2d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:56:06.417277 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e41a-fadf-4196-9b46-1404fef65b2d None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:56:06.419309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 741/1488] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:56:06.424704 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ff100-4451-4d2b-b73d-f6b6d2fe1515 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:56:06.425116 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ff100-4451-4d2b-b73d-f6b6d2fe1515 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:56:06.425257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ff100-4451-4d2b-b73d-f6b6d2fe1515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:56:06.442832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4d7ff100-4451-4d2b-b73d-f6b6d2fe1515 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:56:06.444018 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4d7ff100-4451-4d2b-b73d-f6b6d2fe1515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:56:06.451658 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 748/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:56:06.492615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780e41a-fadf-4196-9b46-1404fef65b2d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:56:06.503466 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780e41a-fadf-4196-9b46-1404fef65b2d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:56:06.507000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c37f6-4bd0-4c8d-b9f1-d7368f2251c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:56:06.507618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c37f6-4bd0-4c8d-b9f1-d7368f2251c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:56:06.507900 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c37f6-4bd0-4c8d-b9f1-d7368f2251c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:56:06.508175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c37f6-4bd0-4c8d-b9f1-d7368f2251c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:56:06.517033 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c37f6-4bd0-4c8d-b9f1-d7368f2251c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:56:06.518494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c37f6-4bd0-4c8d-b9f1-d7368f2251c0 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:56:06.528321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 742/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 21:56:09.056371 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b7043-6304-47a0-aba7-3e2a64ff1462 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:56:09.056991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b7043-6304-47a0-aba7-3e2a64ff1462 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:56:09.056991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b7043-6304-47a0-aba7-3e2a64ff1462 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:56:09.058398 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 749/1491] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 7 21:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:56:09.063961 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0096d7-f278-408d-97e1-3d6a262c40ef None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:56:09.064409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0096d7-f278-408d-97e1-3d6a262c40ef None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:56:09.064512 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0096d7-f278-408d-97e1-3d6a262c40ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:56:09.082527 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1f0096d7-f278-408d-97e1-3d6a262c40ef None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:56:09.083711 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1f0096d7-f278-408d-97e1-3d6a262c40ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:56:09.092095 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 743/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 7 21:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:56:09.135727 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b7043-6304-47a0-aba7-3e2a64ff1462 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:56:09.151056 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b7043-6304-47a0-aba7-3e2a64ff1462 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:56:09.155835 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972663f-0658-4ece-89a6-0960dc204335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:56:09.156352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972663f-0658-4ece-89a6-0960dc204335 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:56:09.156633 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972663f-0658-4ece-89a6-0960dc204335 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:56:09.156907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972663f-0658-4ece-89a6-0960dc204335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:56:09.167852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972663f-0658-4ece-89a6-0960dc204335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:56:09.169628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972663f-0658-4ece-89a6-0960dc204335 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:56:09.180561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 750/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:56:19.077484 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=33 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:56:19.175669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=33 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:57:40.366309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ac9ad-34e4-44e0-bb0b-a54cfc352caf None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:57:40.366751 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ac9ad-34e4-44e0-bb0b-a54cfc352caf None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:57:40.366851 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ac9ad-34e4-44e0-bb0b-a54cfc352caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:57:40.385296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ac5ac9ad-34e4-44e0-bb0b-a54cfc352caf None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:57:40.386492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ac5ac9ad-34e4-44e0-bb0b-a54cfc352caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:57:40.394121 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 744/1494] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 21:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:57:40.401992 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a1c54-b9fd-4dfa-ac23-fcc3a865f28f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:57:40.402468 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a1c54-b9fd-4dfa-ac23-fcc3a865f28f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:57:40.402571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a1c54-b9fd-4dfa-ac23-fcc3a865f28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:57:40.419854 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-315a1c54-b9fd-4dfa-ac23-fcc3a865f28f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:57:40.421019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-315a1c54-b9fd-4dfa-ac23-fcc3a865f28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:57:40.428717 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 751/1495] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 21:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:57:40.433470 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ac9ad-34e4-44e0-bb0b-a54cfc352caf None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:57:40.442852 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ac9ad-34e4-44e0-bb0b-a54cfc352caf None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:57:40.447911 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6210d6-eb29-42fd-8696-35cf07775a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:57:40.448547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6210d6-eb29-42fd-8696-35cf07775a68 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:57:40.448829 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6210d6-eb29-42fd-8696-35cf07775a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:57:40.449107 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6210d6-eb29-42fd-8696-35cf07775a68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:57:40.449839 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6210d6-eb29-42fd-8696-35cf07775a68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 21:57:40.450162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6210d6-eb29-42fd-8696-35cf07775a68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:57:40.451167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: WARNING py.warnings [None req-bc6210d6-eb29-42fd-8696-35cf07775a68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 21:57:40.451167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: warnings.warn(msg) Jun 07 21:57:40.451167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: Jun 07 21:57:40.452041 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6210d6-eb29-42fd-8696-35cf07775a68 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:57:40.463323 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 745/1496] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 21:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 21:57:40.471099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a1c54-b9fd-4dfa-ac23-fcc3a865f28f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:57:40.480520 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a1c54-b9fd-4dfa-ac23-fcc3a865f28f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:57:40.488769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c0759-c073-41c9-9513-3422f834c03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:57:40.489683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c0759-c073-41c9-9513-3422f834c03b admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:57:40.490067 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c0759-c073-41c9-9513-3422f834c03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:57:40.490396 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c0759-c073-41c9-9513-3422f834c03b admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:57:40.491350 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c0759-c073-41c9-9513-3422f834c03b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:57:40.494303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: WARNING py.warnings [None req-674c0759-c073-41c9-9513-3422f834c03b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 21:57:40.494303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: warnings.warn(msg) Jun 07 21:57:40.494303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: Jun 07 21:57:40.496157 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c0759-c073-41c9-9513-3422f834c03b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:57:40.533320 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 752/1497] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 21:57:40 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:57:40.537560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6210d6-eb29-42fd-8696-35cf07775a68 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:57:40.547408 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6210d6-eb29-42fd-8696-35cf07775a68 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:57:40.603399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7022d88-9abb-4957-82e1-666193fe0710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:57:40.604326 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7022d88-9abb-4957-82e1-666193fe0710 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:57:40.604610 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7022d88-9abb-4957-82e1-666193fe0710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:57:40.604883 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7022d88-9abb-4957-82e1-666193fe0710 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:57:40.605559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7022d88-9abb-4957-82e1-666193fe0710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:57:40.606613 dv-cinder-835525-4-smb devstack@keystone.service[80404]: WARNING py.warnings [None req-a7022d88-9abb-4957-82e1-666193fe0710 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 21:57:40.606613 dv-cinder-835525-4-smb devstack@keystone.service[80404]: warnings.warn(msg) Jun 07 21:57:40.606613 dv-cinder-835525-4-smb devstack@keystone.service[80404]: Jun 07 21:57:40.607814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7022d88-9abb-4957-82e1-666193fe0710 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:57:40.627279 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 746/1498] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 21:57:40 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 21:57:40.631492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c0759-c073-41c9-9513-3422f834c03b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:57:40.641512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c0759-c073-41c9-9513-3422f834c03b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:57:40.646001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2110b7-dec2-493e-9489-de422dd47f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:57:40.646646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2110b7-dec2-493e-9489-de422dd47f1a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:57:40.646928 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2110b7-dec2-493e-9489-de422dd47f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:57:40.647199 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2110b7-dec2-493e-9489-de422dd47f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:57:40.647912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2110b7-dec2-493e-9489-de422dd47f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:57:40.649426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: WARNING py.warnings [None req-6d2110b7-dec2-493e-9489-de422dd47f1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 21:57:40.649426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: warnings.warn(msg) Jun 07 21:57:40.649426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: Jun 07 21:57:40.650334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2110b7-dec2-493e-9489-de422dd47f1a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:57:40.662866 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 753/1499] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 21:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 21:57:40.667289 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7022d88-9abb-4957-82e1-666193fe0710 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:57:40.677027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7022d88-9abb-4957-82e1-666193fe0710 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:57:40.681544 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed41cbb-b5ab-4b5b-9e9c-ada9f314fdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:57:40.682223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed41cbb-b5ab-4b5b-9e9c-ada9f314fdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:57:40.682511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed41cbb-b5ab-4b5b-9e9c-ada9f314fdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:57:40.682785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed41cbb-b5ab-4b5b-9e9c-ada9f314fdf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:57:40.683506 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed41cbb-b5ab-4b5b-9e9c-ada9f314fdf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:57:40.684506 dv-cinder-835525-4-smb devstack@keystone.service[80404]: WARNING py.warnings [None req-bed41cbb-b5ab-4b5b-9e9c-ada9f314fdf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 21:57:40.684506 dv-cinder-835525-4-smb devstack@keystone.service[80404]: warnings.warn(msg) Jun 07 21:57:40.684506 dv-cinder-835525-4-smb devstack@keystone.service[80404]: Jun 07 21:57:40.685381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed41cbb-b5ab-4b5b-9e9c-ada9f314fdf1 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:57:40.698372 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 747/1500] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 21:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 21:57:40.702278 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2110b7-dec2-493e-9489-de422dd47f1a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:57:40.712462 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2110b7-dec2-493e-9489-de422dd47f1a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:57:40.716907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a3a04-9e69-438e-9674-26f4f9f4209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:57:40.717767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a3a04-9e69-438e-9674-26f4f9f4209c admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:57:40.718083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a3a04-9e69-438e-9674-26f4f9f4209c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:57:40.718352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a3a04-9e69-438e-9674-26f4f9f4209c admin admin] PATH_INFO: `/v3/projects/a4684f10d8914122b555a5f73c161edf/users/929dd884102b40a2b3cb00514665927b/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:57:40.733488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a3a04-9e69-438e-9674-26f4f9f4209c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4684f10d8914122b555a5f73c161edf, user_id=929dd884102b40a2b3cb00514665927b, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:57:40.734534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: WARNING py.warnings [None req-051a3a04-9e69-438e-9674-26f4f9f4209c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 21:57:40.734534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: warnings.warn(msg) Jun 07 21:57:40.734534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: Jun 07 21:57:40.736435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a3a04-9e69-438e-9674-26f4f9f4209c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:57:40.749035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 754/1501] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 21:57:40 2022] PUT /identity/v3/projects/a4684f10d8914122b555a5f73c161edf/users/929dd884102b40a2b3cb00514665927b/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:57:40.761678 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7ce40-f1b8-4965-ae81-c5f789cb05d1 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:57:40.762000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7ce40-f1b8-4965-ae81-c5f789cb05d1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:57:40.762286 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7ce40-f1b8-4965-ae81-c5f789cb05d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:57:40.788210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-00e7ce40-f1b8-4965-ae81-c5f789cb05d1 None None] MFA Rules not processed for user `929dd884102b40a2b3cb00514665927b`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:57:40.789436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-00e7ce40-f1b8-4965-ae81-c5f789cb05d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:57:40.851786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 748/1502] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 21:57:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:57:40.864987 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282cc94-01cf-4850-aeba-ab6a66d42ad7 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:57:40.865273 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282cc94-01cf-4850-aeba-ab6a66d42ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:57:40.865547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282cc94-01cf-4850-aeba-ab6a66d42ad7 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:57:40.866932 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 755/1503] 10.222.0.18 () {54 vars in 963 bytes} [Tue Jun 7 21:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:57:40.871786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798341b5-9b84-46de-9d15-6720deda1397 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:57:40.872072 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798341b5-9b84-46de-9d15-6720deda1397 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:57:40.872346 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798341b5-9b84-46de-9d15-6720deda1397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:57:40.891453 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-798341b5-9b84-46de-9d15-6720deda1397 None None] MFA Rules not processed for user `5688ba6551834757b7eeef45a15f16e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:57:40.892555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-798341b5-9b84-46de-9d15-6720deda1397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:57:40.933700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:57:40.942227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 749/1504] 10.222.0.18 () {58 vars in 1060 bytes} [Tue Jun 7 21:57:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:57:40.950151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282cc94-01cf-4850-aeba-ab6a66d42ad7 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:57:40.960304 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282cc94-01cf-4850-aeba-ab6a66d42ad7 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:57:40.964369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6557cc9-5ad6-41fe-bd44-c92a37cda657 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:57:40.964988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6557cc9-5ad6-41fe-bd44-c92a37cda657 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:57:40.965263 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6557cc9-5ad6-41fe-bd44-c92a37cda657 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:57:40.965530 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6557cc9-5ad6-41fe-bd44-c92a37cda657 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:57:40.973513 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6557cc9-5ad6-41fe-bd44-c92a37cda657 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:57:40.974947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6557cc9-5ad6-41fe-bd44-c92a37cda657 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:57:40.983746 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 756/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:57:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 21:57:41.027033 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fab7c-5e1a-4dea-a38a-c8773b6a6c26 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:57:41.027318 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fab7c-5e1a-4dea-a38a-c8773b6a6c26 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:57:41.027591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fab7c-5e1a-4dea-a38a-c8773b6a6c26 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:57:41.028902 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 750/1506] 10.222.0.18 () {52 vars in 829 bytes} [Tue Jun 7 21:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:57:41.032356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6557cc9-5ad6-41fe-bd44-c92a37cda657 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:57:41.092026 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6557cc9-5ad6-41fe-bd44-c92a37cda657 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:57:41.096423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657ffde-f5cd-4d59-bcd9-86bb67c199c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:57:41.097273 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657ffde-f5cd-4d59-bcd9-86bb67c199c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:57:41.097550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657ffde-f5cd-4d59-bcd9-86bb67c199c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:57:41.097818 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657ffde-f5cd-4d59-bcd9-86bb67c199c0 admin admin] PATH_INFO: `/v3/users/929dd884102b40a2b3cb00514665927b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:57:41.099004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657ffde-f5cd-4d59-bcd9-86bb67c199c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=929dd884102b40a2b3cb00514665927b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:57:41.100006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: WARNING py.warnings [None req-2657ffde-f5cd-4d59-bcd9-86bb67c199c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 21:57:41.100006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: warnings.warn(msg) Jun 07 21:57:41.100006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: Jun 07 21:57:41.101211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657ffde-f5cd-4d59-bcd9-86bb67c199c0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:57:41.162999 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2657ffde-f5cd-4d59-bcd9-86bb67c199c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '929dd884102b40a2b3cb00514665927b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 21:57:41.174820 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2657ffde-f5cd-4d59-bcd9-86bb67c199c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '929dd884102b40a2b3cb00514665927b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 21:57:41.183979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2657ffde-f5cd-4d59-bcd9-86bb67c199c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '929dd884102b40a2b3cb00514665927b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 21:57:41.184628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2657ffde-f5cd-4d59-bcd9-86bb67c199c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '929dd884102b40a2b3cb00514665927b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 21:57:41.185319 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2657ffde-f5cd-4d59-bcd9-86bb67c199c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '929dd884102b40a2b3cb00514665927b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 21:57:41.201513 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:57:41.210345 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 757/1507] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 21:57:41 2022] DELETE /identity/v3/users/929dd884102b40a2b3cb00514665927b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:57:41.214721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250101e1-4636-4830-9bbb-2036d7ab165b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:57:41.215010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250101e1-4636-4830-9bbb-2036d7ab165b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:57:41.215284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250101e1-4636-4830-9bbb-2036d7ab165b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:57:41.233955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-250101e1-4636-4830-9bbb-2036d7ab165b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:57:41.235164 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-250101e1-4636-4830-9bbb-2036d7ab165b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:57:41.294174 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 751/1508] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 21:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:57:41.304428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657ffde-f5cd-4d59-bcd9-86bb67c199c0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:57:41.306354 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2657ffde-f5cd-4d59-bcd9-86bb67c199c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:57:41.363428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657ffde-f5cd-4d59-bcd9-86bb67c199c0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:57:41.366939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4c505-9f35-41cf-b1b2-3f1fa3ef3fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:57:41.368065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4c505-9f35-41cf-b1b2-3f1fa3ef3fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:57:41.368350 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4c505-9f35-41cf-b1b2-3f1fa3ef3fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:57:41.368614 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4c505-9f35-41cf-b1b2-3f1fa3ef3fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:57:41.377333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4c505-9f35-41cf-b1b2-3f1fa3ef3fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:57:41.378780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4c505-9f35-41cf-b1b2-3f1fa3ef3fb8 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:57:41.388460 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 758/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:57:41.707532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250101e1-4636-4830-9bbb-2036d7ab165b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:57:41.708968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-250101e1-4636-4830-9bbb-2036d7ab165b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:57:41.720836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250101e1-4636-4830-9bbb-2036d7ab165b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:57:41.726711 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac376f3-fb85-4a8c-a672-1e374247ee04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:57:41.728449 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac376f3-fb85-4a8c-a672-1e374247ee04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:57:41.728759 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac376f3-fb85-4a8c-a672-1e374247ee04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:57:41.729305 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac376f3-fb85-4a8c-a672-1e374247ee04 admin admin] PATH_INFO: `/v3/projects/a4684f10d8914122b555a5f73c161edf` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:57:41.731515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac376f3-fb85-4a8c-a672-1e374247ee04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4684f10d8914122b555a5f73c161edf)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:57:41.732898 dv-cinder-835525-4-smb devstack@keystone.service[80404]: WARNING py.warnings [None req-bac376f3-fb85-4a8c-a672-1e374247ee04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 21:57:41.732898 dv-cinder-835525-4-smb devstack@keystone.service[80404]: warnings.warn(msg) Jun 07 21:57:41.732898 dv-cinder-835525-4-smb devstack@keystone.service[80404]: Jun 07 21:57:41.734142 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac376f3-fb85-4a8c-a672-1e374247ee04 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:57:41.794083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-bac376f3-fb85-4a8c-a672-1e374247ee04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4684f10d8914122b555a5f73c161edf', 'request_id': 'req-bac376f3-fb85-4a8c-a672-1e374247ee04'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 21:57:41.800287 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-bac376f3-fb85-4a8c-a672-1e374247ee04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4684f10d8914122b555a5f73c161edf', 'request_id': 'req-bac376f3-fb85-4a8c-a672-1e374247ee04'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 21:57:41.814149 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-bac376f3-fb85-4a8c-a672-1e374247ee04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4684f10d8914122b555a5f73c161edf', 'request_id': 'req-bac376f3-fb85-4a8c-a672-1e374247ee04'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 21:57:41.828854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-bac376f3-fb85-4a8c-a672-1e374247ee04 admin admin] The token cache is being invalidate because project a4684f10d8914122b555a5f73c161edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 21:57:41.829178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-bac376f3-fb85-4a8c-a672-1e374247ee04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 21:57:41.829871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-bac376f3-fb85-4a8c-a672-1e374247ee04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 21:57:41.831460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 752/1510] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 21:57:41 2022] DELETE /identity/v3/projects/a4684f10d8914122b555a5f73c161edf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 21:57:51.384437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:57:51.825724 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:59:20.546264 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbefd4-e70d-4c3d-a0f4-bbb400797e46 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:20.546841 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbefd4-e70d-4c3d-a0f4-bbb400797e46 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:20.546841 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbefd4-e70d-4c3d-a0f4-bbb400797e46 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:20.548178 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 21:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:59:20.553103 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fb2b3-8855-4387-8570-522a529b42e9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:20.553526 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fb2b3-8855-4387-8570-522a529b42e9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:20.553682 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fb2b3-8855-4387-8570-522a529b42e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:20.571865 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e68fb2b3-8855-4387-8570-522a529b42e9 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:59:20.573047 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e68fb2b3-8855-4387-8570-522a529b42e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:59:20.630228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 21:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:59:20.800527 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbefd4-e70d-4c3d-a0f4-bbb400797e46 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:59:20.802868 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-efbbefd4-e70d-4c3d-a0f4-bbb400797e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:59:20.874490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbefd4-e70d-4c3d-a0f4-bbb400797e46 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:59:20.879730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cccc9-1206-4e95-be0a-322062fb9182 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:59:20.880431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cccc9-1206-4e95-be0a-322062fb9182 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:20.880658 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cccc9-1206-4e95-be0a-322062fb9182 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:20.880929 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cccc9-1206-4e95-be0a-322062fb9182 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:20.888821 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5cccc9-1206-4e95-be0a-322062fb9182 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:59:20.890431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5cccc9-1206-4e95-be0a-322062fb9182 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:59:20.900214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 760/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:59:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:59:21.772410 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f49e4-454d-4cc1-aa83-a32c02cb9c76 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:21.772968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f49e4-454d-4cc1-aa83-a32c02cb9c76 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:21.773110 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f49e4-454d-4cc1-aa83-a32c02cb9c76 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:21.774546 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 21:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:59:21.779558 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f0066-ec7b-40fa-b174-d0b8f143ea34 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:21.780010 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f0066-ec7b-40fa-b174-d0b8f143ea34 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:21.780120 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f0066-ec7b-40fa-b174-d0b8f143ea34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:21.801139 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-af7f0066-ec7b-40fa-b174-d0b8f143ea34 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:59:21.802918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-af7f0066-ec7b-40fa-b174-d0b8f143ea34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:59:21.811512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 21:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:59:21.970057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f49e4-454d-4cc1-aa83-a32c02cb9c76 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:59:21.984672 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f49e4-454d-4cc1-aa83-a32c02cb9c76 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:59:21.990586 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8e392-da44-46b7-a9d2-fe7b6031dad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:59:21.991212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8e392-da44-46b7-a9d2-fe7b6031dad9 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:21.991499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8e392-da44-46b7-a9d2-fe7b6031dad9 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:21.991778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8e392-da44-46b7-a9d2-fe7b6031dad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:21.999828 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8e392-da44-46b7-a9d2-fe7b6031dad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:59:22.001422 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8e392-da44-46b7-a9d2-fe7b6031dad9 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:59:22.011309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 755/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:59:22.015884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fc982-6e93-4663-820c-985b7019c106 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:22.016197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fc982-6e93-4663-820c-985b7019c106 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:22.016850 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fc982-6e93-4663-820c-985b7019c106 None None] PATH_INFO: `/v3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:22.017801 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 762/1517] 10.222.0.42 () {54 vars in 925 bytes} [Tue Jun 7 21:59:22 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 21:59:22.023829 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16898d4b-9581-401a-b354-3cea99cffdef None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:22.024120 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16898d4b-9581-401a-b354-3cea99cffdef None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:22.024518 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16898d4b-9581-401a-b354-3cea99cffdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:22.043360 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-16898d4b-9581-401a-b354-3cea99cffdef None None] MFA Rules not processed for user `90facf92f97d435dbe8a001759a8fe0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:59:22.044563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-16898d4b-9581-401a-b354-3cea99cffdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:59:22.111542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 756/1518] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Jun 7 21:59:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:59:26.129429 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea3eda-e0d8-4800-8ab7-bec02720252b None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:26.130005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea3eda-e0d8-4800-8ab7-bec02720252b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:26.130005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea3eda-e0d8-4800-8ab7-bec02720252b None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:26.131899 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 763/1519] 10.222.0.18 () {54 vars in 960 bytes} [Tue Jun 7 21:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:59:26.136786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3637ae-3e03-4c14-bbc8-33c64a105e15 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:26.137259 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3637ae-3e03-4c14-bbc8-33c64a105e15 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:26.137416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3637ae-3e03-4c14-bbc8-33c64a105e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:26.157437 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3d3637ae-3e03-4c14-bbc8-33c64a105e15 None None] MFA Rules not processed for user `90facf92f97d435dbe8a001759a8fe0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:59:26.158672 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3d3637ae-3e03-4c14-bbc8-33c64a105e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:59:26.169214 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 757/1520] 10.222.0.18 () {58 vars in 1057 bytes} [Tue Jun 7 21:59:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:59:26.178624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea3eda-e0d8-4800-8ab7-bec02720252b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:59:26.196230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea3eda-e0d8-4800-8ab7-bec02720252b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:59:26.201857 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503afefe-483f-4ae5-880a-f75259196a0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90facf92f97d435dbe8a001759a8fe0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:59:26.202576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503afefe-483f-4ae5-880a-f75259196a0a service placement] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:26.202861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503afefe-483f-4ae5-880a-f75259196a0a service placement] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:26.203196 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503afefe-483f-4ae5-880a-f75259196a0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:26.211822 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503afefe-483f-4ae5-880a-f75259196a0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:59:26.213466 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503afefe-483f-4ae5-880a-f75259196a0a service placement] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:59:26.223400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 764/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:59:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:59:33.264405 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df68eb-ffb2-4ea0-997a-232a8a511891 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:33.264981 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df68eb-ffb2-4ea0-997a-232a8a511891 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:33.264981 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df68eb-ffb2-4ea0-997a-232a8a511891 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:33.266345 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 21:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:59:33.271589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30c56f-b9b9-4dba-8d56-723fee8eaab1 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:33.271981 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30c56f-b9b9-4dba-8d56-723fee8eaab1 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:33.272142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30c56f-b9b9-4dba-8d56-723fee8eaab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:33.289711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8b30c56f-b9b9-4dba-8d56-723fee8eaab1 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:59:33.290927 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8b30c56f-b9b9-4dba-8d56-723fee8eaab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:59:33.298572 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 21:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:59:33.450462 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df68eb-ffb2-4ea0-997a-232a8a511891 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:59:33.465077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df68eb-ffb2-4ea0-997a-232a8a511891 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:59:33.470380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd569430-5cf8-4b19-9488-77c71c98e99f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:59:33.471004 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd569430-5cf8-4b19-9488-77c71c98e99f service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:33.471284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd569430-5cf8-4b19-9488-77c71c98e99f service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:33.471555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd569430-5cf8-4b19-9488-77c71c98e99f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:33.479912 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd569430-5cf8-4b19-9488-77c71c98e99f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:59:33.481494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd569430-5cf8-4b19-9488-77c71c98e99f service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:59:33.490844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 759/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:59:34.353910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6093cb-e3e0-4cd6-87d0-7ad2b27946b8 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:34.354478 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6093cb-e3e0-4cd6-87d0-7ad2b27946b8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:34.354478 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6093cb-e3e0-4cd6-87d0-7ad2b27946b8 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:34.356122 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 21:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:59:34.360960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b12f6-bc74-4666-ba96-93ee6e067a27 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:34.361394 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b12f6-bc74-4666-ba96-93ee6e067a27 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:34.361532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b12f6-bc74-4666-ba96-93ee6e067a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:34.380625 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a31b12f6-bc74-4666-ba96-93ee6e067a27 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:59:34.381816 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a31b12f6-bc74-4666-ba96-93ee6e067a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:59:34.389844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 21:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:59:34.539056 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6093cb-e3e0-4cd6-87d0-7ad2b27946b8 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:59:34.553727 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6093cb-e3e0-4cd6-87d0-7ad2b27946b8 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:59:34.558930 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7038e-cfd7-437a-864f-23b479543fad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:59:34.559551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7038e-cfd7-437a-864f-23b479543fad service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:34.559828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7038e-cfd7-437a-864f-23b479543fad service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:34.560096 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7038e-cfd7-437a-864f-23b479543fad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:34.568725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7038e-cfd7-437a-864f-23b479543fad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:59:34.570323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7038e-cfd7-437a-864f-23b479543fad service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:59:34.579404 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 767/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:59:38.581828 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245804c2-2c68-4736-8a68-8e838c82528f None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:38.582385 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245804c2-2c68-4736-8a68-8e838c82528f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:38.582385 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245804c2-2c68-4736-8a68-8e838c82528f None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:38.584408 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 21:59:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:59:38.589660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1432d45-d3d5-4db9-bdc2-f845d6cec8f0 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:38.590138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1432d45-d3d5-4db9-bdc2-f845d6cec8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:38.590235 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1432d45-d3d5-4db9-bdc2-f845d6cec8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:38.608313 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f1432d45-d3d5-4db9-bdc2-f845d6cec8f0 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:59:38.609518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f1432d45-d3d5-4db9-bdc2-f845d6cec8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:59:38.617383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 21:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:59:38.653861 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245804c2-2c68-4736-8a68-8e838c82528f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:59:38.655559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-245804c2-2c68-4736-8a68-8e838c82528f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:59:38.711813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245804c2-2c68-4736-8a68-8e838c82528f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:59:38.715311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb481e-7155-44c5-9b01-68119685cb55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:59:38.715942 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb481e-7155-44c5-9b01-68119685cb55 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:38.716224 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb481e-7155-44c5-9b01-68119685cb55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:38.716500 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb481e-7155-44c5-9b01-68119685cb55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:38.725177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb481e-7155-44c5-9b01-68119685cb55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:59:38.726629 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb481e-7155-44c5-9b01-68119685cb55 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:59:38.731688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:59:38.736682 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 762/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:59:40.946088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0d4cc-6fab-46ee-aebc-ec19a97d846b None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:40.946664 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0d4cc-6fab-46ee-aebc-ec19a97d846b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:40.946664 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0d4cc-6fab-46ee-aebc-ec19a97d846b None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:40.948018 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 21:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:59:40.953313 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7641e9-b19b-4355-b18d-a9b47b7a9d0c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:40.953711 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7641e9-b19b-4355-b18d-a9b47b7a9d0c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:40.953871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7641e9-b19b-4355-b18d-a9b47b7a9d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:40.971625 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ee7641e9-b19b-4355-b18d-a9b47b7a9d0c None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:59:40.972797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ee7641e9-b19b-4355-b18d-a9b47b7a9d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:59:40.981246 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 21:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:59:41.017236 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0d4cc-6fab-46ee-aebc-ec19a97d846b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:59:41.018894 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6cd0d4cc-6fab-46ee-aebc-ec19a97d846b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:59:41.031746 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0d4cc-6fab-46ee-aebc-ec19a97d846b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:59:41.035240 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f71039-bed9-444f-a1d6-c40753239a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:59:41.035864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f71039-bed9-444f-a1d6-c40753239a44 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:41.036968 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f71039-bed9-444f-a1d6-c40753239a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:41.037243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f71039-bed9-444f-a1d6-c40753239a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:41.046173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f71039-bed9-444f-a1d6-c40753239a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:59:41.047595 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f71039-bed9-444f-a1d6-c40753239a44 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:59:41.057494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 770/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:59:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:59:44.724194 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d289-9fb2-45dd-92e3-a2db30714d69 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:44.724752 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d289-9fb2-45dd-92e3-a2db30714d69 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:44.724752 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d289-9fb2-45dd-92e3-a2db30714d69 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:44.726052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 21:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:59:44.731446 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dae30-877e-4667-9dcd-218fb39f1af9 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:44.731893 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dae30-877e-4667-9dcd-218fb39f1af9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:44.732000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dae30-877e-4667-9dcd-218fb39f1af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:44.738295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=62 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:59:44.751525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-998dae30-877e-4667-9dcd-218fb39f1af9 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:59:44.752692 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-998dae30-877e-4667-9dcd-218fb39f1af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:59:44.760595 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 21:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:59:45.027261 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3d289-9fb2-45dd-92e3-a2db30714d69 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:59:45.029088 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-61e3d289-9fb2-45dd-92e3-a2db30714d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:59:45.085461 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3d289-9fb2-45dd-92e3-a2db30714d69 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:59:45.089038 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd040bd-b07e-4792-89c4-32d948cc0294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:59:45.089711 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd040bd-b07e-4792-89c4-32d948cc0294 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:45.090031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd040bd-b07e-4792-89c4-32d948cc0294 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:45.090313 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd040bd-b07e-4792-89c4-32d948cc0294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:45.099708 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd040bd-b07e-4792-89c4-32d948cc0294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:59:45.101142 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd040bd-b07e-4792-89c4-32d948cc0294 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:59:45.110661 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 765/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:59:47.344814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5201ee-794b-4be8-a0a7-dedd3bb95802 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:47.345384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5201ee-794b-4be8-a0a7-dedd3bb95802 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:47.345384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5201ee-794b-4be8-a0a7-dedd3bb95802 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:47.346752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 21:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 21:59:47.352096 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a43cd5-d117-4c68-8259-d08cc3959545 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:47.352563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a43cd5-d117-4c68-8259-d08cc3959545 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:47.352670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a43cd5-d117-4c68-8259-d08cc3959545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:47.371177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-13a43cd5-d117-4c68-8259-d08cc3959545 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 21:59:47.372344 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-13a43cd5-d117-4c68-8259-d08cc3959545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:59:47.380505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 21:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 21:59:47.647191 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5201ee-794b-4be8-a0a7-dedd3bb95802 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 21:59:47.648823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-de5201ee-794b-4be8-a0a7-dedd3bb95802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 21:59:47.661436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5201ee-794b-4be8-a0a7-dedd3bb95802 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 21:59:47.664912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbb494-4a35-4c13-b7e4-298162f36490 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 21:59:47.665532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbb494-4a35-4c13-b7e4-298162f36490 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 21:59:47.665862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbb494-4a35-4c13-b7e4-298162f36490 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 21:59:47.666171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbb494-4a35-4c13-b7e4-298162f36490 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 21:59:47.674853 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dbb494-4a35-4c13-b7e4-298162f36490 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 21:59:47.676258 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dbb494-4a35-4c13-b7e4-298162f36490 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 21:59:47.685384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 773/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 21:59:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 21:59:57.366070 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=32 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 21:59:57.681406 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=8 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:22.575875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497f9ba-a333-40ad-84a5-4957803dc6cf None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:22.576948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497f9ba-a333-40ad-84a5-4957803dc6cf None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:22.577465 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497f9ba-a333-40ad-84a5-4957803dc6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:22.607041 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4497f9ba-a333-40ad-84a5-4957803dc6cf None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:22.608608 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4497f9ba-a333-40ad-84a5-4957803dc6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:22.619184 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 767/1540] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:22.628101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe8dae-5276-4103-9459-63135bc9ab15 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:22.629121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe8dae-5276-4103-9459-63135bc9ab15 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:22.629612 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe8dae-5276-4103-9459-63135bc9ab15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:22.657278 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-58fe8dae-5276-4103-9459-63135bc9ab15 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:22.658677 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-58fe8dae-5276-4103-9459-63135bc9ab15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:22.674623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 774/1541] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:22.679662 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497f9ba-a333-40ad-84a5-4957803dc6cf None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:22.694603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497f9ba-a333-40ad-84a5-4957803dc6cf None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:22.700330 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad91fa-5ecd-4805-81d1-f8cc2d890cf7 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:22.700927 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad91fa-5ecd-4805-81d1-f8cc2d890cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:22.701557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad91fa-5ecd-4805-81d1-f8cc2d890cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:22.706064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef876c-4793-4d8c-86ef-84d22b55ad6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:22.706782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef876c-4793-4d8c-86ef-84d22b55ad6d admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:22.707292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef876c-4793-4d8c-86ef-84d22b55ad6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:22.707728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef876c-4793-4d8c-86ef-84d22b55ad6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:22.709162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef876c-4793-4d8c-86ef-84d22b55ad6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:01:22.709642 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef876c-4793-4d8c-86ef-84d22b55ad6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:22.711441 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef876c-4793-4d8c-86ef-84d22b55ad6d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:22.729719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 768/1542] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:01:22.737523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d2ad91fa-5ecd-4805-81d1-f8cc2d890cf7 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:22.738353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef876c-4793-4d8c-86ef-84d22b55ad6d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:22.738794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d2ad91fa-5ecd-4805-81d1-f8cc2d890cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:22.753467 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef876c-4793-4d8c-86ef-84d22b55ad6d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:22.755893 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 775/1543] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:01:22.766577 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e2fc7-435f-4ea2-8b6e-fd3a61debead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:22.767260 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e2fc7-435f-4ea2-8b6e-fd3a61debead admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:22.767544 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e2fc7-435f-4ea2-8b6e-fd3a61debead admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:22.767820 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e2fc7-435f-4ea2-8b6e-fd3a61debead admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:22.768618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f4f00-e1f9-4d41-834c-8d0d55103fbd None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:22.768748 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e2fc7-435f-4ea2-8b6e-fd3a61debead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:22.769185 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f4f00-e1f9-4d41-834c-8d0d55103fbd None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:22.769631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f4f00-e1f9-4d41-834c-8d0d55103fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:22.769754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: WARNING py.warnings [None req-d58e2fc7-435f-4ea2-8b6e-fd3a61debead admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 22:01:22.769754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: warnings.warn(msg) Jun 07 22:01:22.769754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: Jun 07 22:01:22.772000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e2fc7-435f-4ea2-8b6e-fd3a61debead admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:22.803880 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-805f4f00-e1f9-4d41-834c-8d0d55103fbd None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:22.805137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-805f4f00-e1f9-4d41-834c-8d0d55103fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:22.820250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 776/1544] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:01:22.821231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 769/1545] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:22 2022] POST /identity/v3/projects => generated 403 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:22.822154 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f86f96-bf45-464f-97af-b4041ab9c2de None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:22.822387 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f86f96-bf45-464f-97af-b4041ab9c2de None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:22.822667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f86f96-bf45-464f-97af-b4041ab9c2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:22.825367 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e2fc7-435f-4ea2-8b6e-fd3a61debead admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:22.859775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c4f86f96-bf45-464f-97af-b4041ab9c2de None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:22.860912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c4f86f96-bf45-464f-97af-b4041ab9c2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:22.939856 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e2fc7-435f-4ea2-8b6e-fd3a61debead admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:22.950173 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe47e93-375a-488e-b238-20e81ac70017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:22.950856 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe47e93-375a-488e-b238-20e81ac70017 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:22.951134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe47e93-375a-488e-b238-20e81ac70017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:22.951406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe47e93-375a-488e-b238-20e81ac70017 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:22.952101 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe47e93-375a-488e-b238-20e81ac70017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:22.955088 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe47e93-375a-488e-b238-20e81ac70017 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:22.975389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 777/1546] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:22.976376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f86f96-bf45-464f-97af-b4041ab9c2de None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:22.990586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f86f96-bf45-464f-97af-b4041ab9c2de None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:22.991282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 770/1547] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:22 2022] POST /identity/v3/users => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:22.993752 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5853cf3-5422-4b73-b79e-8aed828aad30 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:22.994117 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5853cf3-5422-4b73-b79e-8aed828aad30 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:22.994396 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5853cf3-5422-4b73-b79e-8aed828aad30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:22.995764 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ccecd-de27-4dd4-982c-76fae2b4f53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:22.996328 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ccecd-de27-4dd4-982c-76fae2b4f53f admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:22.996612 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ccecd-de27-4dd4-982c-76fae2b4f53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:22.996886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ccecd-de27-4dd4-982c-76fae2b4f53f admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:22.997614 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ccecd-de27-4dd4-982c-76fae2b4f53f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:01:22.997944 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ccecd-de27-4dd4-982c-76fae2b4f53f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:22.999011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: WARNING py.warnings [None req-583ccecd-de27-4dd4-982c-76fae2b4f53f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 22:01:22.999011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: warnings.warn(msg) Jun 07 22:01:22.999011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: Jun 07 22:01:22.999894 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ccecd-de27-4dd4-982c-76fae2b4f53f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.013510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c5853cf3-5422-4b73-b79e-8aed828aad30 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:23.014741 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c5853cf3-5422-4b73-b79e-8aed828aad30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:23.015722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 778/1548] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:01:23.017381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb49ed1-843b-47ba-b4c2-529422c76317 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.017741 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb49ed1-843b-47ba-b4c2-529422c76317 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.018121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb49ed1-843b-47ba-b4c2-529422c76317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.031914 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 771/1549] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:23.033482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b616af-2935-43fd-9016-eb344bba506e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.033779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b616af-2935-43fd-9016-eb344bba506e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.034289 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b616af-2935-43fd-9016-eb344bba506e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.038871 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4cb49ed1-843b-47ba-b4c2-529422c76317 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:23.040277 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4cb49ed1-843b-47ba-b4c2-529422c76317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:23.048187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 779/1550] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:23.049409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ece85-33d4-4264-9f22-d4056b18dd6e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.049696 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ece85-33d4-4264-9f22-d4056b18dd6e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.049994 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ece85-33d4-4264-9f22-d4056b18dd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.053374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b0b616af-2935-43fd-9016-eb344bba506e None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:23.054585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b0b616af-2935-43fd-9016-eb344bba506e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:23.062540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 772/1551] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:23.063753 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cfa4b-c9c6-42e2-be9a-0a1879792f56 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.064041 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cfa4b-c9c6-42e2-be9a-0a1879792f56 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.064311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cfa4b-c9c6-42e2-be9a-0a1879792f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.078417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-fe2ece85-33d4-4264-9f22-d4056b18dd6e None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:23.079619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fe2ece85-33d4-4264-9f22-d4056b18dd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:23.082213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-559cfa4b-c9c6-42e2-be9a-0a1879792f56 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:23.083401 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-559cfa4b-c9c6-42e2-be9a-0a1879792f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:23.087565 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 780/1552] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:23.092855 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ece85-33d4-4264-9f22-d4056b18dd6e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.094768 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 773/1553] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:23.095585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cfa4b-c9c6-42e2-be9a-0a1879792f56 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.098387 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ece85-33d4-4264-9f22-d4056b18dd6e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.102979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7bd35-f95c-4dbd-b4d3-51e47306ef09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.103632 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7bd35-f95c-4dbd-b4d3-51e47306ef09 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.103913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7bd35-f95c-4dbd-b4d3-51e47306ef09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.104186 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7bd35-f95c-4dbd-b4d3-51e47306ef09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.104795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cfa4b-c9c6-42e2-be9a-0a1879792f56 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.104911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7bd35-f95c-4dbd-b4d3-51e47306ef09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.106784 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7bd35-f95c-4dbd-b4d3-51e47306ef09 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.109546 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628b02c-56db-4f4f-9b10-5baff9ae84b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.110258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628b02c-56db-4f4f-9b10-5baff9ae84b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.110487 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628b02c-56db-4f4f-9b10-5baff9ae84b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.110766 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628b02c-56db-4f4f-9b10-5baff9ae84b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.111446 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628b02c-56db-4f4f-9b10-5baff9ae84b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.113342 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628b02c-56db-4f4f-9b10-5baff9ae84b3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.117188 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 781/1554] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:23.118537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e575429-1170-40f9-beb1-79b89d719303 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.118826 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e575429-1170-40f9-beb1-79b89d719303 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.119102 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e575429-1170-40f9-beb1-79b89d719303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.137097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4e575429-1170-40f9-beb1-79b89d719303 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:23.138327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4e575429-1170-40f9-beb1-79b89d719303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:23.142656 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 774/1555] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:23.143845 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fad1ce-19ff-402f-905f-e40060afd0b4 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.144133 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fad1ce-19ff-402f-905f-e40060afd0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.144412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fad1ce-19ff-402f-905f-e40060afd0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.149302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 782/1556] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:23.155502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8d459-9ecb-43ee-91d4-e3b5ec41ad2a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.155893 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8d459-9ecb-43ee-91d4-e3b5ec41ad2a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.156174 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8d459-9ecb-43ee-91d4-e3b5ec41ad2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.163801 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-24fad1ce-19ff-402f-905f-e40060afd0b4 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:23.165039 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-24fad1ce-19ff-402f-905f-e40060afd0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:23.174600 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-32f8d459-9ecb-43ee-91d4-e3b5ec41ad2a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:23.175745 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-32f8d459-9ecb-43ee-91d4-e3b5ec41ad2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:23.223929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 775/1557] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:23.225210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48464693-a35d-41cc-b4a0-25ca77c8bf5a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.225498 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48464693-a35d-41cc-b4a0-25ca77c8bf5a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.225773 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48464693-a35d-41cc-b4a0-25ca77c8bf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.238200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:23.240452 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 783/1558] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:23.241397 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8d459-9ecb-43ee-91d4-e3b5ec41ad2a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.248253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-48464693-a35d-41cc-b4a0-25ca77c8bf5a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:23.249722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-48464693-a35d-41cc-b4a0-25ca77c8bf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:23.250995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8d459-9ecb-43ee-91d4-e3b5ec41ad2a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.256165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3c233-99fc-49ea-a33c-f345871d8053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.256805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3c233-99fc-49ea-a33c-f345871d8053 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.257099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3c233-99fc-49ea-a33c-f345871d8053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.257352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3c233-99fc-49ea-a33c-f345871d8053 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.258089 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3c233-99fc-49ea-a33c-f345871d8053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:01:23.258306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 776/1559] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:23.258499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3c233-99fc-49ea-a33c-f345871d8053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.259495 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9acb1-23d0-433f-b9ee-aabe0c5dea77 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.259784 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9acb1-23d0-433f-b9ee-aabe0c5dea77 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.259966 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3c233-99fc-49ea-a33c-f345871d8053 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.260105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9acb1-23d0-433f-b9ee-aabe0c5dea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.272778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 784/1560] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:01:23.273596 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3c233-99fc-49ea-a33c-f345871d8053 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.278006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-85e9acb1-23d0-433f-b9ee-aabe0c5dea77 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:23.279419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-85e9acb1-23d0-433f-b9ee-aabe0c5dea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:23.283298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3c233-99fc-49ea-a33c-f345871d8053 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.287587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 777/1561] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:23.287721 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fb7fd-0e5a-4c20-98a2-dd57048de485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.288333 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9acb1-23d0-433f-b9ee-aabe0c5dea77 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.288444 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fb7fd-0e5a-4c20-98a2-dd57048de485 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.288757 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fb7fd-0e5a-4c20-98a2-dd57048de485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.289035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fb7fd-0e5a-4c20-98a2-dd57048de485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.289748 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fb7fd-0e5a-4c20-98a2-dd57048de485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.291765 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fb7fd-0e5a-4c20-98a2-dd57048de485 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.297358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9acb1-23d0-433f-b9ee-aabe0c5dea77 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.302362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bd81c-e6f2-418d-af67-2373b501b3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.302999 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd81c-e6f2-418d-af67-2373b501b3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.303249 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 785/1562] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:23.303370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd81c-e6f2-418d-af67-2373b501b3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.303550 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd81c-e6f2-418d-af67-2373b501b3d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.304222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bd81c-e6f2-418d-af67-2373b501b3d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.304482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b1020-fed9-436f-bac3-a9dd43fb7538 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.304774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b1020-fed9-436f-bac3-a9dd43fb7538 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.305054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b1020-fed9-436f-bac3-a9dd43fb7538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.306154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bd81c-e6f2-418d-af67-2373b501b3d9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.323634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d52b1020-fed9-436f-bac3-a9dd43fb7538 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:23.324917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d52b1020-fed9-436f-bac3-a9dd43fb7538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:23.327663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 778/1563] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/users => generated 290 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:23.328467 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bd81c-e6f2-418d-af67-2373b501b3d9 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.337979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 786/1564] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:23.338797 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b1020-fed9-436f-bac3-a9dd43fb7538 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.341960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bd81c-e6f2-418d-af67-2373b501b3d9 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.346718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72a739-e374-4c68-88a2-a4d0546d6121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.347363 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72a739-e374-4c68-88a2-a4d0546d6121 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.347652 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72a739-e374-4c68-88a2-a4d0546d6121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.347933 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72a739-e374-4c68-88a2-a4d0546d6121 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.348209 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b1020-fed9-436f-bac3-a9dd43fb7538 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.348666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72a739-e374-4c68-88a2-a4d0546d6121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:01:23.348975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72a739-e374-4c68-88a2-a4d0546d6121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.350660 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72a739-e374-4c68-88a2-a4d0546d6121 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.356456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffd355-36ff-434a-b9b8-1b237208fd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.357108 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffd355-36ff-434a-b9b8-1b237208fd05 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.357391 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffd355-36ff-434a-b9b8-1b237208fd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.358047 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffd355-36ff-434a-b9b8-1b237208fd05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.358657 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffd355-36ff-434a-b9b8-1b237208fd05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:01:23.358994 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffd355-36ff-434a-b9b8-1b237208fd05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.360846 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffd355-36ff-434a-b9b8-1b237208fd05 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.363507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 779/1565] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:01:23.364899 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72a739-e374-4c68-88a2-a4d0546d6121 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.372340 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:23.374838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 787/1566] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:01:23.375032 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72a739-e374-4c68-88a2-a4d0546d6121 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.376355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffd355-36ff-434a-b9b8-1b237208fd05 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.381075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f28e58-ebb2-4b76-a4ae-14be159e815b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.381733 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f28e58-ebb2-4b76-a4ae-14be159e815b admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.382043 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f28e58-ebb2-4b76-a4ae-14be159e815b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.382418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f28e58-ebb2-4b76-a4ae-14be159e815b admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.383208 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f28e58-ebb2-4b76-a4ae-14be159e815b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:01:23.383524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f28e58-ebb2-4b76-a4ae-14be159e815b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.385114 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f28e58-ebb2-4b76-a4ae-14be159e815b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.392189 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffd355-36ff-434a-b9b8-1b237208fd05 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.396696 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04171c3a-9b35-4555-a5c5-1b8f62174bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.397147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 780/1567] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:01:23.397537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04171c3a-9b35-4555-a5c5-1b8f62174bce admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.397824 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04171c3a-9b35-4555-a5c5-1b8f62174bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.398008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f28e58-ebb2-4b76-a4ae-14be159e815b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.398247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04171c3a-9b35-4555-a5c5-1b8f62174bce admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.398982 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04171c3a-9b35-4555-a5c5-1b8f62174bce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.400893 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04171c3a-9b35-4555-a5c5-1b8f62174bce admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.407881 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f28e58-ebb2-4b76-a4ae-14be159e815b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.412968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffa473-0418-4e95-a92d-a7c52019a65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.413601 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffa473-0418-4e95-a92d-a7c52019a65f admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.413884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffa473-0418-4e95-a92d-a7c52019a65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.414188 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffa473-0418-4e95-a92d-a7c52019a65f admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.414903 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffa473-0418-4e95-a92d-a7c52019a65f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:01:23.415216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffa473-0418-4e95-a92d-a7c52019a65f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.416900 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffa473-0418-4e95-a92d-a7c52019a65f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.430721 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 788/1568] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:23.430721 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04171c3a-9b35-4555-a5c5-1b8f62174bce admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.430953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 781/1569] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:01:23.431268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffa473-0418-4e95-a92d-a7c52019a65f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.441895 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffa473-0418-4e95-a92d-a7c52019a65f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.491735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04171c3a-9b35-4555-a5c5-1b8f62174bce admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.496337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a1939-5698-4e93-bf26-19aa22e3743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.497225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a1939-5698-4e93-bf26-19aa22e3743e admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.497511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a1939-5698-4e93-bf26-19aa22e3743e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.497791 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a1939-5698-4e93-bf26-19aa22e3743e admin admin] PATH_INFO: `/v3/projects/043e0b3a51084baaaa88dd37762985e3/users/1d56d137e7954d6981f7553939632668/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.498471 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dae6d8-4cf7-4b9e-86c0-8afc1d0b893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.499133 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dae6d8-4cf7-4b9e-86c0-8afc1d0b893b admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.499426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dae6d8-4cf7-4b9e-86c0-8afc1d0b893b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.499691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dae6d8-4cf7-4b9e-86c0-8afc1d0b893b admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.500410 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dae6d8-4cf7-4b9e-86c0-8afc1d0b893b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.502022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dae6d8-4cf7-4b9e-86c0-8afc1d0b893b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.511716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 782/1570] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:23.514750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a1939-5698-4e93-bf26-19aa22e3743e admin admin] RBAC: Authorizing `identity:create_grant(project_id=043e0b3a51084baaaa88dd37762985e3, user_id=1d56d137e7954d6981f7553939632668, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.514866 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dae6d8-4cf7-4b9e-86c0-8afc1d0b893b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.515120 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a1939-5698-4e93-bf26-19aa22e3743e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.522771 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dae6d8-4cf7-4b9e-86c0-8afc1d0b893b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.527810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 789/1571] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:23 2022] PUT /identity/v3/projects/043e0b3a51084baaaa88dd37762985e3/users/1d56d137e7954d6981f7553939632668/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:23.531424 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a1939-5698-4e93-bf26-19aa22e3743e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.584208 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18cb11-7844-4fce-b44a-1e09a8dad316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.584902 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18cb11-7844-4fce-b44a-1e09a8dad316 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.585184 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18cb11-7844-4fce-b44a-1e09a8dad316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.585555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18cb11-7844-4fce-b44a-1e09a8dad316 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.586228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18cb11-7844-4fce-b44a-1e09a8dad316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:01:23.586536 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18cb11-7844-4fce-b44a-1e09a8dad316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.588129 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18cb11-7844-4fce-b44a-1e09a8dad316 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.590754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a1939-5698-4e93-bf26-19aa22e3743e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.595825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1215b5-d77a-46ba-8dec-42bcf2d4f9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.596919 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1215b5-d77a-46ba-8dec-42bcf2d4f9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.597208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1215b5-d77a-46ba-8dec-42bcf2d4f9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.597493 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1215b5-d77a-46ba-8dec-42bcf2d4f9a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.598213 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1215b5-d77a-46ba-8dec-42bcf2d4f9a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.600092 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 783/1572] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:01:23.600666 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1215b5-d77a-46ba-8dec-42bcf2d4f9a0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.600931 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18cb11-7844-4fce-b44a-1e09a8dad316 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.612479 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18cb11-7844-4fce-b44a-1e09a8dad316 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.617672 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe9490-78f9-46ef-bee8-69313bfb4edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.618338 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe9490-78f9-46ef-bee8-69313bfb4edf admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.618625 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe9490-78f9-46ef-bee8-69313bfb4edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.618905 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe9490-78f9-46ef-bee8-69313bfb4edf admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.619586 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe9490-78f9-46ef-bee8-69313bfb4edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.622025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe9490-78f9-46ef-bee8-69313bfb4edf admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.630303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 790/1573] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:23.634194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1215b5-d77a-46ba-8dec-42bcf2d4f9a0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.652048 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 784/1574] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:23.652048 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe9490-78f9-46ef-bee8-69313bfb4edf admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.655456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:23.678181 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:23.698709 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1215b5-d77a-46ba-8dec-42bcf2d4f9a0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.713783 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe9490-78f9-46ef-bee8-69313bfb4edf admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.718800 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4005f7-2f16-41b2-8b9e-a43cb9533870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.719485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4005f7-2f16-41b2-8b9e-a43cb9533870 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.719771 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4005f7-2f16-41b2-8b9e-a43cb9533870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.720044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4005f7-2f16-41b2-8b9e-a43cb9533870 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.720729 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4005f7-2f16-41b2-8b9e-a43cb9533870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.722769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4005f7-2f16-41b2-8b9e-a43cb9533870 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.747148 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 785/1575] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:23.747148 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4005f7-2f16-41b2-8b9e-a43cb9533870 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.754473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4005f7-2f16-41b2-8b9e-a43cb9533870 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.755414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad88a3-15fa-46c1-8e86-8ee01071bf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.756084 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad88a3-15fa-46c1-8e86-8ee01071bf40 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.756488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad88a3-15fa-46c1-8e86-8ee01071bf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.756888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad88a3-15fa-46c1-8e86-8ee01071bf40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.757575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad88a3-15fa-46c1-8e86-8ee01071bf40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.759233 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dc754-ee41-4312-8fd6-e43aa8c521c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.759645 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad88a3-15fa-46c1-8e86-8ee01071bf40 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.759931 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc754-ee41-4312-8fd6-e43aa8c521c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.760144 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc754-ee41-4312-8fd6-e43aa8c521c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.760418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc754-ee41-4312-8fd6-e43aa8c521c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.761093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dc754-ee41-4312-8fd6-e43aa8c521c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.763023 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dc754-ee41-4312-8fd6-e43aa8c521c9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.789376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 791/1576] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:23.789376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad88a3-15fa-46c1-8e86-8ee01071bf40 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.792252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 786/1577] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:23.793403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e42592-eaf4-4a62-bc58-033f70ea1459 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.793694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e42592-eaf4-4a62-bc58-033f70ea1459 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.794023 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e42592-eaf4-4a62-bc58-033f70ea1459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.813200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c6e42592-eaf4-4a62-bc58-033f70ea1459 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:23.814423 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c6e42592-eaf4-4a62-bc58-033f70ea1459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:23.853178 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad88a3-15fa-46c1-8e86-8ee01071bf40 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.874734 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 787/1578] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:23.875616 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e42592-eaf4-4a62-bc58-033f70ea1459 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.885269 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e42592-eaf4-4a62-bc58-033f70ea1459 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.889908 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46180aae-28dd-48ff-a0e6-acb127957351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.890580 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46180aae-28dd-48ff-a0e6-acb127957351 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.890865 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46180aae-28dd-48ff-a0e6-acb127957351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.891140 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46180aae-28dd-48ff-a0e6-acb127957351 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.891859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46180aae-28dd-48ff-a0e6-acb127957351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.893975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46180aae-28dd-48ff-a0e6-acb127957351 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.915279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367e2da-9d53-461f-8d78-c1d44780ddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.916019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367e2da-9d53-461f-8d78-c1d44780ddce admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.916294 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367e2da-9d53-461f-8d78-c1d44780ddce admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.916570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367e2da-9d53-461f-8d78-c1d44780ddce admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.917327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367e2da-9d53-461f-8d78-c1d44780ddce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.919609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367e2da-9d53-461f-8d78-c1d44780ddce admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:23.923982 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 788/1579] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:23.923982 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46180aae-28dd-48ff-a0e6-acb127957351 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.933133 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 792/1580] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:23.933133 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367e2da-9d53-461f-8d78-c1d44780ddce admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:23.942440 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367e2da-9d53-461f-8d78-c1d44780ddce admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.954058 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:23.975667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:23.989029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46180aae-28dd-48ff-a0e6-acb127957351 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:23.993840 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c4c8a-e823-4e47-b4e4-62641d2d13ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:23.994539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4c8a-e823-4e47-b4e4-62641d2d13ef admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:23.994825 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4c8a-e823-4e47-b4e4-62641d2d13ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:23.995096 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4c8a-e823-4e47-b4e4-62641d2d13ef admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:23.995786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c4c8a-e823-4e47-b4e4-62641d2d13ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:23.997702 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c4c8a-e823-4e47-b4e4-62641d2d13ef admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.001576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47e571-b0cb-435c-a6db-83c73372b399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.002279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47e571-b0cb-435c-a6db-83c73372b399 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.002566 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47e571-b0cb-435c-a6db-83c73372b399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.002843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47e571-b0cb-435c-a6db-83c73372b399 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.003526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47e571-b0cb-435c-a6db-83c73372b399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.004742 dv-cinder-835525-4-smb devstack@keystone.service[80403]: WARNING py.warnings [None req-0a47e571-b0cb-435c-a6db-83c73372b399 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 22:01:24.004742 dv-cinder-835525-4-smb devstack@keystone.service[80403]: warnings.warn(msg) Jun 07 22:01:24.004742 dv-cinder-835525-4-smb devstack@keystone.service[80403]: Jun 07 22:01:24.006822 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47e571-b0cb-435c-a6db-83c73372b399 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.017607 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 789/1581] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:24.022196 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c4c8a-e823-4e47-b4e4-62641d2d13ef admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.027524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 793/1582] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:23 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:24.028357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47e571-b0cb-435c-a6db-83c73372b399 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.031610 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c4c8a-e823-4e47-b4e4-62641d2d13ef admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.036943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b61389-b62c-4c65-93d4-0016a0507637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.037626 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b61389-b62c-4c65-93d4-0016a0507637 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.037908 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b61389-b62c-4c65-93d4-0016a0507637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.038204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47e571-b0cb-435c-a6db-83c73372b399 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.038319 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b61389-b62c-4c65-93d4-0016a0507637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.038927 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b61389-b62c-4c65-93d4-0016a0507637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.040525 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b61389-b62c-4c65-93d4-0016a0507637 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.042784 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d6d13-f166-46c5-a3a4-913528e033e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.043421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d6d13-f166-46c5-a3a4-913528e033e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.043706 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d6d13-f166-46c5-a3a4-913528e033e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.043985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d6d13-f166-46c5-a3a4-913528e033e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.044659 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d6d13-f166-46c5-a3a4-913528e033e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.046601 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d6d13-f166-46c5-a3a4-913528e033e0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.051496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 790/1583] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:24.051496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b61389-b62c-4c65-93d4-0016a0507637 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.062727 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b61389-b62c-4c65-93d4-0016a0507637 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.069371 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 794/1584] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:24 2022] POST /identity/v3/users => generated 288 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:24.069371 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d6d13-f166-46c5-a3a4-913528e033e0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.069590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189c862-3a52-42ff-886f-3f7cf15b5a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.069590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189c862-3a52-42ff-886f-3f7cf15b5a37 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.069590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189c862-3a52-42ff-886f-3f7cf15b5a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.069590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189c862-3a52-42ff-886f-3f7cf15b5a37 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.070231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189c862-3a52-42ff-886f-3f7cf15b5a37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.071360 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189c862-3a52-42ff-886f-3f7cf15b5a37 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.093699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 791/1585] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:24 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:24.094648 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189c862-3a52-42ff-886f-3f7cf15b5a37 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.104281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189c862-3a52-42ff-886f-3f7cf15b5a37 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.109112 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac2914-bbcf-4cc7-914d-57266ea4ee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.109741 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac2914-bbcf-4cc7-914d-57266ea4ee46 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.110054 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac2914-bbcf-4cc7-914d-57266ea4ee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.110331 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac2914-bbcf-4cc7-914d-57266ea4ee46 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.111003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac2914-bbcf-4cc7-914d-57266ea4ee46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.112911 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac2914-bbcf-4cc7-914d-57266ea4ee46 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.128349 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d6d13-f166-46c5-a3a4-913528e033e0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.132116 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ca51a-2cce-4126-817a-64f9e1e99b12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.132835 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ca51a-2cce-4126-817a-64f9e1e99b12 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.133192 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ca51a-2cce-4126-817a-64f9e1e99b12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.133381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 792/1586] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:24 2022] POST /identity/v3/users => generated 283 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:24.133840 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ca51a-2cce-4126-817a-64f9e1e99b12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.134192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac2914-bbcf-4cc7-914d-57266ea4ee46 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.143382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ca51a-2cce-4126-817a-64f9e1e99b12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.144504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac2914-bbcf-4cc7-914d-57266ea4ee46 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.145012 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ca51a-2cce-4126-817a-64f9e1e99b12 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.149597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec473cc-54b7-4c9d-8298-f806f95ad8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.150889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec473cc-54b7-4c9d-8298-f806f95ad8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.150889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec473cc-54b7-4c9d-8298-f806f95ad8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.151116 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec473cc-54b7-4c9d-8298-f806f95ad8a8 admin admin] PATH_INFO: `/v3/projects/04adf8fbad2b4f14afcfd20c4f2e1de0/users/6288fe29163c4c1598224f2588467102/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.155212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 795/1587] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:24.156207 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ca51a-2cce-4126-817a-64f9e1e99b12 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.165744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ca51a-2cce-4126-817a-64f9e1e99b12 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.166498 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec473cc-54b7-4c9d-8298-f806f95ad8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04adf8fbad2b4f14afcfd20c4f2e1de0, user_id=6288fe29163c4c1598224f2588467102, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.167700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: WARNING py.warnings [None req-6ec473cc-54b7-4c9d-8298-f806f95ad8a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 22:01:24.167700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: warnings.warn(msg) Jun 07 22:01:24.167700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: Jun 07 22:01:24.169462 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec473cc-54b7-4c9d-8298-f806f95ad8a8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.170573 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82dcbe-c5fa-44d6-9e91-f4bbb199a995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.171229 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82dcbe-c5fa-44d6-9e91-f4bbb199a995 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.171514 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82dcbe-c5fa-44d6-9e91-f4bbb199a995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.171792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82dcbe-c5fa-44d6-9e91-f4bbb199a995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.172868 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82dcbe-c5fa-44d6-9e91-f4bbb199a995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.174170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82dcbe-c5fa-44d6-9e91-f4bbb199a995 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.186057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 796/1588] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:24.186895 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82dcbe-c5fa-44d6-9e91-f4bbb199a995 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.189390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 793/1589] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:24 2022] PUT /identity/v3/projects/04adf8fbad2b4f14afcfd20c4f2e1de0/users/6288fe29163c4c1598224f2588467102/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:24.190231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec473cc-54b7-4c9d-8298-f806f95ad8a8 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.198356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82dcbe-c5fa-44d6-9e91-f4bbb199a995 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.267351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec473cc-54b7-4c9d-8298-f806f95ad8a8 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.273973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5845232-8419-4e0e-89d8-270bc43bb37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.274735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5845232-8419-4e0e-89d8-270bc43bb37e admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.275064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5845232-8419-4e0e-89d8-270bc43bb37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.275352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5845232-8419-4e0e-89d8-270bc43bb37e admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.276088 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5845232-8419-4e0e-89d8-270bc43bb37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.277124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309301e-67ae-4224-8263-1822cf7b4b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.277694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5845232-8419-4e0e-89d8-270bc43bb37e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.277826 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309301e-67ae-4224-8263-1822cf7b4b7a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.278111 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309301e-67ae-4224-8263-1822cf7b4b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.278384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309301e-67ae-4224-8263-1822cf7b4b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.279112 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309301e-67ae-4224-8263-1822cf7b4b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.281107 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309301e-67ae-4224-8263-1822cf7b4b7a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.289138 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 794/1590] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:24.290201 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5845232-8419-4e0e-89d8-270bc43bb37e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.299414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 797/1591] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:24.300374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309301e-67ae-4224-8263-1822cf7b4b7a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.302884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5845232-8419-4e0e-89d8-270bc43bb37e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.309859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c53208-8741-4eee-b315-be276a981892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.310836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309301e-67ae-4224-8263-1822cf7b4b7a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.310972 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c53208-8741-4eee-b315-be276a981892 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.311473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c53208-8741-4eee-b315-be276a981892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.311830 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c53208-8741-4eee-b315-be276a981892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.312632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c53208-8741-4eee-b315-be276a981892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.314470 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c53208-8741-4eee-b315-be276a981892 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.317000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f23d2-b674-4c71-a84b-1b019fa6d94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.318285 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f23d2-b674-4c71-a84b-1b019fa6d94d admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.318633 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f23d2-b674-4c71-a84b-1b019fa6d94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.318922 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f23d2-b674-4c71-a84b-1b019fa6d94d admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.319649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f23d2-b674-4c71-a84b-1b019fa6d94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.321262 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f23d2-b674-4c71-a84b-1b019fa6d94d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.330204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 795/1592] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:24.334083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 798/1593] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:24.335357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c53208-8741-4eee-b315-be276a981892 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.336175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f23d2-b674-4c71-a84b-1b019fa6d94d admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.343906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:24.347795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c53208-8741-4eee-b315-be276a981892 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.349116 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f23d2-b674-4c71-a84b-1b019fa6d94d admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.352867 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484358df-667b-481f-aa01-bc2cf6b8aff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.353540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484358df-667b-481f-aa01-bc2cf6b8aff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.353828 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484358df-667b-481f-aa01-bc2cf6b8aff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.354211 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484358df-667b-481f-aa01-bc2cf6b8aff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.354627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17497639-d8e4-4051-a6ee-1ad3e4df0e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.354935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484358df-667b-481f-aa01-bc2cf6b8aff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.355502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17497639-d8e4-4051-a6ee-1ad3e4df0e63 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.355616 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17497639-d8e4-4051-a6ee-1ad3e4df0e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.356305 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17497639-d8e4-4051-a6ee-1ad3e4df0e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.356844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17497639-d8e4-4051-a6ee-1ad3e4df0e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.357289 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484358df-667b-481f-aa01-bc2cf6b8aff4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.358976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17497639-d8e4-4051-a6ee-1ad3e4df0e63 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.374982 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 796/1594] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:24.375180 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 799/1595] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:24.375180 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17497639-d8e4-4051-a6ee-1ad3e4df0e63 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.375368 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af668b-d35e-4047-a35e-2ce0c6895348 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.375368 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af668b-d35e-4047-a35e-2ce0c6895348 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.375368 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af668b-d35e-4047-a35e-2ce0c6895348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.387426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17497639-d8e4-4051-a6ee-1ad3e4df0e63 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.393064 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366327e0-3364-43a1-8914-80a919ee3f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.394208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366327e0-3364-43a1-8914-80a919ee3f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.394678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366327e0-3364-43a1-8914-80a919ee3f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.395154 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366327e0-3364-43a1-8914-80a919ee3f13 admin admin] PATH_INFO: `/v3/projects/310a82e2f2f8433c85fa73437b7b24da/users/4ba5f51282f548cbbcf0dcaf8fbb4cc2/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.400868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a1af668b-d35e-4047-a35e-2ce0c6895348 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:24.402634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a1af668b-d35e-4047-a35e-2ce0c6895348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:24.411540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 797/1596] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:24.412168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366327e0-3364-43a1-8914-80a919ee3f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=310a82e2f2f8433c85fa73437b7b24da, user_id=4ba5f51282f548cbbcf0dcaf8fbb4cc2, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.412305 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af668b-d35e-4047-a35e-2ce0c6895348 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.415165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366327e0-3364-43a1-8914-80a919ee3f13 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.423416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af668b-d35e-4047-a35e-2ce0c6895348 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.429278 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17805575-c9bb-440c-bf02-434fd443cb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.430298 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17805575-c9bb-440c-bf02-434fd443cb82 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.430298 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17805575-c9bb-440c-bf02-434fd443cb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.430542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17805575-c9bb-440c-bf02-434fd443cb82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.431733 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17805575-c9bb-440c-bf02-434fd443cb82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.433190 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17805575-c9bb-440c-bf02-434fd443cb82 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.433596 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 800/1597] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:24 2022] PUT /identity/v3/projects/310a82e2f2f8433c85fa73437b7b24da/users/4ba5f51282f548cbbcf0dcaf8fbb4cc2/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:24.434616 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366327e0-3364-43a1-8914-80a919ee3f13 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.446687 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 798/1598] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:24.447821 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17805575-c9bb-440c-bf02-434fd443cb82 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.463262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17805575-c9bb-440c-bf02-434fd443cb82 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.494041 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:24.515451 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366327e0-3364-43a1-8914-80a919ee3f13 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.521315 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2997d-4430-42a3-8d68-4655670546e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.522088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2997d-4430-42a3-8d68-4655670546e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.522352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2997d-4430-42a3-8d68-4655670546e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.522728 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2997d-4430-42a3-8d68-4655670546e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.523506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2997d-4430-42a3-8d68-4655670546e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.525151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2997d-4430-42a3-8d68-4655670546e0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.534229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dd0da-36c0-4087-bcd3-3376ea2ca5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.534924 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dd0da-36c0-4087-bcd3-3376ea2ca5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.535269 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dd0da-36c0-4087-bcd3-3376ea2ca5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.535549 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dd0da-36c0-4087-bcd3-3376ea2ca5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.536809 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1dd0da-36c0-4087-bcd3-3376ea2ca5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.537259 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 801/1599] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:24.538255 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2997d-4430-42a3-8d68-4655670546e0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.541578 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1dd0da-36c0-4087-bcd3-3376ea2ca5d2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.548023 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2997d-4430-42a3-8d68-4655670546e0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.552813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1ede8-80d9-419a-8287-bf89bac9e728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.553570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1ede8-80d9-419a-8287-bf89bac9e728 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.553859 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1ede8-80d9-419a-8287-bf89bac9e728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.554183 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1ede8-80d9-419a-8287-bf89bac9e728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.554911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1ede8-80d9-419a-8287-bf89bac9e728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.556519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1ede8-80d9-419a-8287-bf89bac9e728 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.557639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 799/1600] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:24.560732 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dd0da-36c0-4087-bcd3-3376ea2ca5d2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.570564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dd0da-36c0-4087-bcd3-3376ea2ca5d2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.571044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 802/1601] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:24.572270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1ede8-80d9-419a-8287-bf89bac9e728 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.584215 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671d780-75ef-4626-9762-745f8dc05a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.585130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671d780-75ef-4626-9762-745f8dc05a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.585622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671d780-75ef-4626-9762-745f8dc05a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.585723 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671d780-75ef-4626-9762-745f8dc05a15 admin admin] PATH_INFO: `/v3/projects/612f774c4dcb40afb936c701d32d5c7d/users/4054810ecdac475f8e94ff525dc88ae7/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.606953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671d780-75ef-4626-9762-745f8dc05a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=612f774c4dcb40afb936c701d32d5c7d, user_id=4054810ecdac475f8e94ff525dc88ae7, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.610022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671d780-75ef-4626-9762-745f8dc05a15 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.625334 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 800/1602] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:24 2022] PUT /identity/v3/projects/612f774c4dcb40afb936c701d32d5c7d/users/4054810ecdac475f8e94ff525dc88ae7/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:24.636828 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65125394-f84a-4272-b453-8fc97b4bd5ab None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.636828 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65125394-f84a-4272-b453-8fc97b4bd5ab None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.636828 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65125394-f84a-4272-b453-8fc97b4bd5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.657629 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-65125394-f84a-4272-b453-8fc97b4bd5ab None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:24.658901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-65125394-f84a-4272-b453-8fc97b4bd5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:24.675724 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1ede8-80d9-419a-8287-bf89bac9e728 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.733664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 801/1603] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:24.734057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f230d39-dfaa-438f-a522-0801b32138e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.734862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f230d39-dfaa-438f-a522-0801b32138e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.735195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65125394-f84a-4272-b453-8fc97b4bd5ab None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.735311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f230d39-dfaa-438f-a522-0801b32138e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.735621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f230d39-dfaa-438f-a522-0801b32138e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.746173 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65125394-f84a-4272-b453-8fc97b4bd5ab None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.748840 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f230d39-dfaa-438f-a522-0801b32138e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.750381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f230d39-dfaa-438f-a522-0801b32138e0 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.751155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1de17-16ea-4773-83c5-6e13cb9a907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.752042 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1de17-16ea-4773-83c5-6e13cb9a907f admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.752319 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1de17-16ea-4773-83c5-6e13cb9a907f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.752590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1de17-16ea-4773-83c5-6e13cb9a907f admin admin] PATH_INFO: `/v3/projects/afaac01d95e74b9e9058c9c7ce7237ea/users/08868c65e4824034a998df7398daac9b/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.761477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 803/1604] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:24.762422 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f230d39-dfaa-438f-a522-0801b32138e0 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.772019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1de17-16ea-4773-83c5-6e13cb9a907f admin admin] RBAC: Authorizing `identity:create_grant(project_id=afaac01d95e74b9e9058c9c7ce7237ea, user_id=08868c65e4824034a998df7398daac9b, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.773182 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f230d39-dfaa-438f-a522-0801b32138e0 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.775165 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1de17-16ea-4773-83c5-6e13cb9a907f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.779326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bde3a-3fa2-4e6e-a39c-d62bc50f3994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.780633 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bde3a-3fa2-4e6e-a39c-d62bc50f3994 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.780981 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bde3a-3fa2-4e6e-a39c-d62bc50f3994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.781240 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bde3a-3fa2-4e6e-a39c-d62bc50f3994 admin admin] PATH_INFO: `/v3/projects/e4e6bccc7e464babbd4e5c5f6e1b670d/users/4382392090f844128a9321b29bb98002/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.790671 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 802/1605] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:24 2022] PUT /identity/v3/projects/afaac01d95e74b9e9058c9c7ce7237ea/users/08868c65e4824034a998df7398daac9b/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:24.791725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1de17-16ea-4773-83c5-6e13cb9a907f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.796845 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:24.802748 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bde3a-3fa2-4e6e-a39c-d62bc50f3994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e6bccc7e464babbd4e5c5f6e1b670d, user_id=4382392090f844128a9321b29bb98002, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.805537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bde3a-3fa2-4e6e-a39c-d62bc50f3994 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.823369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 804/1606] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:24 2022] PUT /identity/v3/projects/e4e6bccc7e464babbd4e5c5f6e1b670d/users/4382392090f844128a9321b29bb98002/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:24.824943 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bde3a-3fa2-4e6e-a39c-d62bc50f3994 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:24.879438 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1de17-16ea-4773-83c5-6e13cb9a907f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.897521 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bde3a-3fa2-4e6e-a39c-d62bc50f3994 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:24.903448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c8ac6-cec3-41d8-bacb-1b754ead8cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.904400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c8ac6-cec3-41d8-bacb-1b754ead8cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.904684 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c8ac6-cec3-41d8-bacb-1b754ead8cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.904964 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c8ac6-cec3-41d8-bacb-1b754ead8cdc admin admin] PATH_INFO: `/v3/projects/086457d6b1d048fabba3421b88e86245/users/31a1dbb226434d0cb53ad49defa1265f/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.909440 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:24.924829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c8ac6-cec3-41d8-bacb-1b754ead8cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=086457d6b1d048fabba3421b88e86245, user_id=31a1dbb226434d0cb53ad49defa1265f, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.927596 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c8ac6-cec3-41d8-bacb-1b754ead8cdc admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:24.951269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 805/1607] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:24 2022] PUT /identity/v3/projects/086457d6b1d048fabba3421b88e86245/users/31a1dbb226434d0cb53ad49defa1265f/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:24.952907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a14db-6b07-48cb-977c-bf0b5db825cf None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.953197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a14db-6b07-48cb-977c-bf0b5db825cf None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.953490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a14db-6b07-48cb-977c-bf0b5db825cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.970098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2538a8c-f735-4aee-bba6-f50d02fc1cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:24.971484 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2538a8c-f735-4aee-bba6-f50d02fc1cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:24.972074 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2538a8c-f735-4aee-bba6-f50d02fc1cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:24.972494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2538a8c-f735-4aee-bba6-f50d02fc1cf8 admin admin] PATH_INFO: `/v3/projects/ef81ce5d770a4ff094208bb63fc4a18b/users/bd1a33ca9f5144c69a66affd662bb9a6/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:24.996532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2538a8c-f735-4aee-bba6-f50d02fc1cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef81ce5d770a4ff094208bb63fc4a18b, user_id=bd1a33ca9f5144c69a66affd662bb9a6, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:24.999390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2538a8c-f735-4aee-bba6-f50d02fc1cf8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:25.022717 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8b0a14db-6b07-48cb-977c-bf0b5db825cf None None] MFA Rules not processed for user `4054810ecdac475f8e94ff525dc88ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:25.026152 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8b0a14db-6b07-48cb-977c-bf0b5db825cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:25.031379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 803/1608] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:24 2022] PUT /identity/v3/projects/ef81ce5d770a4ff094208bb63fc4a18b/users/bd1a33ca9f5144c69a66affd662bb9a6/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:25.032450 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2538a8c-f735-4aee-bba6-f50d02fc1cf8 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:25.110428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2538a8c-f735-4aee-bba6-f50d02fc1cf8 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:25.115127 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a7dd0-faa5-4f91-809f-165521dd6e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:25.115874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a7dd0-faa5-4f91-809f-165521dd6e1a service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.116226 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a7dd0-faa5-4f91-809f-165521dd6e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.116569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a7dd0-faa5-4f91-809f-165521dd6e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.124846 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 806/1609] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:25.127318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7be8e-fc74-49ba-ac3d-0e364ed4e0b7 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.127779 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7be8e-fc74-49ba-ac3d-0e364ed4e0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.128113 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7be8e-fc74-49ba-ac3d-0e364ed4e0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.171681 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-83d7be8e-fc74-49ba-ac3d-0e364ed4e0b7 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:25.173193 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-83d7be8e-fc74-49ba-ac3d-0e364ed4e0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:25.233087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a7dd0-faa5-4f91-809f-165521dd6e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:25.234628 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a7dd0-faa5-4f91-809f-165521dd6e1a service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:25.246546 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 804/1610] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:25.256308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d3ab2-431a-4cf9-ad02-7b8aa233de83 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.259549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 807/1611] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:25.259698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d3ab2-431a-4cf9-ad02-7b8aa233de83 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.259785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e554f-d595-44ea-9a6a-d3af090e0175 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.259968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d3ab2-431a-4cf9-ad02-7b8aa233de83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.260085 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e554f-d595-44ea-9a6a-d3af090e0175 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.260085 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e554f-d595-44ea-9a6a-d3af090e0175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.265505 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:25.296898 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-608e554f-d595-44ea-9a6a-d3af090e0175 None None] MFA Rules not processed for user `31a1dbb226434d0cb53ad49defa1265f`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:25.298787 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-608e554f-d595-44ea-9a6a-d3af090e0175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:25.302743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e60d3ab2-431a-4cf9-ad02-7b8aa233de83 None None] MFA Rules not processed for user `4382392090f844128a9321b29bb98002`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:25.304052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e60d3ab2-431a-4cf9-ad02-7b8aa233de83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:25.368675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:25.401747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 805/1612] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:25.404203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfeffca-be37-461b-bc56-ce479e3a7508 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.404513 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfeffca-be37-461b-bc56-ce479e3a7508 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.404797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfeffca-be37-461b-bc56-ce479e3a7508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.408075 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 808/1613] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:25.409590 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a60f67-01f0-435a-adb7-6ebc35a00d73 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.409880 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a60f67-01f0-435a-adb7-6ebc35a00d73 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.410259 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a60f67-01f0-435a-adb7-6ebc35a00d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.431167 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-84a60f67-01f0-435a-adb7-6ebc35a00d73 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:25.432441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-84a60f67-01f0-435a-adb7-6ebc35a00d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:25.441500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 809/1614] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:25.441819 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-5bfeffca-be37-461b-bc56-ce479e3a7508 None None] MFA Rules not processed for user `1d56d137e7954d6981f7553939632668`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:25.442882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0545c2-1540-4bbc-b0de-76b701bc6c9e None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.443168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0545c2-1540-4bbc-b0de-76b701bc6c9e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.443352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5bfeffca-be37-461b-bc56-ce479e3a7508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:25.443484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0545c2-1540-4bbc-b0de-76b701bc6c9e None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.444676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 810/1615] 10.222.0.18 () {54 vars in 961 bytes} [Tue Jun 7 22:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 22:01:25.445786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0545c2-1540-4bbc-b0de-76b701bc6c9e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:25.459542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0545c2-1540-4bbc-b0de-76b701bc6c9e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:25.463700 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f5855-eb4d-4671-8d24-0304636d6aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:25.464346 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f5855-eb4d-4671-8d24-0304636d6aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.464997 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f5855-eb4d-4671-8d24-0304636d6aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.465365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f5855-eb4d-4671-8d24-0304636d6aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.477577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f5855-eb4d-4671-8d24-0304636d6aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:25.479455 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f5855-eb4d-4671-8d24-0304636d6aa5 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:25.492467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 811/1616] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:25.493301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f5855-eb4d-4671-8d24-0304636d6aa5 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:25.523904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 806/1617] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:25.525190 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfeffca-be37-461b-bc56-ce479e3a7508 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:25.536904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfeffca-be37-461b-bc56-ce479e3a7508 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:25.540980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba8d05-196f-48ce-a7cf-5e06aa562651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:25.541745 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba8d05-196f-48ce-a7cf-5e06aa562651 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.542066 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba8d05-196f-48ce-a7cf-5e06aa562651 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.542354 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba8d05-196f-48ce-a7cf-5e06aa562651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.552898 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba8d05-196f-48ce-a7cf-5e06aa562651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:25.554376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba8d05-196f-48ce-a7cf-5e06aa562651 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:25.561573 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f5855-eb4d-4671-8d24-0304636d6aa5 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:25.565309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 807/1618] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:25.565739 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eff4c0-26ff-40b6-b1a6-0a6dd00389ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:25.566425 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eff4c0-26ff-40b6-b1a6-0a6dd00389ca service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.566663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091d7c4-5645-463d-b472-ef2e5fc60318 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.566782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eff4c0-26ff-40b6-b1a6-0a6dd00389ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.566957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091d7c4-5645-463d-b472-ef2e5fc60318 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.567067 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eff4c0-26ff-40b6-b1a6-0a6dd00389ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.567291 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091d7c4-5645-463d-b472-ef2e5fc60318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.576079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eff4c0-26ff-40b6-b1a6-0a6dd00389ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:25.577540 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eff4c0-26ff-40b6-b1a6-0a6dd00389ca service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:25.586603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0091d7c4-5645-463d-b472-ef2e5fc60318 None None] MFA Rules not processed for user `1d5760a3f9f946978b1251d3e2aaa943`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:25.587854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0091d7c4-5645-463d-b472-ef2e5fc60318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:25.600765 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 812/1619] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:25 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:25.602600 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d15693-9bb1-40df-b82e-5ab382d5e272 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.602894 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d15693-9bb1-40df-b82e-5ab382d5e272 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.603174 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d15693-9bb1-40df-b82e-5ab382d5e272 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.614535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 813/1620] 10.222.0.18 () {54 vars in 961 bytes} [Tue Jun 7 22:01:25 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 22:01:25.615441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d15693-9bb1-40df-b82e-5ab382d5e272 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:25.651400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d15693-9bb1-40df-b82e-5ab382d5e272 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:25.656894 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3155e-69ca-480c-a71f-549c210ba2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:25.657780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3155e-69ca-480c-a71f-549c210ba2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.658284 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3155e-69ca-480c-a71f-549c210ba2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.658732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3155e-69ca-480c-a71f-549c210ba2c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.659640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3155e-69ca-480c-a71f-549c210ba2c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:25.662281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 808/1621] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jun 7 22:01:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:25.663829 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada4f6e-6323-41b1-9ea5-07c1f3678afc None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.664163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada4f6e-6323-41b1-9ea5-07c1f3678afc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.664529 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada4f6e-6323-41b1-9ea5-07c1f3678afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.673359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3155e-69ca-480c-a71f-549c210ba2c7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:25.685679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-9ada4f6e-6323-41b1-9ea5-07c1f3678afc None None] MFA Rules not processed for user `1d5760a3f9f946978b1251d3e2aaa943`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:25.687002 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9ada4f6e-6323-41b1-9ea5-07c1f3678afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:25.699640 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 809/1622] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jun 7 22:01:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:25.700659 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada4f6e-6323-41b1-9ea5-07c1f3678afc None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:25.712968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada4f6e-6323-41b1-9ea5-07c1f3678afc None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:25.719850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9f090-5036-43e6-a5a0-5dfa8cea05d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:25.720676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9f090-5036-43e6-a5a0-5dfa8cea05d7 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.720960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9f090-5036-43e6-a5a0-5dfa8cea05d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.721280 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9f090-5036-43e6-a5a0-5dfa8cea05d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.731394 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9f090-5036-43e6-a5a0-5dfa8cea05d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:25.733420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9f090-5036-43e6-a5a0-5dfa8cea05d7 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:25.735897 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 814/1623] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:25 2022] POST /identity/v3/projects => generated 405 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:25.741247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3155e-69ca-480c-a71f-549c210ba2c7 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:25.744692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 810/1624] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:25.745096 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9f090-5036-43e6-a5a0-5dfa8cea05d7 service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:25.757431 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9f090-5036-43e6-a5a0-5dfa8cea05d7 service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:25.794220 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:25.825223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf22239-9fe4-4d2d-a86e-4658711afd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:25.826242 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf22239-9fe4-4d2d-a86e-4658711afd8d admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.828188 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf22239-9fe4-4d2d-a86e-4658711afd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.828188 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf22239-9fe4-4d2d-a86e-4658711afd8d admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.828188 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf22239-9fe4-4d2d-a86e-4658711afd8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:25.830264 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf22239-9fe4-4d2d-a86e-4658711afd8d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:25.856846 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 811/1625] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:25 2022] POST /identity/v3/users => generated 309 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:25.860362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf22239-9fe4-4d2d-a86e-4658711afd8d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:25.868691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:25.885283 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf22239-9fe4-4d2d-a86e-4658711afd8d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:25.894312 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3155e-69ca-480c-a71f-549c210ba2c7 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:25.899522 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c3951-c20f-4f5b-beca-b5d5ee3f370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:25.900203 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e90bb3-59c4-4a6f-8e74-d3581aeb1f28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:25.900348 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c3951-c20f-4f5b-beca-b5d5ee3f370d admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.900500 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c3951-c20f-4f5b-beca-b5d5ee3f370d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.900760 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c3951-c20f-4f5b-beca-b5d5ee3f370d admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.901164 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e90bb3-59c4-4a6f-8e74-d3581aeb1f28 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.901722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c3951-c20f-4f5b-beca-b5d5ee3f370d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:25.901847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e90bb3-59c4-4a6f-8e74-d3581aeb1f28 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.902245 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e90bb3-59c4-4a6f-8e74-d3581aeb1f28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:25.905249 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c3951-c20f-4f5b-beca-b5d5ee3f370d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:25.932583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 812/1626] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:25.936961 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c3951-c20f-4f5b-beca-b5d5ee3f370d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:25.958976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c3951-c20f-4f5b-beca-b5d5ee3f370d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:25.974412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227d33a-db0e-444b-9e1c-166432935d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:25.975782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227d33a-db0e-444b-9e1c-166432935d80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:25.976208 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227d33a-db0e-444b-9e1c-166432935d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:25.976492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227d33a-db0e-444b-9e1c-166432935d80 admin admin] PATH_INFO: `/v3/projects/7b1f69df2b934af9bf5d3b90a66594ce/users/0109c6feaf17425991942fcd8eaa87af/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:26.010586 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227d33a-db0e-444b-9e1c-166432935d80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b1f69df2b934af9bf5d3b90a66594ce, user_id=0109c6feaf17425991942fcd8eaa87af, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:26.017573 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227d33a-db0e-444b-9e1c-166432935d80 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:26.028639 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e90bb3-59c4-4a6f-8e74-d3581aeb1f28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:26.030348 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e90bb3-59c4-4a6f-8e74-d3581aeb1f28 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:26.047910 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 813/1627] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:25 2022] PUT /identity/v3/projects/7b1f69df2b934af9bf5d3b90a66594ce/users/0109c6feaf17425991942fcd8eaa87af/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:26.051499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227d33a-db0e-444b-9e1c-166432935d80 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:26.056789 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 815/1628] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:26.203201 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227d33a-db0e-444b-9e1c-166432935d80 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:26.217820 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469a6f8-392b-4130-b978-287c7fb3cfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:26.218834 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469a6f8-392b-4130-b978-287c7fb3cfb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:26.219865 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469a6f8-392b-4130-b978-287c7fb3cfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:26.220397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469a6f8-392b-4130-b978-287c7fb3cfb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:26.223500 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469a6f8-392b-4130-b978-287c7fb3cfb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:26.225877 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469a6f8-392b-4130-b978-287c7fb3cfb6 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:26.239920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850abac5-97c2-4619-8859-5747e6f81eed None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:26.241071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850abac5-97c2-4619-8859-5747e6f81eed None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:26.241499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850abac5-97c2-4619-8859-5747e6f81eed None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:26.243380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 816/1629] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jun 7 22:01:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 22:01:26.250314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 814/1630] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:26.252107 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b965961-2907-4ebd-92e5-61e827c929d7 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:26.252569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b965961-2907-4ebd-92e5-61e827c929d7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:26.253044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b965961-2907-4ebd-92e5-61e827c929d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:26.254938 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469a6f8-392b-4130-b978-287c7fb3cfb6 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:26.280604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469a6f8-392b-4130-b978-287c7fb3cfb6 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:26.289302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8b965961-2907-4ebd-92e5-61e827c929d7 None None] MFA Rules not processed for user `1d5760a3f9f946978b1251d3e2aaa943`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:26.290799 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8b965961-2907-4ebd-92e5-61e827c929d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:26.292384 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa585d1f-164c-4761-99a7-96212d227586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:26.294985 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa585d1f-164c-4761-99a7-96212d227586 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:26.296433 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa585d1f-164c-4761-99a7-96212d227586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:26.297290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa585d1f-164c-4761-99a7-96212d227586 admin admin] PATH_INFO: `/v3/projects/7b1f69df2b934af9bf5d3b90a66594ce/users/0109c6feaf17425991942fcd8eaa87af/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:26.303649 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa585d1f-164c-4761-99a7-96212d227586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b1f69df2b934af9bf5d3b90a66594ce, user_id=0109c6feaf17425991942fcd8eaa87af, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:26.310773 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa585d1f-164c-4761-99a7-96212d227586 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:26.336545 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 815/1631] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:26 2022] PUT /identity/v3/projects/7b1f69df2b934af9bf5d3b90a66594ce/users/0109c6feaf17425991942fcd8eaa87af/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:26.488775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 817/1632] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 7 22:01:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:26.502937 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa585d1f-164c-4761-99a7-96212d227586 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:26.705846 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0a49b-4d91-4bc9-a64e-cb99a747a1e3 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:26.706227 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0a49b-4d91-4bc9-a64e-cb99a747a1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:26.706611 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0a49b-4d91-4bc9-a64e-cb99a747a1e3 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:26.708529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 818/1633] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jun 7 22:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 22:01:26.713901 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901365-d4f1-4759-afd7-4d88828e2ee6 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:26.714609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901365-d4f1-4759-afd7-4d88828e2ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:26.714609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901365-d4f1-4759-afd7-4d88828e2ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:26.751804 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa585d1f-164c-4761-99a7-96212d227586 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:26.767066 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d4dce-7920-4ac9-aa11-9a1c7b824056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:26.767744 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d4dce-7920-4ac9-aa11-9a1c7b824056 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:26.768024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d4dce-7920-4ac9-aa11-9a1c7b824056 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:26.768309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d4dce-7920-4ac9-aa11-9a1c7b824056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:26.769530 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8c901365-d4f1-4759-afd7-4d88828e2ee6 None None] MFA Rules not processed for user `1d5760a3f9f946978b1251d3e2aaa943`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:26.772036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8c901365-d4f1-4759-afd7-4d88828e2ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:26.800719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:26.867943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d4dce-7920-4ac9-aa11-9a1c7b824056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:26.870283 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d4dce-7920-4ac9-aa11-9a1c7b824056 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:26.894950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 816/1634] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:26.903977 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c4d6a-7115-41e7-9cc7-7c2a522779b8 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:26.904293 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c4d6a-7115-41e7-9cc7-7c2a522779b8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:26.904549 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c4d6a-7115-41e7-9cc7-7c2a522779b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:26.953842 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 819/1635] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 7 22:01:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:01:26.973908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c901365-d4f1-4759-afd7-4d88828e2ee6 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:26.977987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0c4c4d6a-7115-41e7-9cc7-7c2a522779b8 None None] MFA Rules not processed for user `6288fe29163c4c1598224f2588467102`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:26.979639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0c4c4d6a-7115-41e7-9cc7-7c2a522779b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:26.993405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c901365-d4f1-4759-afd7-4d88828e2ee6 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:26.999519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57ff6e-4bc8-4a62-9864-f9ad88dc989d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:27.000663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ff6e-4bc8-4a62-9864-f9ad88dc989d service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:27.001385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ff6e-4bc8-4a62-9864-f9ad88dc989d service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:27.001906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ff6e-4bc8-4a62-9864-f9ad88dc989d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:27.020233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57ff6e-4bc8-4a62-9864-f9ad88dc989d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:27.023129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57ff6e-4bc8-4a62-9864-f9ad88dc989d service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:27.030450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:27.038643 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 820/1636] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:01:27.109096 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 817/1637] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:01:27.121338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6270e-94a7-419f-9bc9-55825c3e932b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:27.121699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6270e-94a7-419f-9bc9-55825c3e932b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:27.122087 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6270e-94a7-419f-9bc9-55825c3e932b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:27.166620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b3d6270e-94a7-419f-9bc9-55825c3e932b None None] MFA Rules not processed for user `6288fe29163c4c1598224f2588467102`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:27.168665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b3d6270e-94a7-419f-9bc9-55825c3e932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:27.187273 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 821/1638] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:27.269820 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c4d6a-7115-41e7-9cc7-7c2a522779b8 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:27.277716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6270e-94a7-419f-9bc9-55825c3e932b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:27.299529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6270e-94a7-419f-9bc9-55825c3e932b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:27.311131 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4c584-594f-4c95-9cbf-e66e103f0d6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:27.311914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4c584-594f-4c95-9cbf-e66e103f0d6b service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:27.313072 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4c584-594f-4c95-9cbf-e66e103f0d6b service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:27.314659 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4c584-594f-4c95-9cbf-e66e103f0d6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:27.335762 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4c584-594f-4c95-9cbf-e66e103f0d6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:27.340683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4c584-594f-4c95-9cbf-e66e103f0d6b service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:27.362751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 822/1639] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:01:27.375836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c4d6a-7115-41e7-9cc7-7c2a522779b8 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:27.383039 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995f80e-3ca4-4c25-a534-af2daae643de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:27.385294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995f80e-3ca4-4c25-a534-af2daae643de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:27.387178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995f80e-3ca4-4c25-a534-af2daae643de admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:27.387377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995f80e-3ca4-4c25-a534-af2daae643de admin admin] PATH_INFO: `/v3/users/4382392090f844128a9321b29bb98002` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:27.389621 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995f80e-3ca4-4c25-a534-af2daae643de admin admin] RBAC: Authorizing `identity:delete_user(user_id=4382392090f844128a9321b29bb98002)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:27.391661 dv-cinder-835525-4-smb devstack@keystone.service[80404]: WARNING py.warnings [None req-6995f80e-3ca4-4c25-a534-af2daae643de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 22:01:27.391661 dv-cinder-835525-4-smb devstack@keystone.service[80404]: warnings.warn(msg) Jun 07 22:01:27.391661 dv-cinder-835525-4-smb devstack@keystone.service[80404]: Jun 07 22:01:27.396103 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995f80e-3ca4-4c25-a534-af2daae643de admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:27.523706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:27.529636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6995f80e-3ca4-4c25-a534-af2daae643de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4382392090f844128a9321b29bb98002'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:27.559632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6995f80e-3ca4-4c25-a534-af2daae643de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4382392090f844128a9321b29bb98002'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:27.562381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6995f80e-3ca4-4c25-a534-af2daae643de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4382392090f844128a9321b29bb98002'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:27.577393 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6995f80e-3ca4-4c25-a534-af2daae643de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4382392090f844128a9321b29bb98002'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:27.578674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6995f80e-3ca4-4c25-a534-af2daae643de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4382392090f844128a9321b29bb98002'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:27.638393 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 818/1640] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:01:27 2022] DELETE /identity/v3/users/4382392090f844128a9321b29bb98002 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:27.644102 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3de470-102e-4011-a82f-ad4d675cd630 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:27.644869 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3de470-102e-4011-a82f-ad4d675cd630 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:27.645403 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3de470-102e-4011-a82f-ad4d675cd630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:27.688262 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7e3de470-102e-4011-a82f-ad4d675cd630 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:27.705008 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7e3de470-102e-4011-a82f-ad4d675cd630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:27.838472 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 823/1641] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:27.893078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995f80e-3ca4-4c25-a534-af2daae643de admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:27.894602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6995f80e-3ca4-4c25-a534-af2daae643de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:28.034212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995f80e-3ca4-4c25-a534-af2daae643de admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:28.038726 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6c2d8-da42-4c9a-8831-134ebd3a8676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:28.039500 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6c2d8-da42-4c9a-8831-134ebd3a8676 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:28.039847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6c2d8-da42-4c9a-8831-134ebd3a8676 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:28.040188 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6c2d8-da42-4c9a-8831-134ebd3a8676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:28.055671 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6c2d8-da42-4c9a-8831-134ebd3a8676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:28.057476 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6c2d8-da42-4c9a-8831-134ebd3a8676 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:28.072627 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 819/1642] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:28.240519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f5f22-d525-4e21-ba97-a6a0cd00f447 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:28.240844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f5f22-d525-4e21-ba97-a6a0cd00f447 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:28.241121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f5f22-d525-4e21-ba97-a6a0cd00f447 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:28.242786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 824/1643] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jun 7 22:01:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 22:01:28.248550 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39165f-2723-4154-987c-bcadad130a24 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:28.248847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39165f-2723-4154-987c-bcadad130a24 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:28.249190 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39165f-2723-4154-987c-bcadad130a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:28.377239 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6b39165f-2723-4154-987c-bcadad130a24 None None] MFA Rules not processed for user `aab50bc9064e444184afb1b4c585ce39`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:28.382442 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6b39165f-2723-4154-987c-bcadad130a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:28.416970 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 820/1644] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 7 22:01:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:28.439677 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f5f22-d525-4e21-ba97-a6a0cd00f447 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:28.442943 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ed2f5f22-d525-4e21-ba97-a6a0cd00f447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:28.493856 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f5f22-d525-4e21-ba97-a6a0cd00f447 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:28.509220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01795f-f137-40db-93b3-db21d551b657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:28.513547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01795f-f137-40db-93b3-db21d551b657 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:28.515339 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01795f-f137-40db-93b3-db21d551b657 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:28.516613 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01795f-f137-40db-93b3-db21d551b657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:28.551365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01795f-f137-40db-93b3-db21d551b657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:28.555136 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01795f-f137-40db-93b3-db21d551b657 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:28.596832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 825/1645] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:29.461734 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc58034-b1c9-40d9-b181-3f084bae9347 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:29.462285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc58034-b1c9-40d9-b181-3f084bae9347 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:29.462405 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc58034-b1c9-40d9-b181-3f084bae9347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:29.511734 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01795f-f137-40db-93b3-db21d551b657 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:29.513327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1d01795f-f137-40db-93b3-db21d551b657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:29.553113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-acc58034-b1c9-40d9-b181-3f084bae9347 None None] MFA Rules not processed for user `0109c6feaf17425991942fcd8eaa87af`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:29.561074 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01795f-f137-40db-93b3-db21d551b657 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:29.567044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-acc58034-b1c9-40d9-b181-3f084bae9347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:29.585879 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b6dfa-7fd9-498d-beca-49ee444b2268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:29.587261 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b6dfa-7fd9-498d-beca-49ee444b2268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:29.587558 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b6dfa-7fd9-498d-beca-49ee444b2268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:29.587838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b6dfa-7fd9-498d-beca-49ee444b2268 admin admin] PATH_INFO: `/v3/projects/e4e6bccc7e464babbd4e5c5f6e1b670d` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:29.591602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b6dfa-7fd9-498d-beca-49ee444b2268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e6bccc7e464babbd4e5c5f6e1b670d)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:29.592649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: WARNING py.warnings [None req-e13b6dfa-7fd9-498d-beca-49ee444b2268 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 22:01:29.592649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: warnings.warn(msg) Jun 07 22:01:29.592649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: Jun 07 22:01:29.593855 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b6dfa-7fd9-498d-beca-49ee444b2268 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:29.847690 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e13b6dfa-7fd9-498d-beca-49ee444b2268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e6bccc7e464babbd4e5c5f6e1b670d', 'request_id': 'req-e13b6dfa-7fd9-498d-beca-49ee444b2268'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:29.861688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 821/1646] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:29 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:29.863615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b90f2-b873-4449-a58c-c0f2dcad3171 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:29.864173 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b90f2-b873-4449-a58c-c0f2dcad3171 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:29.864552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b90f2-b873-4449-a58c-c0f2dcad3171 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:29.871973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 822/1647] 10.222.0.18 () {54 vars in 960 bytes} [Tue Jun 7 22:01:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 22:01:29.878472 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09634de9-e7c8-4180-861b-934ed62399e0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:29.878957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09634de9-e7c8-4180-861b-934ed62399e0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:29.879399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09634de9-e7c8-4180-861b-934ed62399e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:29.882056 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e13b6dfa-7fd9-498d-beca-49ee444b2268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e6bccc7e464babbd4e5c5f6e1b670d', 'request_id': 'req-e13b6dfa-7fd9-498d-beca-49ee444b2268'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:29.923815 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e13b6dfa-7fd9-498d-beca-49ee444b2268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e6bccc7e464babbd4e5c5f6e1b670d', 'request_id': 'req-e13b6dfa-7fd9-498d-beca-49ee444b2268'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:29.940469 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-09634de9-e7c8-4180-861b-934ed62399e0 None None] MFA Rules not processed for user `90facf92f97d435dbe8a001759a8fe0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:29.947612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-09634de9-e7c8-4180-861b-934ed62399e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:29.950417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e13b6dfa-7fd9-498d-beca-49ee444b2268 admin admin] The token cache is being invalidate because project e4e6bccc7e464babbd4e5c5f6e1b670d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:01:29.950832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e13b6dfa-7fd9-498d-beca-49ee444b2268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:29.952054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e13b6dfa-7fd9-498d-beca-49ee444b2268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:29.962143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 826/1648] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:01:29 2022] DELETE /identity/v3/projects/e4e6bccc7e464babbd4e5c5f6e1b670d => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:01:29.963908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5002d-44c1-44d8-ad36-024219ae9f94 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:29.964305 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5002d-44c1-44d8-ad36-024219ae9f94 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:29.964689 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5002d-44c1-44d8-ad36-024219ae9f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:30.003739 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d6d5002d-44c1-44d8-ad36-024219ae9f94 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:30.009278 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d6d5002d-44c1-44d8-ad36-024219ae9f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:30.011525 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:30.142952 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 823/1649] 10.222.0.18 () {58 vars in 1057 bytes} [Tue Jun 7 22:01:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:30.151691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09634de9-e7c8-4180-861b-934ed62399e0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:30.175561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:30.187391 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09634de9-e7c8-4180-861b-934ed62399e0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:30.209684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185562be-3331-47f8-9f17-436e18533e3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90facf92f97d435dbe8a001759a8fe0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:30.211495 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185562be-3331-47f8-9f17-436e18533e3c service placement] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:30.214204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185562be-3331-47f8-9f17-436e18533e3c service placement] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:30.226261 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185562be-3331-47f8-9f17-436e18533e3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:30.238325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-185562be-3331-47f8-9f17-436e18533e3c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:30.244359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 827/1650] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:30.254842 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc9d57-880f-48c6-8c15-cdbccf75c81a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:30.266970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc9d57-880f-48c6-8c15-cdbccf75c81a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:30.267443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc9d57-880f-48c6-8c15-cdbccf75c81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:30.303343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185562be-3331-47f8-9f17-436e18533e3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:30.306222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d2fc9d57-880f-48c6-8c15-cdbccf75c81a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:30.308486 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185562be-3331-47f8-9f17-436e18533e3c service placement] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:30.311524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d2fc9d57-880f-48c6-8c15-cdbccf75c81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:30.339399 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 828/1651] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:30.340547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc9d57-880f-48c6-8c15-cdbccf75c81a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:30.352437 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 824/1652] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:30.396398 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc9d57-880f-48c6-8c15-cdbccf75c81a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:30.418765 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec984cfa-dc01-407a-b599-3532344d76b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:30.419480 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec984cfa-dc01-407a-b599-3532344d76b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:30.419756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec984cfa-dc01-407a-b599-3532344d76b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:30.420035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec984cfa-dc01-407a-b599-3532344d76b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:30.420780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec984cfa-dc01-407a-b599-3532344d76b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:01:30.421090 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec984cfa-dc01-407a-b599-3532344d76b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:30.422941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec984cfa-dc01-407a-b599-3532344d76b1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:30.459563 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 829/1653] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:01:30.466919 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185562be-3331-47f8-9f17-436e18533e3c service placement] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:30.486346 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185562be-3331-47f8-9f17-436e18533e3c service placement] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:30.499026 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c4f9c-3bd5-4cc6-9b21-7cdbb09e9a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:30.502302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c4f9c-3bd5-4cc6-9b21-7cdbb09e9a3b admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:30.503286 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c4f9c-3bd5-4cc6-9b21-7cdbb09e9a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:30.505010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c4f9c-3bd5-4cc6-9b21-7cdbb09e9a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:30.508109 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c4f9c-3bd5-4cc6-9b21-7cdbb09e9a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:30.513213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c4f9c-3bd5-4cc6-9b21-7cdbb09e9a3b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:30.612921 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 825/1654] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:30 2022] POST /identity/v3/projects => generated 403 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:30.617451 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec984cfa-dc01-407a-b599-3532344d76b1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:30.631463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec984cfa-dc01-407a-b599-3532344d76b1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:30.777532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d1645-5ea7-495e-bd9e-081bdcbfded9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:30.791093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d1645-5ea7-495e-bd9e-081bdcbfded9 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:30.791430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d1645-5ea7-495e-bd9e-081bdcbfded9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:30.791711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d1645-5ea7-495e-bd9e-081bdcbfded9 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:30.792452 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d1645-5ea7-495e-bd9e-081bdcbfded9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:30.794439 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d1645-5ea7-495e-bd9e-081bdcbfded9 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:30.852778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 830/1655] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:30 2022] POST /identity/v3/users => generated 302 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:30.857787 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c4f9c-3bd5-4cc6-9b21-7cdbb09e9a3b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:30.880080 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c4f9c-3bd5-4cc6-9b21-7cdbb09e9a3b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:30.887773 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a540e-b6a2-4d93-a4b1-a97144fd6f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:30.888574 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a540e-b6a2-4d93-a4b1-a97144fd6f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:30.888870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a540e-b6a2-4d93-a4b1-a97144fd6f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:30.889207 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a540e-b6a2-4d93-a4b1-a97144fd6f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:30.889942 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a540e-b6a2-4d93-a4b1-a97144fd6f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:30.892885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a540e-b6a2-4d93-a4b1-a97144fd6f0a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:30.926805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 826/1656] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:01:30.930630 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d1645-5ea7-495e-bd9e-081bdcbfded9 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:30.944938 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d1645-5ea7-495e-bd9e-081bdcbfded9 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:30.960985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ecf41-f7e9-46b9-b0b6-a7553c3ec2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:30.962049 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ecf41-f7e9-46b9-b0b6-a7553c3ec2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:30.962573 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ecf41-f7e9-46b9-b0b6-a7553c3ec2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:30.963046 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ecf41-f7e9-46b9-b0b6-a7553c3ec2a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:30.964103 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ecf41-f7e9-46b9-b0b6-a7553c3ec2a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:30.965986 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ecf41-f7e9-46b9-b0b6-a7553c3ec2a8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:30.989125 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a540e-b6a2-4d93-a4b1-a97144fd6f0a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:30.994344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 831/1657] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:31.003086 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a540e-b6a2-4d93-a4b1-a97144fd6f0a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:31.015547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aae023-1641-4a26-a121-72cf442a96fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:31.017121 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aae023-1641-4a26-a121-72cf442a96fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:31.017593 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aae023-1641-4a26-a121-72cf442a96fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:31.018106 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aae023-1641-4a26-a121-72cf442a96fb admin admin] PATH_INFO: `/v3/projects/3c0d11ed30f648debf6708743bb5cb08/users/5e6a11653ab347139ecc470814a9b887/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:31.080701 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aae023-1641-4a26-a121-72cf442a96fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c0d11ed30f648debf6708743bb5cb08, user_id=5e6a11653ab347139ecc470814a9b887, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:31.084360 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aae023-1641-4a26-a121-72cf442a96fb admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:31.121968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 827/1658] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:30 2022] PUT /identity/v3/projects/3c0d11ed30f648debf6708743bb5cb08/users/5e6a11653ab347139ecc470814a9b887/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:01:31.130996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82744b-f832-435c-adb9-0c8c8f980e90 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:31.131524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82744b-f832-435c-adb9-0c8c8f980e90 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:31.131968 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82744b-f832-435c-adb9-0c8c8f980e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:31.201372 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8b82744b-f832-435c-adb9-0c8c8f980e90 None None] MFA Rules not processed for user `5e6a11653ab347139ecc470814a9b887`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:31.202903 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8b82744b-f832-435c-adb9-0c8c8f980e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:31.368101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 832/1659] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:31.374673 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aae023-1641-4a26-a121-72cf442a96fb admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:31.573242 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aae023-1641-4a26-a121-72cf442a96fb admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:31.584308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d4a89-c96e-4b4b-a6a7-58ed3b8ef02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:31.585123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4a89-c96e-4b4b-a6a7-58ed3b8ef02c admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:31.587482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4a89-c96e-4b4b-a6a7-58ed3b8ef02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:31.587784 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4a89-c96e-4b4b-a6a7-58ed3b8ef02c admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:31.588987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d4a89-c96e-4b4b-a6a7-58ed3b8ef02c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:31.593441 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d4a89-c96e-4b4b-a6a7-58ed3b8ef02c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:31.675840 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 828/1660] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:31 2022] POST /identity/v3/projects => generated 405 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:31.678676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82744b-f832-435c-adb9-0c8c8f980e90 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:31.712828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82744b-f832-435c-adb9-0c8c8f980e90 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:31.862723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:31.938902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65244c2-b3e4-453c-ab8a-bc487e19e5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:31.939759 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65244c2-b3e4-453c-ab8a-bc487e19e5cf admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:31.949681 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65244c2-b3e4-453c-ab8a-bc487e19e5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:31.952366 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65244c2-b3e4-453c-ab8a-bc487e19e5cf admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:31.953239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65244c2-b3e4-453c-ab8a-bc487e19e5cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:31.955450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65244c2-b3e4-453c-ab8a-bc487e19e5cf admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:32.033556 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 833/1661] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:31 2022] POST /identity/v3/users => generated 309 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:32.034903 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d4a89-c96e-4b4b-a6a7-58ed3b8ef02c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:32.055479 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d4a89-c96e-4b4b-a6a7-58ed3b8ef02c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:32.073140 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d9603-e0c2-45bd-bf36-d00c59eb1e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:32.073836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d9603-e0c2-45bd-bf36-d00c59eb1e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:32.076333 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d9603-e0c2-45bd-bf36-d00c59eb1e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:32.076333 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d9603-e0c2-45bd-bf36-d00c59eb1e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:32.085067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d9603-e0c2-45bd-bf36-d00c59eb1e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:32.089884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d9603-e0c2-45bd-bf36-d00c59eb1e2f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:32.147892 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 829/1662] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:32.152979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65244c2-b3e4-453c-ab8a-bc487e19e5cf admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:32.169884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65244c2-b3e4-453c-ab8a-bc487e19e5cf admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:32.178208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d386127-e775-4429-b5d2-47080d8215b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:32.179196 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d386127-e775-4429-b5d2-47080d8215b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:32.179634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d386127-e775-4429-b5d2-47080d8215b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:32.180097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d386127-e775-4429-b5d2-47080d8215b2 admin admin] PATH_INFO: `/v3/projects/f9a44f0b88574d44a609f388c2d44dfc/users/2c786f8f25b5489782f27f8bd0316507/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:32.199626 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d386127-e775-4429-b5d2-47080d8215b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a44f0b88574d44a609f388c2d44dfc, user_id=2c786f8f25b5489782f27f8bd0316507, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:32.212663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d386127-e775-4429-b5d2-47080d8215b2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:32.249007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 834/1663] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:32 2022] PUT /identity/v3/projects/f9a44f0b88574d44a609f388c2d44dfc/users/2c786f8f25b5489782f27f8bd0316507/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:32.250456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d9603-e0c2-45bd-bf36-d00c59eb1e2f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:32.266047 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d9603-e0c2-45bd-bf36-d00c59eb1e2f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:32.327839 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:32.454500 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072514e-239c-4345-b1d1-e498690d3e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:32.455678 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072514e-239c-4345-b1d1-e498690d3e80 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:32.457364 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072514e-239c-4345-b1d1-e498690d3e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:32.457761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072514e-239c-4345-b1d1-e498690d3e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:32.458611 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072514e-239c-4345-b1d1-e498690d3e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:32.468819 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072514e-239c-4345-b1d1-e498690d3e80 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:32.495379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 830/1664] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:32.499630 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d386127-e775-4429-b5d2-47080d8215b2 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:32.523178 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d386127-e775-4429-b5d2-47080d8215b2 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:32.543241 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a52ece-91d2-478a-adec-03f101300486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:32.547282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a52ece-91d2-478a-adec-03f101300486 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:32.552925 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a52ece-91d2-478a-adec-03f101300486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:32.553445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a52ece-91d2-478a-adec-03f101300486 admin admin] PATH_INFO: `/v3/projects/f9a44f0b88574d44a609f388c2d44dfc/users/2c786f8f25b5489782f27f8bd0316507/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:32.567826 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a52ece-91d2-478a-adec-03f101300486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a44f0b88574d44a609f388c2d44dfc, user_id=2c786f8f25b5489782f27f8bd0316507, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:32.579765 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a52ece-91d2-478a-adec-03f101300486 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:32.638775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 835/1665] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:32 2022] PUT /identity/v3/projects/f9a44f0b88574d44a609f388c2d44dfc/users/2c786f8f25b5489782f27f8bd0316507/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:01:32.640305 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb33c86-840f-44d7-ab0b-ab1cd4b7d2ac None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:32.640767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb33c86-840f-44d7-ab0b-ab1cd4b7d2ac None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:32.640919 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb33c86-840f-44d7-ab0b-ab1cd4b7d2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:32.696000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6bb33c86-840f-44d7-ab0b-ab1cd4b7d2ac None None] MFA Rules not processed for user `2c786f8f25b5489782f27f8bd0316507`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:32.697434 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6bb33c86-840f-44d7-ab0b-ab1cd4b7d2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:32.797705 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c0798-1dc6-413c-a597-e0d2630d0537 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:32.798548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c0798-1dc6-413c-a597-e0d2630d0537 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:32.798959 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c0798-1dc6-413c-a597-e0d2630d0537 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:32.801797 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 836/1666] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 7 22:01:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 22:01:32.866007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f13203-a2ef-46d6-83aa-8059f7d5fbdd None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:32.866303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f13203-a2ef-46d6-83aa-8059f7d5fbdd None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:32.866577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f13203-a2ef-46d6-83aa-8059f7d5fbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:32.907668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-42f13203-a2ef-46d6-83aa-8059f7d5fbdd None None] MFA Rules not processed for user `90facf92f97d435dbe8a001759a8fe0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:32.928441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-42f13203-a2ef-46d6-83aa-8059f7d5fbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:32.958443 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 831/1667] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:32 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:01:32.968228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb33c86-840f-44d7-ab0b-ab1cd4b7d2ac None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:32.970284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6bb33c86-840f-44d7-ab0b-ab1cd4b7d2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:33.091289 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 837/1668] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 7 22:01:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:33.134177 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f13203-a2ef-46d6-83aa-8059f7d5fbdd None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:33.155286 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb33c86-840f-44d7-ab0b-ab1cd4b7d2ac None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:33.166640 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ded87e-8ac2-48cf-bc0b-b251d0381735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:33.167316 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ded87e-8ac2-48cf-bc0b-b251d0381735 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:33.167605 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ded87e-8ac2-48cf-bc0b-b251d0381735 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:33.167887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ded87e-8ac2-48cf-bc0b-b251d0381735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:33.176877 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f13203-a2ef-46d6-83aa-8059f7d5fbdd None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:33.184674 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926c8d8-3950-4d83-a43f-7ee9788eac55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90facf92f97d435dbe8a001759a8fe0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:33.187289 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926c8d8-3950-4d83-a43f-7ee9788eac55 service placement] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:33.187676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926c8d8-3950-4d83-a43f-7ee9788eac55 service placement] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:33.188052 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926c8d8-3950-4d83-a43f-7ee9788eac55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:33.203272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ded87e-8ac2-48cf-bc0b-b251d0381735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:33.204730 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ded87e-8ac2-48cf-bc0b-b251d0381735 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:33.228542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 832/1669] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:32 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:33.233864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926c8d8-3950-4d83-a43f-7ee9788eac55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:33.239575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926c8d8-3950-4d83-a43f-7ee9788eac55 service placement] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:33.316717 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 838/1670] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:33.439754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ded87e-8ac2-48cf-bc0b-b251d0381735 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:33.440931 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-46ded87e-8ac2-48cf-bc0b-b251d0381735 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:33.563679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926c8d8-3950-4d83-a43f-7ee9788eac55 service placement] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:33.619984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:33.662228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ded87e-8ac2-48cf-bc0b-b251d0381735 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:33.676174 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d1108-1ceb-4b57-8566-8abd5a352086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:33.681511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d1108-1ceb-4b57-8566-8abd5a352086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:33.681963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d1108-1ceb-4b57-8566-8abd5a352086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:33.682163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d1108-1ceb-4b57-8566-8abd5a352086 admin admin] PATH_INFO: `/v3/users/4054810ecdac475f8e94ff525dc88ae7` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:33.686209 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d1108-1ceb-4b57-8566-8abd5a352086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4054810ecdac475f8e94ff525dc88ae7)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:33.688233 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d1108-1ceb-4b57-8566-8abd5a352086 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:33.726732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926c8d8-3950-4d83-a43f-7ee9788eac55 service placement] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:33.732643 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0715d9-5faa-436d-a834-c6c3b9165f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:33.733792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0715d9-5faa-436d-a834-c6c3b9165f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:33.734342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0715d9-5faa-436d-a834-c6c3b9165f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:33.734760 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0715d9-5faa-436d-a834-c6c3b9165f50 admin admin] PATH_INFO: `/v3/users/5e6a11653ab347139ecc470814a9b887` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:33.736747 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0715d9-5faa-436d-a834-c6c3b9165f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6a11653ab347139ecc470814a9b887)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:33.739726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0715d9-5faa-436d-a834-c6c3b9165f50 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:33.760249 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:33.811959 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bc0715d9-5faa-436d-a834-c6c3b9165f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6a11653ab347139ecc470814a9b887'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:33.824460 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bc0715d9-5faa-436d-a834-c6c3b9165f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6a11653ab347139ecc470814a9b887'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:33.834885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bc0715d9-5faa-436d-a834-c6c3b9165f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6a11653ab347139ecc470814a9b887'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:33.835851 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bc0715d9-5faa-436d-a834-c6c3b9165f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6a11653ab347139ecc470814a9b887'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:33.836715 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bc0715d9-5faa-436d-a834-c6c3b9165f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6a11653ab347139ecc470814a9b887'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:33.839594 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d18d1108-1ceb-4b57-8566-8abd5a352086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4054810ecdac475f8e94ff525dc88ae7'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:33.860264 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d18d1108-1ceb-4b57-8566-8abd5a352086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4054810ecdac475f8e94ff525dc88ae7'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:33.860703 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 839/1671] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:01:33 2022] DELETE /identity/v3/users/5e6a11653ab347139ecc470814a9b887 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:01:33.860975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d18d1108-1ceb-4b57-8566-8abd5a352086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4054810ecdac475f8e94ff525dc88ae7'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:33.866365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc1b31-e6b4-4246-86e7-a9882c9d98cb None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:33.867051 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc1b31-e6b4-4246-86e7-a9882c9d98cb None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:33.867770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc1b31-e6b4-4246-86e7-a9882c9d98cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:33.881979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d18d1108-1ceb-4b57-8566-8abd5a352086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4054810ecdac475f8e94ff525dc88ae7'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:33.882539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d18d1108-1ceb-4b57-8566-8abd5a352086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4054810ecdac475f8e94ff525dc88ae7'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:33.920161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 833/1672] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:01:33 2022] DELETE /identity/v3/users/4054810ecdac475f8e94ff525dc88ae7 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:33.922407 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2a599-96b3-424a-b856-eedca7a69667 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:33.922698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2a599-96b3-424a-b856-eedca7a69667 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:33.922975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2a599-96b3-424a-b856-eedca7a69667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:33.951836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-a0dc1b31-e6b4-4246-86e7-a9882c9d98cb None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:33.956199 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a0dc1b31-e6b4-4246-86e7-a9882c9d98cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:33.959305 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e1b2a599-96b3-424a-b856-eedca7a69667 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:33.960883 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e1b2a599-96b3-424a-b856-eedca7a69667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:34.121627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 840/1673] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:34.129918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 834/1674] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:34.240359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc1b31-e6b4-4246-86e7-a9882c9d98cb None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:34.241919 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a0dc1b31-e6b4-4246-86e7-a9882c9d98cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:34.249108 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa3482-f3c5-46ba-8db3-d4afbc4c9365 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:34.249400 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa3482-f3c5-46ba-8db3-d4afbc4c9365 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:34.249582 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa3482-f3c5-46ba-8db3-d4afbc4c9365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:34.320248 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1ffa3482-f3c5-46ba-8db3-d4afbc4c9365 None None] MFA Rules not processed for user `4fc55e3a9107489a9b24385ac5379ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:34.322010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1ffa3482-f3c5-46ba-8db3-d4afbc4c9365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:34.475153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc1b31-e6b4-4246-86e7-a9882c9d98cb None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:34.490971 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec586d-cc31-4426-9b14-a3cb78ae8191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:34.493081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec586d-cc31-4426-9b14-a3cb78ae8191 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:34.494889 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec586d-cc31-4426-9b14-a3cb78ae8191 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:34.495374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec586d-cc31-4426-9b14-a3cb78ae8191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:34.524312 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 835/1675] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 7 22:01:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:34.530341 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec586d-cc31-4426-9b14-a3cb78ae8191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:34.533523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec586d-cc31-4426-9b14-a3cb78ae8191 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:34.538503 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa3482-f3c5-46ba-8db3-d4afbc4c9365 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:34.558785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa3482-f3c5-46ba-8db3-d4afbc4c9365 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:34.567006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 841/1676] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:34.567592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26c28e-a978-4571-b3f7-f8fcc3e13318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:34.569526 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26c28e-a978-4571-b3f7-f8fcc3e13318 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:34.569818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26c28e-a978-4571-b3f7-f8fcc3e13318 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:34.571882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26c28e-a978-4571-b3f7-f8fcc3e13318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:34.594865 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26c28e-a978-4571-b3f7-f8fcc3e13318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:34.599654 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26c28e-a978-4571-b3f7-f8fcc3e13318 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:34.636675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 836/1677] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:34.784799 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec586d-cc31-4426-9b14-a3cb78ae8191 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:34.786397 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-40ec586d-cc31-4426-9b14-a3cb78ae8191 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:34.858367 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:34.932275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec586d-cc31-4426-9b14-a3cb78ae8191 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:34.947096 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5aa80a-004e-42b4-88f1-ed08b355017d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b69c708fbc470aae3e3954e21a1e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:34.947706 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5aa80a-004e-42b4-88f1-ed08b355017d service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:34.947993 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5aa80a-004e-42b4-88f1-ed08b355017d service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:34.950651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5aa80a-004e-42b4-88f1-ed08b355017d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:34.963033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5aa80a-004e-42b4-88f1-ed08b355017d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:34.967032 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5aa80a-004e-42b4-88f1-ed08b355017d service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:34.978783 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 842/1678] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 7 22:01:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 22:01:36.956233 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26c28e-a978-4571-b3f7-f8fcc3e13318 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:36.965090 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7a26c28e-a978-4571-b3f7-f8fcc3e13318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:37.009274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:37.019583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26c28e-a978-4571-b3f7-f8fcc3e13318 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:37.045055 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa068cad-5f85-4bc1-bdd1-d4d1f3931441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:37.047343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa068cad-5f85-4bc1-bdd1-d4d1f3931441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:37.052237 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa068cad-5f85-4bc1-bdd1-d4d1f3931441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:37.052527 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa068cad-5f85-4bc1-bdd1-d4d1f3931441 admin admin] PATH_INFO: `/v3/users/1d56d137e7954d6981f7553939632668` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:37.056770 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa068cad-5f85-4bc1-bdd1-d4d1f3931441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d56d137e7954d6981f7553939632668)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:37.066016 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa068cad-5f85-4bc1-bdd1-d4d1f3931441 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:37.205204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-aa068cad-5f85-4bc1-bdd1-d4d1f3931441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d56d137e7954d6981f7553939632668'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:37.219415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-aa068cad-5f85-4bc1-bdd1-d4d1f3931441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d56d137e7954d6981f7553939632668'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:37.220232 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-aa068cad-5f85-4bc1-bdd1-d4d1f3931441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d56d137e7954d6981f7553939632668'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:37.253171 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-aa068cad-5f85-4bc1-bdd1-d4d1f3931441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d56d137e7954d6981f7553939632668'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:37.254119 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-aa068cad-5f85-4bc1-bdd1-d4d1f3931441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d56d137e7954d6981f7553939632668'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:37.337387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 837/1679] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:01:36 2022] DELETE /identity/v3/users/1d56d137e7954d6981f7553939632668 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:38.125334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5aa80a-004e-42b4-88f1-ed08b355017d service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:38.127493 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1a5aa80a-004e-42b4-88f1-ed08b355017d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:38.153686 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5aa80a-004e-42b4-88f1-ed08b355017d service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:38.345805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b0855-9f4d-42e5-b250-2b5f31f0bd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:38.351330 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b0855-9f4d-42e5-b250-2b5f31f0bd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:38.351643 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa068cad-5f85-4bc1-bdd1-d4d1f3931441 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:38.352148 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b0855-9f4d-42e5-b250-2b5f31f0bd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:38.352148 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b0855-9f4d-42e5-b250-2b5f31f0bd4f admin admin] PATH_INFO: `/v3/users/31a1dbb226434d0cb53ad49defa1265f` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:38.354124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-aa068cad-5f85-4bc1-bdd1-d4d1f3931441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:38.354779 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b0855-9f4d-42e5-b250-2b5f31f0bd4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a1dbb226434d0cb53ad49defa1265f)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:38.359939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b0855-9f4d-42e5-b250-2b5f31f0bd4f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:38.398698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa068cad-5f85-4bc1-bdd1-d4d1f3931441 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:38.428421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e67256-eb48-4c2f-aefb-5366ac046936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:38.429820 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e67256-eb48-4c2f-aefb-5366ac046936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:38.430458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e67256-eb48-4c2f-aefb-5366ac046936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:38.430925 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e67256-eb48-4c2f-aefb-5366ac046936 admin admin] PATH_INFO: `/v3/projects/612f774c4dcb40afb936c701d32d5c7d` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:38.454895 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e67256-eb48-4c2f-aefb-5366ac046936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=612f774c4dcb40afb936c701d32d5c7d)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:38.460516 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e67256-eb48-4c2f-aefb-5366ac046936 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:38.471142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ca5b0855-9f4d-42e5-b250-2b5f31f0bd4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a1dbb226434d0cb53ad49defa1265f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:38.502389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ca5b0855-9f4d-42e5-b250-2b5f31f0bd4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a1dbb226434d0cb53ad49defa1265f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:38.519623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ca5b0855-9f4d-42e5-b250-2b5f31f0bd4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a1dbb226434d0cb53ad49defa1265f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:38.521448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ca5b0855-9f4d-42e5-b250-2b5f31f0bd4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a1dbb226434d0cb53ad49defa1265f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:38.522270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ca5b0855-9f4d-42e5-b250-2b5f31f0bd4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a1dbb226434d0cb53ad49defa1265f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:38.593955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 843/1680] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:01:38 2022] DELETE /identity/v3/users/31a1dbb226434d0cb53ad49defa1265f => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:38.597937 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076234e4-3ed6-45a0-9c66-dd64b1527976 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:38.597937 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076234e4-3ed6-45a0-9c66-dd64b1527976 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:38.597937 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076234e4-3ed6-45a0-9c66-dd64b1527976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:38.623614 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-076234e4-3ed6-45a0-9c66-dd64b1527976 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:38.625066 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-076234e4-3ed6-45a0-9c66-dd64b1527976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:38.631086 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-45e67256-eb48-4c2f-aefb-5366ac046936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '612f774c4dcb40afb936c701d32d5c7d', 'request_id': 'req-45e67256-eb48-4c2f-aefb-5366ac046936'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:38.638852 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-45e67256-eb48-4c2f-aefb-5366ac046936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '612f774c4dcb40afb936c701d32d5c7d', 'request_id': 'req-45e67256-eb48-4c2f-aefb-5366ac046936'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:38.661441 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-45e67256-eb48-4c2f-aefb-5366ac046936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '612f774c4dcb40afb936c701d32d5c7d', 'request_id': 'req-45e67256-eb48-4c2f-aefb-5366ac046936'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:38.724954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-45e67256-eb48-4c2f-aefb-5366ac046936 admin admin] The token cache is being invalidate because project 612f774c4dcb40afb936c701d32d5c7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:01:38.725498 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-45e67256-eb48-4c2f-aefb-5366ac046936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:38.734593 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-45e67256-eb48-4c2f-aefb-5366ac046936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:38.742264 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 838/1681] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:01:38 2022] DELETE /identity/v3/projects/612f774c4dcb40afb936c701d32d5c7d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:01:38.749625 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726cf61-40a7-4900-80dd-5a1f39fe1d9b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:38.752251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726cf61-40a7-4900-80dd-5a1f39fe1d9b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:38.752724 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726cf61-40a7-4900-80dd-5a1f39fe1d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:38.828256 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:38.872162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3726cf61-40a7-4900-80dd-5a1f39fe1d9b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:38.880721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3726cf61-40a7-4900-80dd-5a1f39fe1d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:38.909856 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 839/1682] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:38.917404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726cf61-40a7-4900-80dd-5a1f39fe1d9b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:38.918750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 844/1683] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:38.922694 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982aa0f-b779-405b-84f0-e40b289f0f0f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:38.925739 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3726cf61-40a7-4900-80dd-5a1f39fe1d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:38.926413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982aa0f-b779-405b-84f0-e40b289f0f0f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:38.926837 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982aa0f-b779-405b-84f0-e40b289f0f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:38.961694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726cf61-40a7-4900-80dd-5a1f39fe1d9b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:38.974006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7982aa0f-b779-405b-84f0-e40b289f0f0f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:38.978442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7982aa0f-b779-405b-84f0-e40b289f0f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:38.982059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273649e-4e5b-4361-a4c2-8604ba4b02a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:38.982875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273649e-4e5b-4361-a4c2-8604ba4b02a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:38.983171 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273649e-4e5b-4361-a4c2-8604ba4b02a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:38.983450 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273649e-4e5b-4361-a4c2-8604ba4b02a7 admin admin] PATH_INFO: `/v3/projects/043e0b3a51084baaaa88dd37762985e3` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:38.984805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273649e-4e5b-4361-a4c2-8604ba4b02a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=043e0b3a51084baaaa88dd37762985e3)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:38.986900 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273649e-4e5b-4361-a4c2-8604ba4b02a7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:39.002492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 845/1684] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:39.003835 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982aa0f-b779-405b-84f0-e40b289f0f0f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:39.008770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7982aa0f-b779-405b-84f0-e40b289f0f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:39.036304 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982aa0f-b779-405b-84f0-e40b289f0f0f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:39.041573 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a0239-8911-46b4-a33d-79b9b3c206f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:39.042690 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a0239-8911-46b4-a33d-79b9b3c206f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:39.042942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a0239-8911-46b4-a33d-79b9b3c206f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:39.043216 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a0239-8911-46b4-a33d-79b9b3c206f8 admin admin] PATH_INFO: `/v3/projects/3c0d11ed30f648debf6708743bb5cb08` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:39.045097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a0239-8911-46b4-a33d-79b9b3c206f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c0d11ed30f648debf6708743bb5cb08)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:39.048444 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a0239-8911-46b4-a33d-79b9b3c206f8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:39.102575 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:39.108834 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1273649e-4e5b-4361-a4c2-8604ba4b02a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043e0b3a51084baaaa88dd37762985e3', 'request_id': 'req-1273649e-4e5b-4361-a4c2-8604ba4b02a7'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.127563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1273649e-4e5b-4361-a4c2-8604ba4b02a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043e0b3a51084baaaa88dd37762985e3', 'request_id': 'req-1273649e-4e5b-4361-a4c2-8604ba4b02a7'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.144137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1273649e-4e5b-4361-a4c2-8604ba4b02a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043e0b3a51084baaaa88dd37762985e3', 'request_id': 'req-1273649e-4e5b-4361-a4c2-8604ba4b02a7'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.156212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-007a0239-8911-46b4-a33d-79b9b3c206f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c0d11ed30f648debf6708743bb5cb08', 'request_id': 'req-007a0239-8911-46b4-a33d-79b9b3c206f8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.169461 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-007a0239-8911-46b4-a33d-79b9b3c206f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c0d11ed30f648debf6708743bb5cb08', 'request_id': 'req-007a0239-8911-46b4-a33d-79b9b3c206f8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.171848 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1273649e-4e5b-4361-a4c2-8604ba4b02a7 admin admin] The token cache is being invalidate because project 043e0b3a51084baaaa88dd37762985e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:01:39.172163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1273649e-4e5b-4361-a4c2-8604ba4b02a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.175063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1273649e-4e5b-4361-a4c2-8604ba4b02a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.181592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 840/1685] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:01:38 2022] DELETE /identity/v3/projects/043e0b3a51084baaaa88dd37762985e3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:39.182514 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273649e-4e5b-4361-a4c2-8604ba4b02a7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:39.185850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1273649e-4e5b-4361-a4c2-8604ba4b02a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:39.202640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-007a0239-8911-46b4-a33d-79b9b3c206f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c0d11ed30f648debf6708743bb5cb08', 'request_id': 'req-007a0239-8911-46b4-a33d-79b9b3c206f8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.220138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-007a0239-8911-46b4-a33d-79b9b3c206f8 admin admin] The token cache is being invalidate because project 3c0d11ed30f648debf6708743bb5cb08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:01:39.222859 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-007a0239-8911-46b4-a33d-79b9b3c206f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.224715 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-007a0239-8911-46b4-a33d-79b9b3c206f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.238723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 846/1686] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:01:39 2022] DELETE /identity/v3/projects/3c0d11ed30f648debf6708743bb5cb08 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:39.239998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a0239-8911-46b4-a33d-79b9b3c206f8 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:39.242120 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-007a0239-8911-46b4-a33d-79b9b3c206f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:39.352346 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273649e-4e5b-4361-a4c2-8604ba4b02a7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:39.401069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a0239-8911-46b4-a33d-79b9b3c206f8 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:39.408661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902ef06-79a6-4f4e-8135-fa0fe906595a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:39.409289 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902ef06-79a6-4f4e-8135-fa0fe906595a service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:39.409673 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902ef06-79a6-4f4e-8135-fa0fe906595a service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:39.410044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902ef06-79a6-4f4e-8135-fa0fe906595a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:39.412243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e902ef06-79a6-4f4e-8135-fa0fe906595a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:39.498136 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d43c40-8d40-400d-bf41-0c89c8778625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:39.501386 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d43c40-8d40-400d-bf41-0c89c8778625 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:39.502812 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d43c40-8d40-400d-bf41-0c89c8778625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:39.503349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d43c40-8d40-400d-bf41-0c89c8778625 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:39.507257 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d43c40-8d40-400d-bf41-0c89c8778625 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:01:39.508447 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d43c40-8d40-400d-bf41-0c89c8778625 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:39.512937 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d43c40-8d40-400d-bf41-0c89c8778625 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:39.545163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 841/1687] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:01:39.547764 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d43c40-8d40-400d-bf41-0c89c8778625 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:39.565030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e9d43c40-8d40-400d-bf41-0c89c8778625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:39.591659 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902ef06-79a6-4f4e-8135-fa0fe906595a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:39.594127 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902ef06-79a6-4f4e-8135-fa0fe906595a service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:39.594967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d43c40-8d40-400d-bf41-0c89c8778625 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:39.608997 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 847/1688] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:39.610463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902ef06-79a6-4f4e-8135-fa0fe906595a service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:39.613178 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e902ef06-79a6-4f4e-8135-fa0fe906595a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:39.624499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95df84-0a65-4a90-b6ab-d67df3729180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:39.625651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95df84-0a65-4a90-b6ab-d67df3729180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:39.625995 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95df84-0a65-4a90-b6ab-d67df3729180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:39.626373 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95df84-0a65-4a90-b6ab-d67df3729180 admin admin] PATH_INFO: `/v3/users/0109c6feaf17425991942fcd8eaa87af` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:39.632571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95df84-0a65-4a90-b6ab-d67df3729180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0109c6feaf17425991942fcd8eaa87af)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:39.636003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95df84-0a65-4a90-b6ab-d67df3729180 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:39.637283 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902ef06-79a6-4f4e-8135-fa0fe906595a service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:39.643435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3991a-a701-414c-934d-1cfe1d01aec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:39.644631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3991a-a701-414c-934d-1cfe1d01aec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:39.645163 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3991a-a701-414c-934d-1cfe1d01aec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:39.645771 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3991a-a701-414c-934d-1cfe1d01aec0 admin admin] PATH_INFO: `/v3/users/2c786f8f25b5489782f27f8bd0316507` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:39.648675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3991a-a701-414c-934d-1cfe1d01aec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c786f8f25b5489782f27f8bd0316507)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:39.654071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3991a-a701-414c-934d-1cfe1d01aec0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:39.663609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:39.757463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0fa3991a-a701-414c-934d-1cfe1d01aec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c786f8f25b5489782f27f8bd0316507'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.767827 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0fa3991a-a701-414c-934d-1cfe1d01aec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c786f8f25b5489782f27f8bd0316507'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.775815 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-db95df84-0a65-4a90-b6ab-d67df3729180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0109c6feaf17425991942fcd8eaa87af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.788650 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-db95df84-0a65-4a90-b6ab-d67df3729180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0109c6feaf17425991942fcd8eaa87af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.789417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-db95df84-0a65-4a90-b6ab-d67df3729180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0109c6feaf17425991942fcd8eaa87af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.797479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0fa3991a-a701-414c-934d-1cfe1d01aec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c786f8f25b5489782f27f8bd0316507'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.800651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0fa3991a-a701-414c-934d-1cfe1d01aec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c786f8f25b5489782f27f8bd0316507'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.804220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0fa3991a-a701-414c-934d-1cfe1d01aec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c786f8f25b5489782f27f8bd0316507'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.804676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-db95df84-0a65-4a90-b6ab-d67df3729180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0109c6feaf17425991942fcd8eaa87af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.805574 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-db95df84-0a65-4a90-b6ab-d67df3729180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0109c6feaf17425991942fcd8eaa87af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:39.826967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:39.879191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 842/1689] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:01:39 2022] DELETE /identity/v3/users/0109c6feaf17425991942fcd8eaa87af => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:39.879191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95df84-0a65-4a90-b6ab-d67df3729180 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:39.879191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-db95df84-0a65-4a90-b6ab-d67df3729180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:39.887902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 848/1690] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:01:39 2022] DELETE /identity/v3/users/2c786f8f25b5489782f27f8bd0316507 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:40.146122 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95df84-0a65-4a90-b6ab-d67df3729180 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:40.336170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7ce19-5a09-4f5f-9e85-ecd8a68f8f1d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:40.337143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7ce19-5a09-4f5f-9e85-ecd8a68f8f1d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:40.337644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7ce19-5a09-4f5f-9e85-ecd8a68f8f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:40.387329 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbae405-7ea3-47de-a9eb-0c1b23fca9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:40.388288 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae405-7ea3-47de-a9eb-0c1b23fca9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:40.388587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae405-7ea3-47de-a9eb-0c1b23fca9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:40.388867 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae405-7ea3-47de-a9eb-0c1b23fca9f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:40.389579 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbae405-7ea3-47de-a9eb-0c1b23fca9f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:40.398523 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbae405-7ea3-47de-a9eb-0c1b23fca9f2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:40.416088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3fb7ce19-5a09-4f5f-9e85-ecd8a68f8f1d None None] MFA Rules not processed for user `aab50bc9064e444184afb1b4c585ce39`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:40.422495 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3fb7ce19-5a09-4f5f-9e85-ecd8a68f8f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:40.453587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 843/1691] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:39 2022] POST /identity/v3/projects => generated 371 bytes in 593 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:40.459069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbae405-7ea3-47de-a9eb-0c1b23fca9f2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:40.616324 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbae405-7ea3-47de-a9eb-0c1b23fca9f2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:40.634445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f4062-bbba-4dce-8d5d-b9fc800edf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:40.637309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f4062-bbba-4dce-8d5d-b9fc800edf53 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:40.637618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f4062-bbba-4dce-8d5d-b9fc800edf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:40.637906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f4062-bbba-4dce-8d5d-b9fc800edf53 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:40.638657 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f4062-bbba-4dce-8d5d-b9fc800edf53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:40.644632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f4062-bbba-4dce-8d5d-b9fc800edf53 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:40.695072 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 844/1692] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:40 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:40.696892 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f4062-bbba-4dce-8d5d-b9fc800edf53 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:40.724524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f4062-bbba-4dce-8d5d-b9fc800edf53 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:40.736705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177f0ee-8976-4ffb-b234-f9fda24a6f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:40.737392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177f0ee-8976-4ffb-b234-f9fda24a6f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:40.737681 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177f0ee-8976-4ffb-b234-f9fda24a6f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:40.741992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177f0ee-8976-4ffb-b234-f9fda24a6f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:40.743092 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177f0ee-8976-4ffb-b234-f9fda24a6f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:40.744779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177f0ee-8976-4ffb-b234-f9fda24a6f92 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:40.761843 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:40.773749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 849/1693] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Jun 7 22:01:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:40.780629 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 845/1694] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:40.793869 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7ce19-5a09-4f5f-9e85-ecd8a68f8f1d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:40.828471 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7ce19-5a09-4f5f-9e85-ecd8a68f8f1d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:40.854581 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f802f4a-f9dd-440c-8fd0-e2f7e54429bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:40.855250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f802f4a-f9dd-440c-8fd0-e2f7e54429bb admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:40.855533 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f802f4a-f9dd-440c-8fd0-e2f7e54429bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:40.855810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f802f4a-f9dd-440c-8fd0-e2f7e54429bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:40.856813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f802f4a-f9dd-440c-8fd0-e2f7e54429bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:40.858508 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f802f4a-f9dd-440c-8fd0-e2f7e54429bb admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:40.897168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 850/1695] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:40.898847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177f0ee-8976-4ffb-b234-f9fda24a6f92 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:40.930533 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177f0ee-8976-4ffb-b234-f9fda24a6f92 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:40.933041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f802f4a-f9dd-440c-8fd0-e2f7e54429bb admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:40.942938 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2f802f4a-f9dd-440c-8fd0-e2f7e54429bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:40.961588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b73d1a-a0b2-4591-b058-73af34380202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:40.962565 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b73d1a-a0b2-4591-b058-73af34380202 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:40.962854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b73d1a-a0b2-4591-b058-73af34380202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:40.963139 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b73d1a-a0b2-4591-b058-73af34380202 admin admin] PATH_INFO: `/v3/projects/79a777e6294e4ce09bb4f022e9615619/users/b5e93e2735b746ea8f063482aa5079c7/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:41.011799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b73d1a-a0b2-4591-b058-73af34380202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a777e6294e4ce09bb4f022e9615619, user_id=b5e93e2735b746ea8f063482aa5079c7, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:41.014574 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b73d1a-a0b2-4591-b058-73af34380202 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:41.080969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 846/1696] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:40 2022] PUT /identity/v3/projects/79a777e6294e4ce09bb4f022e9615619/users/b5e93e2735b746ea8f063482aa5079c7/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:41.080969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b73d1a-a0b2-4591-b058-73af34380202 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:41.080969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-94b73d1a-a0b2-4591-b058-73af34380202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:41.123943 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f802f4a-f9dd-440c-8fd0-e2f7e54429bb admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:41.287303 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b73d1a-a0b2-4591-b058-73af34380202 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:41.290606 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:41.302152 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92970ba-0b87-44c3-a646-0d7ca2c6c5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:41.302869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92970ba-0b87-44c3-a646-0d7ca2c6c5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:41.303153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92970ba-0b87-44c3-a646-0d7ca2c6c5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:41.303431 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92970ba-0b87-44c3-a646-0d7ca2c6c5df admin admin] PATH_INFO: `/v3/projects/086457d6b1d048fabba3421b88e86245` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:41.312316 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92970ba-0b87-44c3-a646-0d7ca2c6c5df admin admin] RBAC: Authorizing `identity:delete_project(project_id=086457d6b1d048fabba3421b88e86245)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:41.314338 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92970ba-0b87-44c3-a646-0d7ca2c6c5df admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:41.340845 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54c837-81ba-44cd-b95f-a7b2b5c7e122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:41.343766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54c837-81ba-44cd-b95f-a7b2b5c7e122 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:41.345010 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54c837-81ba-44cd-b95f-a7b2b5c7e122 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:41.345324 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54c837-81ba-44cd-b95f-a7b2b5c7e122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:41.377119 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54c837-81ba-44cd-b95f-a7b2b5c7e122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:41.383184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54c837-81ba-44cd-b95f-a7b2b5c7e122 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:41.424362 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 851/1697] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:01:41.430279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09d349-fa9c-4472-84d1-65fbac753dd9 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:41.431571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09d349-fa9c-4472-84d1-65fbac753dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:41.431871 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09d349-fa9c-4472-84d1-65fbac753dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:41.447216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c92970ba-0b87-44c3-a646-0d7ca2c6c5df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086457d6b1d048fabba3421b88e86245', 'request_id': 'req-c92970ba-0b87-44c3-a646-0d7ca2c6c5df'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:41.460771 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c92970ba-0b87-44c3-a646-0d7ca2c6c5df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086457d6b1d048fabba3421b88e86245', 'request_id': 'req-c92970ba-0b87-44c3-a646-0d7ca2c6c5df'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:41.477038 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c92970ba-0b87-44c3-a646-0d7ca2c6c5df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086457d6b1d048fabba3421b88e86245', 'request_id': 'req-c92970ba-0b87-44c3-a646-0d7ca2c6c5df'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:41.502653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c92970ba-0b87-44c3-a646-0d7ca2c6c5df admin admin] The token cache is being invalidate because project 086457d6b1d048fabba3421b88e86245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:01:41.502905 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c92970ba-0b87-44c3-a646-0d7ca2c6c5df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:41.506450 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c92970ba-0b87-44c3-a646-0d7ca2c6c5df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:41.512101 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 847/1698] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:01:41 2022] DELETE /identity/v3/projects/086457d6b1d048fabba3421b88e86245 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:41.517031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6b0a5-3d89-4d43-99d1-5bbb6b28f6aa None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:41.519740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6b0a5-3d89-4d43-99d1-5bbb6b28f6aa None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:41.520650 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6b0a5-3d89-4d43-99d1-5bbb6b28f6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:41.556972 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8d09d349-fa9c-4472-84d1-65fbac753dd9 None None] MFA Rules not processed for user `b5e93e2735b746ea8f063482aa5079c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:41.563096 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c1f6b0a5-3d89-4d43-99d1-5bbb6b28f6aa None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:41.563314 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8d09d349-fa9c-4472-84d1-65fbac753dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:41.564694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c1f6b0a5-3d89-4d43-99d1-5bbb6b28f6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:41.757746 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 848/1699] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:41.764753 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c147af-3c85-4fb6-bb7b-fc8e1f35dd85 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:41.765112 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c147af-3c85-4fb6-bb7b-fc8e1f35dd85 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:41.765428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c147af-3c85-4fb6-bb7b-fc8e1f35dd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:41.787243 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:41.795657 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 852/1700] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:41.814778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-28c147af-3c85-4fb6-bb7b-fc8e1f35dd85 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:41.814930 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09d349-fa9c-4472-84d1-65fbac753dd9 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:41.816048 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-28c147af-3c85-4fb6-bb7b-fc8e1f35dd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:41.818448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8d09d349-fa9c-4472-84d1-65fbac753dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:41.867860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 849/1701] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:41.869664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890df492-2e17-4e14-a495-b2d9b6b12d92 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:41.869980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890df492-2e17-4e14-a495-b2d9b6b12d92 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:41.870388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890df492-2e17-4e14-a495-b2d9b6b12d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:41.941318 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-890df492-2e17-4e14-a495-b2d9b6b12d92 None None] MFA Rules not processed for user `08868c65e4824034a998df7398daac9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:41.945273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-890df492-2e17-4e14-a495-b2d9b6b12d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:42.049401 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09d349-fa9c-4472-84d1-65fbac753dd9 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:42.057788 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbfea1-dc41-4b38-a901-0e069463b53e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:42.058653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbfea1-dc41-4b38-a901-0e069463b53e service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:42.059047 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbfea1-dc41-4b38-a901-0e069463b53e service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:42.059492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbfea1-dc41-4b38-a901-0e069463b53e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:42.072199 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbfea1-dc41-4b38-a901-0e069463b53e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:42.074086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbfea1-dc41-4b38-a901-0e069463b53e service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:42.085230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 853/1702] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:42.086685 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbfea1-dc41-4b38-a901-0e069463b53e service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:42.099023 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbfea1-dc41-4b38-a901-0e069463b53e service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:42.104279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47a5bd-ec5b-4140-b8a3-07ff5f89262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:42.105088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47a5bd-ec5b-4140-b8a3-07ff5f89262b admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:42.105478 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47a5bd-ec5b-4140-b8a3-07ff5f89262b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:42.106330 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47a5bd-ec5b-4140-b8a3-07ff5f89262b admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:42.107036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47a5bd-ec5b-4140-b8a3-07ff5f89262b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:01:42.109259 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47a5bd-ec5b-4140-b8a3-07ff5f89262b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:42.110007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47a5bd-ec5b-4140-b8a3-07ff5f89262b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:42.143512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 854/1703] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:01:42.149965 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47a5bd-ec5b-4140-b8a3-07ff5f89262b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:42.157114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6e47a5bd-ec5b-4140-b8a3-07ff5f89262b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:42.182525 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 850/1704] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:42.193748 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47a5bd-ec5b-4140-b8a3-07ff5f89262b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:42.196324 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890df492-2e17-4e14-a495-b2d9b6b12d92 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:42.206848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b51fe1-88d8-4707-b273-01b0bf92e183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:42.209889 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b51fe1-88d8-4707-b273-01b0bf92e183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:42.211637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b51fe1-88d8-4707-b273-01b0bf92e183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:42.212141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b51fe1-88d8-4707-b273-01b0bf92e183 admin admin] PATH_INFO: `/v3/projects/f9a44f0b88574d44a609f388c2d44dfc` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:42.213576 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890df492-2e17-4e14-a495-b2d9b6b12d92 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:42.217246 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b51fe1-88d8-4707-b273-01b0bf92e183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a44f0b88574d44a609f388c2d44dfc)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:42.220653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b51fe1-88d8-4707-b273-01b0bf92e183 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:42.244567 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa956b8-949a-4096-9d3f-4c60b884a165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:42.245351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa956b8-949a-4096-9d3f-4c60b884a165 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:42.245713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa956b8-949a-4096-9d3f-4c60b884a165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:42.247075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa956b8-949a-4096-9d3f-4c60b884a165 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:42.247867 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa956b8-949a-4096-9d3f-4c60b884a165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:42.259603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa956b8-949a-4096-9d3f-4c60b884a165 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:42.341170 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 851/1705] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:42 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:42.343099 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa956b8-949a-4096-9d3f-4c60b884a165 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:42.345618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-baa956b8-949a-4096-9d3f-4c60b884a165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:42.347698 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:42.399407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c1b51fe1-88d8-4707-b273-01b0bf92e183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a44f0b88574d44a609f388c2d44dfc', 'request_id': 'req-c1b51fe1-88d8-4707-b273-01b0bf92e183'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:42.414074 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c1b51fe1-88d8-4707-b273-01b0bf92e183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a44f0b88574d44a609f388c2d44dfc', 'request_id': 'req-c1b51fe1-88d8-4707-b273-01b0bf92e183'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:42.434088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c1b51fe1-88d8-4707-b273-01b0bf92e183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a44f0b88574d44a609f388c2d44dfc', 'request_id': 'req-c1b51fe1-88d8-4707-b273-01b0bf92e183'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:42.469042 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c1b51fe1-88d8-4707-b273-01b0bf92e183 admin admin] The token cache is being invalidate because project f9a44f0b88574d44a609f388c2d44dfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:01:42.469042 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c1b51fe1-88d8-4707-b273-01b0bf92e183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:42.477186 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c1b51fe1-88d8-4707-b273-01b0bf92e183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:42.486137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 855/1706] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:01:42 2022] DELETE /identity/v3/projects/f9a44f0b88574d44a609f388c2d44dfc => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:42.487543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b51fe1-88d8-4707-b273-01b0bf92e183 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:42.491127 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c1b51fe1-88d8-4707-b273-01b0bf92e183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:42.646474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa956b8-949a-4096-9d3f-4c60b884a165 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:42.657024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf3193-86f9-44ec-987d-aa843a9799b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:42.658204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf3193-86f9-44ec-987d-aa843a9799b3 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:42.658494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf3193-86f9-44ec-987d-aa843a9799b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:42.658823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf3193-86f9-44ec-987d-aa843a9799b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:42.664106 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-16bf3193-86f9-44ec-987d-aa843a9799b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:42.780058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf3193-86f9-44ec-987d-aa843a9799b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:42.782234 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf3193-86f9-44ec-987d-aa843a9799b3 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:42.798996 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 852/1707] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:42.799275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b51fe1-88d8-4707-b273-01b0bf92e183 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:42.814493 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2167-58b5-4ac3-8bd6-e7c43f1db839 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:42.815057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2167-58b5-4ac3-8bd6-e7c43f1db839 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:42.817678 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2167-58b5-4ac3-8bd6-e7c43f1db839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:42.842818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:42.924434 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-52fe2167-58b5-4ac3-8bd6-e7c43f1db839 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:42.933868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-52fe2167-58b5-4ac3-8bd6-e7c43f1db839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:42.998865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a414d1-3397-4e54-895d-9192f1b018fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:42.999570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a414d1-3397-4e54-895d-9192f1b018fc admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:42.999855 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a414d1-3397-4e54-895d-9192f1b018fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:43.001845 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a414d1-3397-4e54-895d-9192f1b018fc admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:43.001845 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a414d1-3397-4e54-895d-9192f1b018fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:43.003104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a414d1-3397-4e54-895d-9192f1b018fc admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:43.071136 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 856/1708] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:42 2022] POST /identity/v3/users => generated 284 bytes in 588 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:43.073729 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a414d1-3397-4e54-895d-9192f1b018fc admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:43.133314 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a414d1-3397-4e54-895d-9192f1b018fc admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:43.155703 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5e23e-ac9b-46ee-84c3-786911c17e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:43.156503 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5e23e-ac9b-46ee-84c3-786911c17e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:43.156789 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5e23e-ac9b-46ee-84c3-786911c17e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:43.163119 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 853/1709] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:43.165860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5e23e-ac9b-46ee-84c3-786911c17e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:43.167374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5e23e-ac9b-46ee-84c3-786911c17e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:43.167488 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a403671-e757-49db-b926-07a67d884db6 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:43.167488 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a403671-e757-49db-b926-07a67d884db6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:43.167488 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a403671-e757-49db-b926-07a67d884db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:43.184988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5e23e-ac9b-46ee-84c3-786911c17e45 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:43.189979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8a403671-e757-49db-b926-07a67d884db6 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:43.191206 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8a403671-e757-49db-b926-07a67d884db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:43.203467 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 854/1710] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:43.208552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a403671-e757-49db-b926-07a67d884db6 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:43.223112 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a403671-e757-49db-b926-07a67d884db6 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:43.228713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737e96f-55f3-4c90-b1ec-b8b4af403ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:43.229413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737e96f-55f3-4c90-b1ec-b8b4af403ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:43.229785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737e96f-55f3-4c90-b1ec-b8b4af403ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:43.230121 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737e96f-55f3-4c90-b1ec-b8b4af403ebd admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:43.231334 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737e96f-55f3-4c90-b1ec-b8b4af403ebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:01:43.231709 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737e96f-55f3-4c90-b1ec-b8b4af403ebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:43.234350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737e96f-55f3-4c90-b1ec-b8b4af403ebd admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:43.255271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 857/1711] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:43.257497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5e23e-ac9b-46ee-84c3-786911c17e45 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:43.260060 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 855/1712] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:01:43.261838 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737e96f-55f3-4c90-b1ec-b8b4af403ebd admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:43.279929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737e96f-55f3-4c90-b1ec-b8b4af403ebd admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:43.293911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5e23e-ac9b-46ee-84c3-786911c17e45 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:43.307113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee3f81-d766-41a8-9c5e-60d8b3d91806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:43.309451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee3f81-d766-41a8-9c5e-60d8b3d91806 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:43.310892 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee3f81-d766-41a8-9c5e-60d8b3d91806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:43.312180 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee3f81-d766-41a8-9c5e-60d8b3d91806 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:43.314219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee3f81-d766-41a8-9c5e-60d8b3d91806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:43.322659 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee3f81-d766-41a8-9c5e-60d8b3d91806 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:43.334884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54d819-3090-47f2-adaf-a36b9150debb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:43.335586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54d819-3090-47f2-adaf-a36b9150debb admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:43.335872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54d819-3090-47f2-adaf-a36b9150debb admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:43.336158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54d819-3090-47f2-adaf-a36b9150debb admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:43.336892 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54d819-3090-47f2-adaf-a36b9150debb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:43.338568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54d819-3090-47f2-adaf-a36b9150debb admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:43.397186 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 858/1713] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:43.398190 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54d819-3090-47f2-adaf-a36b9150debb admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:43.413294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 856/1714] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:43 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:43.414326 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee3f81-d766-41a8-9c5e-60d8b3d91806 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:43.442695 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54d819-3090-47f2-adaf-a36b9150debb admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:43.624004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:43.676832 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee3f81-d766-41a8-9c5e-60d8b3d91806 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:43.694396 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704eca3-a8d7-45e1-8cd1-b7c69c83d107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:43.695093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704eca3-a8d7-45e1-8cd1-b7c69c83d107 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:43.695386 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704eca3-a8d7-45e1-8cd1-b7c69c83d107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:43.695664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704eca3-a8d7-45e1-8cd1-b7c69c83d107 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:43.696360 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704eca3-a8d7-45e1-8cd1-b7c69c83d107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:43.698761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704eca3-a8d7-45e1-8cd1-b7c69c83d107 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:43.704758 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cccd2-84d0-4659-af5c-dcb0bb424c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:43.706407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cccd2-84d0-4659-af5c-dcb0bb424c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:43.706798 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cccd2-84d0-4659-af5c-dcb0bb424c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:43.707262 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cccd2-84d0-4659-af5c-dcb0bb424c75 admin admin] PATH_INFO: `/v3/projects/85b9e7b6edbf42f2999a83e3605c0def/users/b0c9d706323941ee9ab0909d1ddd93d6/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:43.744328 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cccd2-84d0-4659-af5c-dcb0bb424c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b9e7b6edbf42f2999a83e3605c0def, user_id=b0c9d706323941ee9ab0909d1ddd93d6, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:43.758771 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cccd2-84d0-4659-af5c-dcb0bb424c75 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:43.759091 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 857/1715] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:43 2022] POST /identity/v3/users => generated 283 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:43.760056 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704eca3-a8d7-45e1-8cd1-b7c69c83d107 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:43.765265 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9704eca3-a8d7-45e1-8cd1-b7c69c83d107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:43.789981 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 859/1716] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:43 2022] PUT /identity/v3/projects/85b9e7b6edbf42f2999a83e3605c0def/users/b0c9d706323941ee9ab0909d1ddd93d6/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:43.789981 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cccd2-84d0-4659-af5c-dcb0bb424c75 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:43.799463 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704eca3-a8d7-45e1-8cd1-b7c69c83d107 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:43.984233 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:44.016907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0d01f-28ba-410a-b307-998fc2342133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:44.019502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0d01f-28ba-410a-b307-998fc2342133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:44.021681 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0d01f-28ba-410a-b307-998fc2342133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:44.022043 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0d01f-28ba-410a-b307-998fc2342133 admin admin] PATH_INFO: `/v3/projects/7b1f69df2b934af9bf5d3b90a66594ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:44.030822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0d01f-28ba-410a-b307-998fc2342133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b1f69df2b934af9bf5d3b90a66594ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:44.038322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0d01f-28ba-410a-b307-998fc2342133 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:44.068393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cccd2-84d0-4659-af5c-dcb0bb424c75 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:44.079877 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f086cea-17ec-46aa-8fb7-e17192165d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:44.081271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f086cea-17ec-46aa-8fb7-e17192165d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:44.082895 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f086cea-17ec-46aa-8fb7-e17192165d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:44.094145 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f086cea-17ec-46aa-8fb7-e17192165d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:44.096271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f086cea-17ec-46aa-8fb7-e17192165d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:44.107853 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f086cea-17ec-46aa-8fb7-e17192165d58 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:44.152668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7dd0d01f-28ba-410a-b307-998fc2342133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b1f69df2b934af9bf5d3b90a66594ce', 'request_id': 'req-7dd0d01f-28ba-410a-b307-998fc2342133'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:44.159259 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7dd0d01f-28ba-410a-b307-998fc2342133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b1f69df2b934af9bf5d3b90a66594ce', 'request_id': 'req-7dd0d01f-28ba-410a-b307-998fc2342133'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:44.168437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 860/1717] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:44.172439 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fd49c-471a-4526-9438-505597681423 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:44.172777 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fd49c-471a-4526-9438-505597681423 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:44.173060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fd49c-471a-4526-9438-505597681423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:44.173186 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7dd0d01f-28ba-410a-b307-998fc2342133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b1f69df2b934af9bf5d3b90a66594ce', 'request_id': 'req-7dd0d01f-28ba-410a-b307-998fc2342133'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:44.190652 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7dd0d01f-28ba-410a-b307-998fc2342133 admin admin] The token cache is being invalidate because project 7b1f69df2b934af9bf5d3b90a66594ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:01:44.190969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7dd0d01f-28ba-410a-b307-998fc2342133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:44.191639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7dd0d01f-28ba-410a-b307-998fc2342133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:44.193752 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 858/1718] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:01:43 2022] DELETE /identity/v3/projects/7b1f69df2b934af9bf5d3b90a66594ce => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:44.197709 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0d01f-28ba-410a-b307-998fc2342133 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:44.197709 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7dd0d01f-28ba-410a-b307-998fc2342133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:44.282446 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0d01f-28ba-410a-b307-998fc2342133 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:44.288624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf5c80-9d8f-4f23-8af2-bc82892f70f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:44.289419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5c80-9d8f-4f23-8af2-bc82892f70f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:44.289712 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5c80-9d8f-4f23-8af2-bc82892f70f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:44.290058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5c80-9d8f-4f23-8af2-bc82892f70f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:44.290807 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf5c80-9d8f-4f23-8af2-bc82892f70f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:44.292596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf5c80-9d8f-4f23-8af2-bc82892f70f0 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:44.308542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 859/1719] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:44.310045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca71d7-3719-4e1d-a2bd-6cb35a832b52 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:44.310346 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca71d7-3719-4e1d-a2bd-6cb35a832b52 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:44.310716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca71d7-3719-4e1d-a2bd-6cb35a832b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:44.325448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-374fd49c-471a-4526-9438-505597681423 None None] MFA Rules not processed for user `b0c9d706323941ee9ab0909d1ddd93d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:44.328453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-374fd49c-471a-4526-9438-505597681423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:44.343212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8eca71d7-3719-4e1d-a2bd-6cb35a832b52 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:44.344874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8eca71d7-3719-4e1d-a2bd-6cb35a832b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:44.388131 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 860/1720] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:44.389205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca71d7-3719-4e1d-a2bd-6cb35a832b52 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:44.404336 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca71d7-3719-4e1d-a2bd-6cb35a832b52 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:44.420065 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f480d-799f-4000-816b-0a7d8d67759c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:44.426395 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f480d-799f-4000-816b-0a7d8d67759c admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:44.426784 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f480d-799f-4000-816b-0a7d8d67759c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:44.427185 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f480d-799f-4000-816b-0a7d8d67759c admin admin] PATH_INFO: `/v3/projects/7a9a8b710e9844c0b71282f0ffcba769/users/11e3aeb509dd49b29b1ff4d2199fa767/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:44.453149 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f480d-799f-4000-816b-0a7d8d67759c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9a8b710e9844c0b71282f0ffcba769, user_id=11e3aeb509dd49b29b1ff4d2199fa767, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:44.462559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f480d-799f-4000-816b-0a7d8d67759c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:44.490787 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 861/1721] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:44 2022] PUT /identity/v3/projects/7a9a8b710e9844c0b71282f0ffcba769/users/11e3aeb509dd49b29b1ff4d2199fa767/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:44.492595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285a46a-a105-4add-9e9a-cc473135b6aa None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:44.493145 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285a46a-a105-4add-9e9a-cc473135b6aa None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:44.493664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285a46a-a105-4add-9e9a-cc473135b6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:44.544152 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4285a46a-a105-4add-9e9a-cc473135b6aa None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:44.545834 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4285a46a-a105-4add-9e9a-cc473135b6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:44.655058 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 861/1722] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:44.655058 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c69e9-afcb-435c-b15d-0bfd1643b8cf None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:44.655058 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c69e9-afcb-435c-b15d-0bfd1643b8cf None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:44.655058 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c69e9-afcb-435c-b15d-0bfd1643b8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:44.665491 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:44.716070 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 862/1723] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:44.718125 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5a43a-3142-480a-872f-50aa851fcab3 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:44.718125 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5a43a-3142-480a-872f-50aa851fcab3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:44.718585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5a43a-3142-480a-872f-50aa851fcab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:44.720184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b18c69e9-afcb-435c-b15d-0bfd1643b8cf None None] MFA Rules not processed for user `bd1a33ca9f5144c69a66affd662bb9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:44.721586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b18c69e9-afcb-435c-b15d-0bfd1643b8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:44.805074 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-90d5a43a-3142-480a-872f-50aa851fcab3 None None] MFA Rules not processed for user `11e3aeb509dd49b29b1ff4d2199fa767`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:44.807217 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-90d5a43a-3142-480a-872f-50aa851fcab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:44.835130 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:44.919767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 862/1724] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:44.927669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c5253-b870-4f39-8ae2-005cbd005802 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:44.927998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c5253-b870-4f39-8ae2-005cbd005802 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:44.928223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c5253-b870-4f39-8ae2-005cbd005802 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:44.930375 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 863/1725] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 7 22:01:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 22:01:44.931250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c5253-b870-4f39-8ae2-005cbd005802 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:44.941008 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-617c5253-b870-4f39-8ae2-005cbd005802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:44.994392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c5253-b870-4f39-8ae2-005cbd005802 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:45.007224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c57ab-e5a1-4c10-b816-ff370658d374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:45.008121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c57ab-e5a1-4c10-b816-ff370658d374 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:45.008409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c57ab-e5a1-4c10-b816-ff370658d374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:45.008736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c57ab-e5a1-4c10-b816-ff370658d374 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:45.010320 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c57ab-e5a1-4c10-b816-ff370658d374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:45.012573 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c57ab-e5a1-4c10-b816-ff370658d374 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:45.035795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 863/1726] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:45.036763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5a43a-3142-480a-872f-50aa851fcab3 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:45.049889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5a43a-3142-480a-872f-50aa851fcab3 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:45.057703 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f940-c136-4f5d-becc-996fe452cc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:45.058688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f940-c136-4f5d-becc-996fe452cc8b admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:45.059216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f940-c136-4f5d-becc-996fe452cc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:45.059598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f940-c136-4f5d-becc-996fe452cc8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:45.060548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974f940-c136-4f5d-becc-996fe452cc8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:01:45.061069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974f940-c136-4f5d-becc-996fe452cc8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:45.063158 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974f940-c136-4f5d-becc-996fe452cc8b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:45.094730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 864/1727] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:44 2022] POST /identity/v3/projects => generated 369 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:45.095635 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c57ab-e5a1-4c10-b816-ff370658d374 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:45.101416 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c53c57ab-e5a1-4c10-b816-ff370658d374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:45.111073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 864/1728] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:01:45.113312 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f940-c136-4f5d-becc-996fe452cc8b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:45.145818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f940-c136-4f5d-becc-996fe452cc8b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:45.394754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e93b5-a6e2-42e9-a33d-708ab6e4800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:45.396051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e93b5-a6e2-42e9-a33d-708ab6e4800e admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:45.396452 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e93b5-a6e2-42e9-a33d-708ab6e4800e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:45.396842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e93b5-a6e2-42e9-a33d-708ab6e4800e admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:45.402360 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e93b5-a6e2-42e9-a33d-708ab6e4800e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:45.404750 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e93b5-a6e2-42e9-a33d-708ab6e4800e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:45.414483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c57ab-e5a1-4c10-b816-ff370658d374 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:45.443372 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d90a27-530c-4778-ac89-213be420fba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:45.444065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90a27-530c-4778-ac89-213be420fba8 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:45.444352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90a27-530c-4778-ac89-213be420fba8 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:45.444633 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90a27-530c-4778-ac89-213be420fba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:45.531807 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 865/1729] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:45 2022] POST /identity/v3/projects => generated 365 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:45.537045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6553bb-1fd5-4634-8db1-1763ae4a81d3 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:45.547791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6553bb-1fd5-4634-8db1-1763ae4a81d3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:45.550127 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6553bb-1fd5-4634-8db1-1763ae4a81d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:45.629876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d90a27-530c-4778-ac89-213be420fba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:45.631549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d90a27-530c-4778-ac89-213be420fba8 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:45.663068 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8a6553bb-1fd5-4634-8db1-1763ae4a81d3 None None] MFA Rules not processed for user `1d5760a3f9f946978b1251d3e2aaa943`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:45.664335 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 865/1730] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:45.665183 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d90a27-530c-4778-ac89-213be420fba8 service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:45.667778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8a6553bb-1fd5-4634-8db1-1763ae4a81d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:45.694535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d90a27-530c-4778-ac89-213be420fba8 service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:45.860545 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:45.864234 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:45.889520 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee433277-3e2d-4518-8414-49afe93d351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:45.890311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee433277-3e2d-4518-8414-49afe93d351b admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:45.890598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee433277-3e2d-4518-8414-49afe93d351b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:45.890872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee433277-3e2d-4518-8414-49afe93d351b admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:45.895602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee433277-3e2d-4518-8414-49afe93d351b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:45.898169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee433277-3e2d-4518-8414-49afe93d351b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:45.915849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 866/1731] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 7 22:01:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:45.916666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6553bb-1fd5-4634-8db1-1763ae4a81d3 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:45.949386 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6553bb-1fd5-4634-8db1-1763ae4a81d3 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:45.961009 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533b6b5-7451-4723-950d-55cc1bbcb1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:45.961796 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533b6b5-7451-4723-950d-55cc1bbcb1a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:45.962010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533b6b5-7451-4723-950d-55cc1bbcb1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:45.962362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533b6b5-7451-4723-950d-55cc1bbcb1a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:45.962955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1533b6b5-7451-4723-950d-55cc1bbcb1a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:45.965199 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 866/1732] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:45 2022] POST /identity/v3/users => generated 291 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:45.967083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1533b6b5-7451-4723-950d-55cc1bbcb1a9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:45.969258 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee433277-3e2d-4518-8414-49afe93d351b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:45.975575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ee433277-3e2d-4518-8414-49afe93d351b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:46.016595 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee433277-3e2d-4518-8414-49afe93d351b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:46.021863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 867/1733] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:45 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:46.022817 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533b6b5-7451-4723-950d-55cc1bbcb1a9 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:46.027283 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3cebb-cdd2-47f9-a1c8-4da341457e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:46.030955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3cebb-cdd2-47f9-a1c8-4da341457e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:46.031487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3cebb-cdd2-47f9-a1c8-4da341457e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:46.032025 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3cebb-cdd2-47f9-a1c8-4da341457e83 admin admin] PATH_INFO: `/v3/users/b5e93e2735b746ea8f063482aa5079c7` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:46.033484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3cebb-cdd2-47f9-a1c8-4da341457e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e93e2735b746ea8f063482aa5079c7)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:46.039934 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3cebb-cdd2-47f9-a1c8-4da341457e83 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:46.148459 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533b6b5-7451-4723-950d-55cc1bbcb1a9 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:46.161477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fff3cebb-cdd2-47f9-a1c8-4da341457e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e93e2735b746ea8f063482aa5079c7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:46.167622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f55e-0010-445f-9122-3df2adf2f0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:46.168291 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f55e-0010-445f-9122-3df2adf2f0bc admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:46.168524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f55e-0010-445f-9122-3df2adf2f0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:46.168795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f55e-0010-445f-9122-3df2adf2f0bc admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:46.169496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2f55e-0010-445f-9122-3df2adf2f0bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:46.171506 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2f55e-0010-445f-9122-3df2adf2f0bc admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:46.187949 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fff3cebb-cdd2-47f9-a1c8-4da341457e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e93e2735b746ea8f063482aa5079c7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:46.209636 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fff3cebb-cdd2-47f9-a1c8-4da341457e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e93e2735b746ea8f063482aa5079c7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:46.210302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fff3cebb-cdd2-47f9-a1c8-4da341457e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e93e2735b746ea8f063482aa5079c7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:46.210995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fff3cebb-cdd2-47f9-a1c8-4da341457e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e93e2735b746ea8f063482aa5079c7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:46.219893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 868/1734] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:46 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:46.219893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f55e-0010-445f-9122-3df2adf2f0bc admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:46.226418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b4d2f55e-0010-445f-9122-3df2adf2f0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:46.262798 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 867/1735] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:01:45 2022] DELETE /identity/v3/users/b5e93e2735b746ea8f063482aa5079c7 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:46.263802 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3cebb-cdd2-47f9-a1c8-4da341457e83 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:46.265225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fff3cebb-cdd2-47f9-a1c8-4da341457e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:46.408169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f55e-0010-445f-9122-3df2adf2f0bc admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:46.543726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3cebb-cdd2-47f9-a1c8-4da341457e83 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:46.557521 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416010cd-41dc-4a61-8be4-46fbf85be4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:46.559117 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:46.561965 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416010cd-41dc-4a61-8be4-46fbf85be4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:46.562691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416010cd-41dc-4a61-8be4-46fbf85be4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:46.564517 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416010cd-41dc-4a61-8be4-46fbf85be4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:46.567735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416010cd-41dc-4a61-8be4-46fbf85be4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:46.572719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416010cd-41dc-4a61-8be4-46fbf85be4a3 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:46.599566 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 868/1736] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:46.607040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46bc6e-985a-444d-bd87-179fc0781de2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:46.607587 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416010cd-41dc-4a61-8be4-46fbf85be4a3 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:46.608071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46bc6e-985a-444d-bd87-179fc0781de2 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:46.608494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46bc6e-985a-444d-bd87-179fc0781de2 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:46.608908 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46bc6e-985a-444d-bd87-179fc0781de2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:46.611020 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-416010cd-41dc-4a61-8be4-46fbf85be4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:46.614746 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2b46bc6e-985a-444d-bd87-179fc0781de2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:46.644022 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416010cd-41dc-4a61-8be4-46fbf85be4a3 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:46.645622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46bc6e-985a-444d-bd87-179fc0781de2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:46.647453 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46bc6e-985a-444d-bd87-179fc0781de2 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:46.658691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c22d98-5a59-428c-a2f8-7da2456edfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:46.659396 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c22d98-5a59-428c-a2f8-7da2456edfdc admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:46.659685 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c22d98-5a59-428c-a2f8-7da2456edfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:46.659970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c22d98-5a59-428c-a2f8-7da2456edfdc admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:46.663221 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c22d98-5a59-428c-a2f8-7da2456edfdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:46.668887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c22d98-5a59-428c-a2f8-7da2456edfdc admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:46.679177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 869/1737] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:46.680331 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46bc6e-985a-444d-bd87-179fc0781de2 service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:46.683398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2b46bc6e-985a-444d-bd87-179fc0781de2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:46.723665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 869/1738] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:46 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:46.724183 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b55e93-3c2f-4621-bf3e-79de112b5d41 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:46.724486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b55e93-3c2f-4621-bf3e-79de112b5d41 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:46.726092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b55e93-3c2f-4621-bf3e-79de112b5d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:46.739318 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46bc6e-985a-444d-bd87-179fc0781de2 service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:46.757888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f81ad-b971-442c-b741-432613e37999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:46.758691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f81ad-b971-442c-b741-432613e37999 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:46.759116 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f81ad-b971-442c-b741-432613e37999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:46.759576 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f81ad-b971-442c-b741-432613e37999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:46.760318 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f81ad-b971-442c-b741-432613e37999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:46.762044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f81ad-b971-442c-b741-432613e37999 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:46.781515 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-a9b55e93-3c2f-4621-bf3e-79de112b5d41 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:46.787098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a9b55e93-3c2f-4621-bf3e-79de112b5d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:46.820683 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 870/1739] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:46.823058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f81ad-b971-442c-b741-432613e37999 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:46.831175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 870/1740] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:46.833337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b55e93-3c2f-4621-bf3e-79de112b5d41 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:46.865560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f81ad-b971-442c-b741-432613e37999 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:46.870263 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b55e93-3c2f-4621-bf3e-79de112b5d41 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:46.875388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad5e02-6a22-475f-ad5a-5f1e426a3648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:46.876546 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad5e02-6a22-475f-ad5a-5f1e426a3648 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:46.877024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad5e02-6a22-475f-ad5a-5f1e426a3648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:46.877489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad5e02-6a22-475f-ad5a-5f1e426a3648 admin admin] PATH_INFO: `/v3/projects/7e27a3d79cdb4704af319909c258e18a/users/baa12e9c082641259f0d49b5a2285366/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:46.904153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4065e-67d7-4907-a6fb-504cacfaaf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:46.909265 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4065e-67d7-4907-a6fb-504cacfaaf6b admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:46.909803 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4065e-67d7-4907-a6fb-504cacfaaf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:46.909918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4065e-67d7-4907-a6fb-504cacfaaf6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:46.914004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4065e-67d7-4907-a6fb-504cacfaaf6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:46.917315 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4065e-67d7-4907-a6fb-504cacfaaf6b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:46.918451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad5e02-6a22-475f-ad5a-5f1e426a3648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e27a3d79cdb4704af319909c258e18a, user_id=baa12e9c082641259f0d49b5a2285366, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:46.921399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad5e02-6a22-475f-ad5a-5f1e426a3648 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:46.953859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 871/1741] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:46 2022] PUT /identity/v3/projects/7e27a3d79cdb4704af319909c258e18a/users/baa12e9c082641259f0d49b5a2285366/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:46.955073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad5e02-6a22-475f-ad5a-5f1e426a3648 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:46.966683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 871/1742] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:46.968614 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4065e-67d7-4907-a6fb-504cacfaaf6b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:46.972313 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b9a4065e-67d7-4907-a6fb-504cacfaaf6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:47.067527 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:47.090915 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad5e02-6a22-475f-ad5a-5f1e426a3648 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:47.112577 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1040ced-7326-4572-b4d2-895588253b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:47.113796 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1040ced-7326-4572-b4d2-895588253b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:47.114061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1040ced-7326-4572-b4d2-895588253b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:47.114434 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1040ced-7326-4572-b4d2-895588253b7c admin admin] PATH_INFO: `/v3/projects/55bd151f91b44e2dbdcd0876b44eb457/users/5d6022ecf6764ec8b37d2d2d94f1405f/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:47.151659 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1040ced-7326-4572-b4d2-895588253b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=55bd151f91b44e2dbdcd0876b44eb457, user_id=5d6022ecf6764ec8b37d2d2d94f1405f, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:47.154733 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1040ced-7326-4572-b4d2-895588253b7c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:47.185677 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 872/1743] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:46 2022] PUT /identity/v3/projects/55bd151f91b44e2dbdcd0876b44eb457/users/5d6022ecf6764ec8b37d2d2d94f1405f/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:47.187015 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1040ced-7326-4572-b4d2-895588253b7c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:47.191716 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4065e-67d7-4907-a6fb-504cacfaaf6b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:47.326710 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1040ced-7326-4572-b4d2-895588253b7c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:47.340278 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706b046-4d1a-44a9-9b04-94424c197ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:47.342502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b046-4d1a-44a9-9b04-94424c197ede admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:47.342838 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b046-4d1a-44a9-9b04-94424c197ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:47.343785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b046-4d1a-44a9-9b04-94424c197ede admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:47.349292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706b046-4d1a-44a9-9b04-94424c197ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:47.353523 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706b046-4d1a-44a9-9b04-94424c197ede admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:47.388451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 873/1744] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:47.390518 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706b046-4d1a-44a9-9b04-94424c197ede admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:47.405316 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8317aec-5d0e-4b94-9f8a-17cc89d5a229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:47.406643 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8317aec-5d0e-4b94-9f8a-17cc89d5a229 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:47.406938 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8317aec-5d0e-4b94-9f8a-17cc89d5a229 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:47.407356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8317aec-5d0e-4b94-9f8a-17cc89d5a229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:47.419531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706b046-4d1a-44a9-9b04-94424c197ede admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:47.438018 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799cfd3-c6c9-47f6-9d5c-4be954e3d531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:47.438862 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799cfd3-c6c9-47f6-9d5c-4be954e3d531 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:47.439252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799cfd3-c6c9-47f6-9d5c-4be954e3d531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:47.439625 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799cfd3-c6c9-47f6-9d5c-4be954e3d531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:47.440482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799cfd3-c6c9-47f6-9d5c-4be954e3d531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:47.444474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799cfd3-c6c9-47f6-9d5c-4be954e3d531 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:47.466218 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8317aec-5d0e-4b94-9f8a-17cc89d5a229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:47.468880 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8317aec-5d0e-4b94-9f8a-17cc89d5a229 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:47.472386 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 874/1745] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:47.476967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799cfd3-c6c9-47f6-9d5c-4be954e3d531 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:47.512018 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 872/1746] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:47.512861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8317aec-5d0e-4b94-9f8a-17cc89d5a229 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:47.515539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799cfd3-c6c9-47f6-9d5c-4be954e3d531 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:47.538234 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38228f9-bf1a-4ce7-97e8-dba37a17ac6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:47.539272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38228f9-bf1a-4ce7-97e8-dba37a17ac6a admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:47.539757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38228f9-bf1a-4ce7-97e8-dba37a17ac6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:47.540232 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38228f9-bf1a-4ce7-97e8-dba37a17ac6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:47.541160 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38228f9-bf1a-4ce7-97e8-dba37a17ac6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:47.543188 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38228f9-bf1a-4ce7-97e8-dba37a17ac6a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:47.545024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:47.571135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 875/1747] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:47.574251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38228f9-bf1a-4ce7-97e8-dba37a17ac6a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:47.592662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8317aec-5d0e-4b94-9f8a-17cc89d5a229 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:47.600435 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38228f9-bf1a-4ce7-97e8-dba37a17ac6a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:47.614965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b434691-2a86-465d-b5b3-61ae10513489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:47.616115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b434691-2a86-465d-b5b3-61ae10513489 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:47.616498 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b434691-2a86-465d-b5b3-61ae10513489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:47.616991 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b434691-2a86-465d-b5b3-61ae10513489 admin admin] PATH_INFO: `/v3/projects/65fea48763544e6a999de8fff2b702c7/users/9e4ac938dca34a67b54ad0de268362ca/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:47.641128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fcbf5-182f-4706-a503-1c2c69833332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:47.642080 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fcbf5-182f-4706-a503-1c2c69833332 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:47.642365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fcbf5-182f-4706-a503-1c2c69833332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:47.642643 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fcbf5-182f-4706-a503-1c2c69833332 admin admin] PATH_INFO: `/v3/projects/7e27a3d79cdb4704af319909c258e18a/users/baa12e9c082641259f0d49b5a2285366/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:47.657896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b434691-2a86-465d-b5b3-61ae10513489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65fea48763544e6a999de8fff2b702c7, user_id=9e4ac938dca34a67b54ad0de268362ca, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:47.661844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b434691-2a86-465d-b5b3-61ae10513489 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:47.662518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fcbf5-182f-4706-a503-1c2c69833332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e27a3d79cdb4704af319909c258e18a, user_id=baa12e9c082641259f0d49b5a2285366, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:47.692178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 876/1748] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:47 2022] PUT /identity/v3/projects/65fea48763544e6a999de8fff2b702c7/users/9e4ac938dca34a67b54ad0de268362ca/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:47.692178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b434691-2a86-465d-b5b3-61ae10513489 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:47.692506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fcbf5-182f-4706-a503-1c2c69833332 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:47.753617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 873/1749] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:47 2022] PUT /identity/v3/projects/7e27a3d79cdb4704af319909c258e18a/users/baa12e9c082641259f0d49b5a2285366/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:47.753617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bf5f1-553e-4ef9-9617-5e2a26a800af None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:47.753874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bf5f1-553e-4ef9-9617-5e2a26a800af None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:47.754291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bf5f1-553e-4ef9-9617-5e2a26a800af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:47.787838 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b434691-2a86-465d-b5b3-61ae10513489 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:47.836131 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d29bf5f1-553e-4ef9-9617-5e2a26a800af None None] MFA Rules not processed for user `9e4ac938dca34a67b54ad0de268362ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:47.840125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d29bf5f1-553e-4ef9-9617-5e2a26a800af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:47.966773 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c80fe4-6464-4e61-9e7a-75f29b96dcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:47.967691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c80fe4-6464-4e61-9e7a-75f29b96dcef admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:47.967975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c80fe4-6464-4e61-9e7a-75f29b96dcef admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:47.968254 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c80fe4-6464-4e61-9e7a-75f29b96dcef admin admin] PATH_INFO: `/v3/projects/55bd151f91b44e2dbdcd0876b44eb457/users/5d6022ecf6764ec8b37d2d2d94f1405f/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:47.982857 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 874/1750] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:47.982857 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9941cf3-921b-4bb3-8bb7-6458d5ebb28e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:47.982857 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9941cf3-921b-4bb3-8bb7-6458d5ebb28e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:47.982857 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9941cf3-921b-4bb3-8bb7-6458d5ebb28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:47.995452 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c80fe4-6464-4e61-9e7a-75f29b96dcef admin admin] RBAC: Authorizing `identity:create_grant(project_id=55bd151f91b44e2dbdcd0876b44eb457, user_id=5d6022ecf6764ec8b37d2d2d94f1405f, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:48.010430 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c80fe4-6464-4e61-9e7a-75f29b96dcef admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:48.058934 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b9941cf3-921b-4bb3-8bb7-6458d5ebb28e None None] MFA Rules not processed for user `baa12e9c082641259f0d49b5a2285366`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:48.063432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b9941cf3-921b-4bb3-8bb7-6458d5ebb28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:48.073726 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 877/1751] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:47 2022] PUT /identity/v3/projects/55bd151f91b44e2dbdcd0876b44eb457/users/5d6022ecf6764ec8b37d2d2d94f1405f/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:48.075561 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c80fe4-6464-4e61-9e7a-75f29b96dcef admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:48.265157 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:48.340606 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c80fe4-6464-4e61-9e7a-75f29b96dcef admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:48.350858 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 875/1752] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:47 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:48.356306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843eae76-5b95-4a28-99b2-1b35801d9067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:48.356994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eae76-5b95-4a28-99b2-1b35801d9067 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:48.357279 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eae76-5b95-4a28-99b2-1b35801d9067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:48.357642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a66d8-7a67-4b3c-969b-c74553a7746c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:48.358060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a66d8-7a67-4b3c-969b-c74553a7746c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:48.358316 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a66d8-7a67-4b3c-969b-c74553a7746c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:48.367119 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eae76-5b95-4a28-99b2-1b35801d9067 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:48.368037 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843eae76-5b95-4a28-99b2-1b35801d9067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:48.371342 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843eae76-5b95-4a28-99b2-1b35801d9067 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:48.424510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:48.445167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 878/1753] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:48 2022] POST /identity/v3/projects => generated 373 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:48.446143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843eae76-5b95-4a28-99b2-1b35801d9067 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:48.450023 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-843eae76-5b95-4a28-99b2-1b35801d9067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:48.484119 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-572a66d8-7a67-4b3c-969b-c74553a7746c None None] MFA Rules not processed for user `5d6022ecf6764ec8b37d2d2d94f1405f`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:48.485503 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-572a66d8-7a67-4b3c-969b-c74553a7746c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:48.632090 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843eae76-5b95-4a28-99b2-1b35801d9067 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:48.645644 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d205-baf5-4674-a909-287594a714f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:48.646428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d205-baf5-4674-a909-287594a714f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:48.646727 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d205-baf5-4674-a909-287594a714f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:48.647013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d205-baf5-4674-a909-287594a714f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:48.723940 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 876/1754] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:48.723940 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a66d8-7a67-4b3c-969b-c74553a7746c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:48.902346 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a66d8-7a67-4b3c-969b-c74553a7746c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:48.909359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2126a-3954-486b-909e-07a24025d428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:48.911394 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2126a-3954-486b-909e-07a24025d428 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:48.911910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2126a-3954-486b-909e-07a24025d428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:48.912194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2126a-3954-486b-909e-07a24025d428 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:48.913483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2126a-3954-486b-909e-07a24025d428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:48.916734 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2126a-3954-486b-909e-07a24025d428 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:48.942968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573d205-baf5-4674-a909-287594a714f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:48.949784 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573d205-baf5-4674-a909-287594a714f5 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:48.963960 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 877/1755] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:48 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:48.965289 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2126a-3954-486b-909e-07a24025d428 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:48.971151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-92f2126a-3954-486b-909e-07a24025d428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:48.980183 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 879/1756] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:48.983350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d205-baf5-4674-a909-287594a714f5 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:49.003028 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2126a-3954-486b-909e-07a24025d428 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:49.024456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d205-baf5-4674-a909-287594a714f5 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:49.027872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005bfd3-6b6b-43f3-8033-09459b90ccf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:49.028136 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005bfd3-6b6b-43f3-8033-09459b90ccf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:49.028562 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005bfd3-6b6b-43f3-8033-09459b90ccf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:49.028857 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005bfd3-6b6b-43f3-8033-09459b90ccf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:49.051868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c967e-81b3-479b-9744-b3e3c09b0d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:49.065699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c967e-81b3-479b-9744-b3e3c09b0d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:49.065699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c967e-81b3-479b-9744-b3e3c09b0d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:49.065699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c967e-81b3-479b-9744-b3e3c09b0d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:49.067731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c967e-81b3-479b-9744-b3e3c09b0d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:49.079846 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c967e-81b3-479b-9744-b3e3c09b0d00 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:49.089898 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005bfd3-6b6b-43f3-8033-09459b90ccf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:49.103960 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005bfd3-6b6b-43f3-8033-09459b90ccf3 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:49.120689 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 880/1757] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:49.126857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c967e-81b3-479b-9744-b3e3c09b0d00 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:49.151230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 878/1758] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:49.152016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005bfd3-6b6b-43f3-8033-09459b90ccf3 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:49.179977 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c967e-81b3-479b-9744-b3e3c09b0d00 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:49.204754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc2d97-de8f-439e-8e36-cd218578db8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:49.206151 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc2d97-de8f-439e-8e36-cd218578db8b service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:49.210264 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc2d97-de8f-439e-8e36-cd218578db8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:49.210475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005bfd3-6b6b-43f3-8033-09459b90ccf3 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:49.212254 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc2d97-de8f-439e-8e36-cd218578db8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:49.218694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-30dc2d97-de8f-439e-8e36-cd218578db8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:49.236884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f123138-8d70-423a-84b3-3c1f7ff51a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:49.237793 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f123138-8d70-423a-84b3-3c1f7ff51a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:49.244161 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f123138-8d70-423a-84b3-3c1f7ff51a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:49.246514 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f123138-8d70-423a-84b3-3c1f7ff51a88 admin admin] PATH_INFO: `/v3/projects/b6c81eb635704c439ad0633bb9679fd1/users/7d53021f33754461b04b6a0755d239b6/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:49.324218 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f123138-8d70-423a-84b3-3c1f7ff51a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c81eb635704c439ad0633bb9679fd1, user_id=7d53021f33754461b04b6a0755d239b6, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:49.333590 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f123138-8d70-423a-84b3-3c1f7ff51a88 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:49.389461 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 879/1759] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:49 2022] PUT /identity/v3/projects/b6c81eb635704c439ad0633bb9679fd1/users/7d53021f33754461b04b6a0755d239b6/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:49.393320 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f123138-8d70-423a-84b3-3c1f7ff51a88 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:49.468032 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:49.503449 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc2d97-de8f-439e-8e36-cd218578db8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:49.507586 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc2d97-de8f-439e-8e36-cd218578db8b service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:49.577052 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f123138-8d70-423a-84b3-3c1f7ff51a88 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:49.582819 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f014e-6fd4-422e-887b-a44faccdd35c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:49.583488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f014e-6fd4-422e-887b-a44faccdd35c service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:49.583769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f014e-6fd4-422e-887b-a44faccdd35c service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:49.584046 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f014e-6fd4-422e-887b-a44faccdd35c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:49.589438 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ca3f014e-6fd4-422e-887b-a44faccdd35c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:49.595488 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 881/1760] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:49.596784 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc2d97-de8f-439e-8e36-cd218578db8b service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:49.649277 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc2d97-de8f-439e-8e36-cd218578db8b service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:49.760656 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f014e-6fd4-422e-887b-a44faccdd35c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:49.762766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f014e-6fd4-422e-887b-a44faccdd35c service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:49.782492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:49.790702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 880/1761] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:49.848782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d564b2f-c3fd-4b1a-8c1f-5e791159268c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:49.849534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d564b2f-c3fd-4b1a-8c1f-5e791159268c admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:49.849906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d564b2f-c3fd-4b1a-8c1f-5e791159268c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:49.850440 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d564b2f-c3fd-4b1a-8c1f-5e791159268c admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:49.852959 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d564b2f-c3fd-4b1a-8c1f-5e791159268c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:49.863390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d564b2f-c3fd-4b1a-8c1f-5e791159268c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:49.917576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f014e-6fd4-422e-887b-a44faccdd35c service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:49.917994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 882/1762] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:49.936593 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f014e-6fd4-422e-887b-a44faccdd35c service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:49.957836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7c2dd-dcdc-44c7-a986-fd8f399f52dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:49.957836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7c2dd-dcdc-44c7-a986-fd8f399f52dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:49.961474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7c2dd-dcdc-44c7-a986-fd8f399f52dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:49.962656 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7c2dd-dcdc-44c7-a986-fd8f399f52dd admin admin] PATH_INFO: `/v3/projects/b6c81eb635704c439ad0633bb9679fd1/users/7d53021f33754461b04b6a0755d239b6/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:49.982488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7c2dd-dcdc-44c7-a986-fd8f399f52dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c81eb635704c439ad0633bb9679fd1, user_id=7d53021f33754461b04b6a0755d239b6, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:49.992833 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7c2dd-dcdc-44c7-a986-fd8f399f52dd admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:50.036085 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 881/1763] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:49 2022] PUT /identity/v3/projects/b6c81eb635704c439ad0633bb9679fd1/users/7d53021f33754461b04b6a0755d239b6/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:01:50.053533 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5cb48-5386-4442-91b2-e3ca977f09ad None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:50.055412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5cb48-5386-4442-91b2-e3ca977f09ad None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:50.056163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5cb48-5386-4442-91b2-e3ca977f09ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:50.173500 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-7ee5cb48-5386-4442-91b2-e3ca977f09ad None None] MFA Rules not processed for user `7d53021f33754461b04b6a0755d239b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:50.182875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7ee5cb48-5386-4442-91b2-e3ca977f09ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:50.256536 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9aad8-e3ac-424e-90b1-bae7ae4665b9 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:50.256863 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9aad8-e3ac-424e-90b1-bae7ae4665b9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:50.257221 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9aad8-e3ac-424e-90b1-bae7ae4665b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:50.315004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-9ad9aad8-e3ac-424e-90b1-bae7ae4665b9 None None] MFA Rules not processed for user `4ba5f51282f548cbbcf0dcaf8fbb4cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:50.319077 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9ad9aad8-e3ac-424e-90b1-bae7ae4665b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:50.477776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 883/1764] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:50.481636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5cb48-5386-4442-91b2-e3ca977f09ad None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:50.486168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7ee5cb48-5386-4442-91b2-e3ca977f09ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:50.514002 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 882/1765] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:50.524882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9aad8-e3ac-424e-90b1-bae7ae4665b9 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:50.615588 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:50.622324 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9aad8-e3ac-424e-90b1-bae7ae4665b9 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:50.635635 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18174b6f-cbc8-4f5c-ad1c-bb2ac3f43465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:50.635993 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18174b6f-cbc8-4f5c-ad1c-bb2ac3f43465 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:50.636278 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18174b6f-cbc8-4f5c-ad1c-bb2ac3f43465 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:50.636550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18174b6f-cbc8-4f5c-ad1c-bb2ac3f43465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:50.651169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5cb48-5386-4442-91b2-e3ca977f09ad None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:50.653450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18174b6f-cbc8-4f5c-ad1c-bb2ac3f43465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:50.655322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18174b6f-cbc8-4f5c-ad1c-bb2ac3f43465 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:50.669362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92562c3-363b-4b36-aec6-8a8f6f141e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:50.670284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92562c3-363b-4b36-aec6-8a8f6f141e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:50.670566 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92562c3-363b-4b36-aec6-8a8f6f141e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:50.670836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92562c3-363b-4b36-aec6-8a8f6f141e2c admin admin] PATH_INFO: `/v3/projects/79a777e6294e4ce09bb4f022e9615619` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:50.673551 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92562c3-363b-4b36-aec6-8a8f6f141e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a777e6294e4ce09bb4f022e9615619)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:50.678695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92562c3-363b-4b36-aec6-8a8f6f141e2c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:50.682334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 883/1766] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:50.683770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359af77-64e8-43fc-a190-7c53ec3146d2 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:50.684065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359af77-64e8-43fc-a190-7c53ec3146d2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:50.684337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359af77-64e8-43fc-a190-7c53ec3146d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:50.728664 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f359af77-64e8-43fc-a190-7c53ec3146d2 None None] MFA Rules not processed for user `4ba5f51282f548cbbcf0dcaf8fbb4cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:50.729885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f359af77-64e8-43fc-a190-7c53ec3146d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:50.742156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 884/1767] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:50.751289 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359af77-64e8-43fc-a190-7c53ec3146d2 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:50.752534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f359af77-64e8-43fc-a190-7c53ec3146d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:50.821454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f92562c3-363b-4b36-aec6-8a8f6f141e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a777e6294e4ce09bb4f022e9615619', 'request_id': 'req-f92562c3-363b-4b36-aec6-8a8f6f141e2c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:50.839498 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f92562c3-363b-4b36-aec6-8a8f6f141e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a777e6294e4ce09bb4f022e9615619', 'request_id': 'req-f92562c3-363b-4b36-aec6-8a8f6f141e2c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:50.840867 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:50.847618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f92562c3-363b-4b36-aec6-8a8f6f141e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a777e6294e4ce09bb4f022e9615619', 'request_id': 'req-f92562c3-363b-4b36-aec6-8a8f6f141e2c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:50.881337 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f92562c3-363b-4b36-aec6-8a8f6f141e2c admin admin] The token cache is being invalidate because project 79a777e6294e4ce09bb4f022e9615619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:01:50.881733 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f92562c3-363b-4b36-aec6-8a8f6f141e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:50.882490 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f92562c3-363b-4b36-aec6-8a8f6f141e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:50.884165 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 884/1768] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:01:50 2022] DELETE /identity/v3/projects/79a777e6294e4ce09bb4f022e9615619 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:50.889223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef783a-9c47-4631-9a4f-540c5146030a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:50.889575 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef783a-9c47-4631-9a4f-540c5146030a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:50.889780 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef783a-9c47-4631-9a4f-540c5146030a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:50.947603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359af77-64e8-43fc-a190-7c53ec3146d2 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:50.953952 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ebef783a-9c47-4631-9a4f-540c5146030a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:50.955094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ebef783a-9c47-4631-9a4f-540c5146030a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:51.094914 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 885/1769] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:01:51.096430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d685e38-6c90-49ea-9f0a-e14cacb73fa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:51.097155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d685e38-6c90-49ea-9f0a-e14cacb73fa5 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:51.097478 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d685e38-6c90-49ea-9f0a-e14cacb73fa5 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:51.098088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d685e38-6c90-49ea-9f0a-e14cacb73fa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:51.100779 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7d685e38-6c90-49ea-9f0a-e14cacb73fa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:51.103401 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0e03-27dc-4743-aa7e-e4bcaac9af4b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:51.103673 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0e03-27dc-4743-aa7e-e4bcaac9af4b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:51.103963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0e03-27dc-4743-aa7e-e4bcaac9af4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:51.135525 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-874d0e03-27dc-4743-aa7e-e4bcaac9af4b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:51.136744 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-874d0e03-27dc-4743-aa7e-e4bcaac9af4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:51.168975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 886/1770] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:51.172781 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d0e03-27dc-4743-aa7e-e4bcaac9af4b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:51.186942 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d0e03-27dc-4743-aa7e-e4bcaac9af4b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:51.198794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5a594-81db-41ac-9b41-40811fc0c057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:51.199472 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5a594-81db-41ac-9b41-40811fc0c057 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:51.199749 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5a594-81db-41ac-9b41-40811fc0c057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:51.200018 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5a594-81db-41ac-9b41-40811fc0c057 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:51.200753 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5a594-81db-41ac-9b41-40811fc0c057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:01:51.201057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5a594-81db-41ac-9b41-40811fc0c057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:51.202706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5a594-81db-41ac-9b41-40811fc0c057 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:51.216911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d685e38-6c90-49ea-9f0a-e14cacb73fa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:51.219267 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d685e38-6c90-49ea-9f0a-e14cacb73fa5 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:51.236932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 887/1771] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:01:51.242929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5a594-81db-41ac-9b41-40811fc0c057 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:51.253872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 885/1772] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:51.263390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5a594-81db-41ac-9b41-40811fc0c057 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:51.280836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c555a5-3ea9-4082-8437-ee0230d71b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:51.281234 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c555a5-3ea9-4082-8437-ee0230d71b13 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:51.281511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c555a5-3ea9-4082-8437-ee0230d71b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:51.281791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c555a5-3ea9-4082-8437-ee0230d71b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:51.282575 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c555a5-3ea9-4082-8437-ee0230d71b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:51.289813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c555a5-3ea9-4082-8437-ee0230d71b13 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:51.352032 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d685e38-6c90-49ea-9f0a-e14cacb73fa5 service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:51.383180 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d685e38-6c90-49ea-9f0a-e14cacb73fa5 service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:51.386441 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 888/1773] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:51 2022] POST /identity/v3/projects => generated 357 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:51.399433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:51.444250 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c555a5-3ea9-4082-8437-ee0230d71b13 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:51.446412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-53c555a5-3ea9-4082-8437-ee0230d71b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:51.516832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5069d43-d4da-4670-b0a2-eaa72a93e17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:51.517520 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069d43-d4da-4670-b0a2-eaa72a93e17f admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:51.517800 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069d43-d4da-4670-b0a2-eaa72a93e17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:51.518097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069d43-d4da-4670-b0a2-eaa72a93e17f admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:51.518790 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5069d43-d4da-4670-b0a2-eaa72a93e17f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:51.520779 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5069d43-d4da-4670-b0a2-eaa72a93e17f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:51.581512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 886/1774] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:51 2022] POST /identity/v3/users => generated 279 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:01:51.585622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5069d43-d4da-4670-b0a2-eaa72a93e17f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:51.610476 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5069d43-d4da-4670-b0a2-eaa72a93e17f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:51.621520 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4d18e-e2dc-4921-9758-6f0afc9e92ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:51.622615 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4d18e-e2dc-4921-9758-6f0afc9e92ea admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:51.623048 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4d18e-e2dc-4921-9758-6f0afc9e92ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:51.623459 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4d18e-e2dc-4921-9758-6f0afc9e92ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:51.624345 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4d18e-e2dc-4921-9758-6f0afc9e92ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:51.630970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4d18e-e2dc-4921-9758-6f0afc9e92ea admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:51.661135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c555a5-3ea9-4082-8437-ee0230d71b13 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:51.665026 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 887/1775] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:51.666382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4d18e-e2dc-4921-9758-6f0afc9e92ea admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:51.688192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82432ab0-7fd9-4dcc-999b-1f86361b8700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:51.689170 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82432ab0-7fd9-4dcc-999b-1f86361b8700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:51.692388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82432ab0-7fd9-4dcc-999b-1f86361b8700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:51.692756 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82432ab0-7fd9-4dcc-999b-1f86361b8700 admin admin] PATH_INFO: `/v3/users/9e4ac938dca34a67b54ad0de268362ca` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:51.696445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82432ab0-7fd9-4dcc-999b-1f86361b8700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e4ac938dca34a67b54ad0de268362ca)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:51.702315 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82432ab0-7fd9-4dcc-999b-1f86361b8700 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:51.705173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4d18e-e2dc-4921-9758-6f0afc9e92ea admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:51.722396 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7216a-ca74-4582-94e5-6e8eac74c6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:51.723655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7216a-ca74-4582-94e5-6e8eac74c6fe admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:51.723942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7216a-ca74-4582-94e5-6e8eac74c6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:51.724214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7216a-ca74-4582-94e5-6e8eac74c6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:51.725190 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7216a-ca74-4582-94e5-6e8eac74c6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:51.735729 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7216a-ca74-4582-94e5-6e8eac74c6fe admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:51.783191 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 888/1776] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:51.790618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7216a-ca74-4582-94e5-6e8eac74c6fe admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:51.812390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-82432ab0-7fd9-4dcc-999b-1f86361b8700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e4ac938dca34a67b54ad0de268362ca'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:51.817152 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:51.819243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7216a-ca74-4582-94e5-6e8eac74c6fe admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:51.835217 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1413c45-8f99-466f-9544-b6fe15512279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:51.836493 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-82432ab0-7fd9-4dcc-999b-1f86361b8700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e4ac938dca34a67b54ad0de268362ca'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:51.837808 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1413c45-8f99-466f-9544-b6fe15512279 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:51.838531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-82432ab0-7fd9-4dcc-999b-1f86361b8700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e4ac938dca34a67b54ad0de268362ca'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:51.839104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1413c45-8f99-466f-9544-b6fe15512279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:51.840486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1413c45-8f99-466f-9544-b6fe15512279 admin admin] PATH_INFO: `/v3/projects/77522851741e42438399da55d8b86a0d/users/e8a39672839340a382c0df424625865d/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:51.858998 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-82432ab0-7fd9-4dcc-999b-1f86361b8700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e4ac938dca34a67b54ad0de268362ca'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:51.861735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-82432ab0-7fd9-4dcc-999b-1f86361b8700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e4ac938dca34a67b54ad0de268362ca'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:51.888907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1413c45-8f99-466f-9544-b6fe15512279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77522851741e42438399da55d8b86a0d, user_id=e8a39672839340a382c0df424625865d, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:51.893867 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1413c45-8f99-466f-9544-b6fe15512279 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:51.908964 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 889/1777] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:01:51 2022] DELETE /identity/v3/users/9e4ac938dca34a67b54ad0de268362ca => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:51.911504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741f749-8082-42af-9a35-45c8caa80162 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:51.915986 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741f749-8082-42af-9a35-45c8caa80162 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:51.924201 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741f749-8082-42af-9a35-45c8caa80162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:51.935362 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 889/1778] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:51 2022] PUT /identity/v3/projects/77522851741e42438399da55d8b86a0d/users/e8a39672839340a382c0df424625865d/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:51.939135 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868b1c2-76e7-4a28-a3d0-b901f3a147ed None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:51.940071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868b1c2-76e7-4a28-a3d0-b901f3a147ed None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:51.940329 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868b1c2-76e7-4a28-a3d0-b901f3a147ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:51.976841 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8741f749-8082-42af-9a35-45c8caa80162 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:51.979334 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8741f749-8082-42af-9a35-45c8caa80162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:52.005631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0868b1c2-76e7-4a28-a3d0-b901f3a147ed None None] MFA Rules not processed for user `e8a39672839340a382c0df424625865d`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:52.006890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0868b1c2-76e7-4a28-a3d0-b901f3a147ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:52.199167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 890/1779] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:52.245579 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741f749-8082-42af-9a35-45c8caa80162 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:52.247840 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8741f749-8082-42af-9a35-45c8caa80162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:52.260091 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 890/1780] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:51 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:52.261491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868b1c2-76e7-4a28-a3d0-b901f3a147ed None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:52.265557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0868b1c2-76e7-4a28-a3d0-b901f3a147ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:52.310326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868b1c2-76e7-4a28-a3d0-b901f3a147ed None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:52.325823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec433448-9d77-4e43-866e-c4eb0d17a161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:52.330608 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec433448-9d77-4e43-866e-c4eb0d17a161 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:52.330608 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec433448-9d77-4e43-866e-c4eb0d17a161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:52.330608 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec433448-9d77-4e43-866e-c4eb0d17a161 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:52.332841 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec433448-9d77-4e43-866e-c4eb0d17a161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:52.341904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec433448-9d77-4e43-866e-c4eb0d17a161 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:52.429573 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 891/1781] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:52 2022] POST /identity/v3/projects => generated 355 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:52.430963 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec433448-9d77-4e43-866e-c4eb0d17a161 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:52.445729 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741f749-8082-42af-9a35-45c8caa80162 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:52.548361 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:52.581899 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd98be-59b6-4375-9d82-d726c87533f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:52.582666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd98be-59b6-4375-9d82-d726c87533f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:52.582869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd98be-59b6-4375-9d82-d726c87533f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:52.583229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd98be-59b6-4375-9d82-d726c87533f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:52.657568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec433448-9d77-4e43-866e-c4eb0d17a161 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:52.669832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc74428-1351-4ddc-81b7-f89ff01ce83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:52.670645 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc74428-1351-4ddc-81b7-f89ff01ce83b admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:52.671373 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc74428-1351-4ddc-81b7-f89ff01ce83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:52.672246 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc74428-1351-4ddc-81b7-f89ff01ce83b admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:52.673292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc74428-1351-4ddc-81b7-f89ff01ce83b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:52.677701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc74428-1351-4ddc-81b7-f89ff01ce83b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:52.687091 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:52.736711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 892/1782] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:52 2022] POST /identity/v3/users => generated 284 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:52.737772 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc74428-1351-4ddc-81b7-f89ff01ce83b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:52.769092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc74428-1351-4ddc-81b7-f89ff01ce83b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:52.778863 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf703c-238f-47d3-b1f3-9d94cbd76897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:52.780053 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf703c-238f-47d3-b1f3-9d94cbd76897 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:52.780729 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf703c-238f-47d3-b1f3-9d94cbd76897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:52.780908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf703c-238f-47d3-b1f3-9d94cbd76897 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:52.781855 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf703c-238f-47d3-b1f3-9d94cbd76897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:52.784409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf703c-238f-47d3-b1f3-9d94cbd76897 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:52.806836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 893/1783] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:52.808009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf703c-238f-47d3-b1f3-9d94cbd76897 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:52.825365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf703c-238f-47d3-b1f3-9d94cbd76897 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:52.837049 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68811f-9ff9-4515-b4c1-4afaff4b2e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:52.838360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68811f-9ff9-4515-b4c1-4afaff4b2e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:52.838756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68811f-9ff9-4515-b4c1-4afaff4b2e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:52.839041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68811f-9ff9-4515-b4c1-4afaff4b2e80 admin admin] PATH_INFO: `/v3/projects/10e3c5bc738a417eb9fd09cf64712d50/users/cefa9bfe61af4abaac05a5c9755555ae/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:52.841966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd98be-59b6-4375-9d82-d726c87533f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:52.845774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd98be-59b6-4375-9d82-d726c87533f0 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:52.860153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 891/1784] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:01:52.916027 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68811f-9ff9-4515-b4c1-4afaff4b2e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e3c5bc738a417eb9fd09cf64712d50, user_id=cefa9bfe61af4abaac05a5c9755555ae, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:52.920850 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68811f-9ff9-4515-b4c1-4afaff4b2e80 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:53.034142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 894/1785] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:52 2022] PUT /identity/v3/projects/10e3c5bc738a417eb9fd09cf64712d50/users/cefa9bfe61af4abaac05a5c9755555ae/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:53.040830 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd98be-59b6-4375-9d82-d726c87533f0 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:53.089059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd98be-59b6-4375-9d82-d726c87533f0 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:53.183551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f9318-3c0c-4d15-a627-4fb7c8384111 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:53.183884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f9318-3c0c-4d15-a627-4fb7c8384111 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:53.184140 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f9318-3c0c-4d15-a627-4fb7c8384111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:53.219235 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1d8f9318-3c0c-4d15-a627-4fb7c8384111 None None] MFA Rules not processed for user `08868c65e4824034a998df7398daac9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:53.221751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1d8f9318-3c0c-4d15-a627-4fb7c8384111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:53.257744 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe280f15-b6df-4526-a113-0d7578fab43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:53.258466 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe280f15-b6df-4526-a113-0d7578fab43c admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:53.258753 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe280f15-b6df-4526-a113-0d7578fab43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:53.259029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe280f15-b6df-4526-a113-0d7578fab43c admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:53.259761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe280f15-b6df-4526-a113-0d7578fab43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:53.261744 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe280f15-b6df-4526-a113-0d7578fab43c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:53.291196 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 892/1786] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:53.297840 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe280f15-b6df-4526-a113-0d7578fab43c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:53.316252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe280f15-b6df-4526-a113-0d7578fab43c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:53.321633 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a0b37-36ec-4500-b2e8-dd9a55bf159d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:53.324868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0b37-36ec-4500-b2e8-dd9a55bf159d admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:53.325849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0b37-36ec-4500-b2e8-dd9a55bf159d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:53.326371 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0b37-36ec-4500-b2e8-dd9a55bf159d admin admin] PATH_INFO: `/v3/projects/10e3c5bc738a417eb9fd09cf64712d50/users/cefa9bfe61af4abaac05a5c9755555ae/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:53.329195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a0b37-36ec-4500-b2e8-dd9a55bf159d admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e3c5bc738a417eb9fd09cf64712d50, user_id=cefa9bfe61af4abaac05a5c9755555ae, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:53.332951 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a0b37-36ec-4500-b2e8-dd9a55bf159d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:53.345779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 893/1787] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:53 2022] PUT /identity/v3/projects/10e3c5bc738a417eb9fd09cf64712d50/users/cefa9bfe61af4abaac05a5c9755555ae/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:53.366040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec69ac-8710-4311-afb7-ff45df2498a1 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:53.366040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec69ac-8710-4311-afb7-ff45df2498a1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:53.366040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec69ac-8710-4311-afb7-ff45df2498a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:53.399334 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0dec69ac-8710-4311-afb7-ff45df2498a1 None None] MFA Rules not processed for user `cefa9bfe61af4abaac05a5c9755555ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:53.399637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 895/1788] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:53.400565 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0dec69ac-8710-4311-afb7-ff45df2498a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:53.401129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41f58d-a17f-4b65-b274-8182d7a0b883 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:53.401424 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41f58d-a17f-4b65-b274-8182d7a0b883 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:53.401705 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41f58d-a17f-4b65-b274-8182d7a0b883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:53.450893 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5f41f58d-a17f-4b65-b274-8182d7a0b883 None None] MFA Rules not processed for user `4ba5f51282f548cbbcf0dcaf8fbb4cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:53.452134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5f41f58d-a17f-4b65-b274-8182d7a0b883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:53.568674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 894/1789] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:53 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:53.582736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec69ac-8710-4311-afb7-ff45df2498a1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:53.584175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0dec69ac-8710-4311-afb7-ff45df2498a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:53.649260 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 896/1790] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:53.705740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:53.764561 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec69ac-8710-4311-afb7-ff45df2498a1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:53.812627 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7a8eb-968b-40de-b729-85ddaf7061e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:53.813308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7a8eb-968b-40de-b729-85ddaf7061e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:53.814746 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7a8eb-968b-40de-b729-85ddaf7061e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:53.815026 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7a8eb-968b-40de-b729-85ddaf7061e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:53.830674 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a67ab-89e7-4ef0-8fcf-4f4a4e3b0d39 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:53.831019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a67ab-89e7-4ef0-8fcf-4f4a4e3b0d39 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:53.831299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a67ab-89e7-4ef0-8fcf-4f4a4e3b0d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:53.864315 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7a8eb-968b-40de-b729-85ddaf7061e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:53.874578 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7a8eb-968b-40de-b729-85ddaf7061e8 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:53.880002 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-dc5a67ab-89e7-4ef0-8fcf-4f4a4e3b0d39 None None] MFA Rules not processed for user `bd1a33ca9f5144c69a66affd662bb9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:53.881697 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-dc5a67ab-89e7-4ef0-8fcf-4f4a4e3b0d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:53.910849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 895/1791] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:53 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:01:53.911757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7a8eb-968b-40de-b729-85ddaf7061e8 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:53.915397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-63e7a8eb-968b-40de-b729-85ddaf7061e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:53.948595 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:53.997897 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 897/1792] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:01:54.107388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7a8eb-968b-40de-b729-85ddaf7061e8 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:54.111046 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a67ab-89e7-4ef0-8fcf-4f4a4e3b0d39 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:54.113178 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-dc5a67ab-89e7-4ef0-8fcf-4f4a4e3b0d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:54.118823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315e539-ccaf-4e8c-a013-3654be11c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:54.119701 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315e539-ccaf-4e8c-a013-3654be11c341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:54.119980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315e539-ccaf-4e8c-a013-3654be11c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:54.120252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315e539-ccaf-4e8c-a013-3654be11c341 admin admin] PATH_INFO: `/v3/projects/65fea48763544e6a999de8fff2b702c7` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:54.121438 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315e539-ccaf-4e8c-a013-3654be11c341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65fea48763544e6a999de8fff2b702c7)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:54.123367 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315e539-ccaf-4e8c-a013-3654be11c341 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:54.130857 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a67ab-89e7-4ef0-8fcf-4f4a4e3b0d39 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:54.136394 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7957df-7d2f-418c-8d75-6918c4e3cdc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:54.137377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7957df-7d2f-418c-8d75-6918c4e3cdc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:54.137919 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7957df-7d2f-418c-8d75-6918c4e3cdc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:54.138442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7957df-7d2f-418c-8d75-6918c4e3cdc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:54.236462 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d315e539-ccaf-4e8c-a013-3654be11c341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65fea48763544e6a999de8fff2b702c7', 'request_id': 'req-d315e539-ccaf-4e8c-a013-3654be11c341'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:54.252381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d315e539-ccaf-4e8c-a013-3654be11c341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65fea48763544e6a999de8fff2b702c7', 'request_id': 'req-d315e539-ccaf-4e8c-a013-3654be11c341'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:54.268479 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d315e539-ccaf-4e8c-a013-3654be11c341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65fea48763544e6a999de8fff2b702c7', 'request_id': 'req-d315e539-ccaf-4e8c-a013-3654be11c341'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:54.275327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7957df-7d2f-418c-8d75-6918c4e3cdc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:54.279509 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7957df-7d2f-418c-8d75-6918c4e3cdc8 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:54.297733 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d315e539-ccaf-4e8c-a013-3654be11c341 admin admin] The token cache is being invalidate because project 65fea48763544e6a999de8fff2b702c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:01:54.298205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d315e539-ccaf-4e8c-a013-3654be11c341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:54.306985 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d315e539-ccaf-4e8c-a013-3654be11c341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:54.311866 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 896/1793] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:01:53 2022] DELETE /identity/v3/projects/65fea48763544e6a999de8fff2b702c7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:54.312677 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315e539-ccaf-4e8c-a013-3654be11c341 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:54.314175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d315e539-ccaf-4e8c-a013-3654be11c341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:54.316268 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 898/1794] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:54 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:01:54.321394 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7957df-7d2f-418c-8d75-6918c4e3cdc8 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:54.360077 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7957df-7d2f-418c-8d75-6918c4e3cdc8 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:54.422394 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315e539-ccaf-4e8c-a013-3654be11c341 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:54.428896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa9682-7fd1-47bc-bb7e-d148ec2b2969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:54.430154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa9682-7fd1-47bc-bb7e-d148ec2b2969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:54.430571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa9682-7fd1-47bc-bb7e-d148ec2b2969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:54.430964 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa9682-7fd1-47bc-bb7e-d148ec2b2969 admin admin] PATH_INFO: `/v3/users/11e3aeb509dd49b29b1ff4d2199fa767` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:54.432213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa9682-7fd1-47bc-bb7e-d148ec2b2969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e3aeb509dd49b29b1ff4d2199fa767)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:54.435053 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa9682-7fd1-47bc-bb7e-d148ec2b2969 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:54.454845 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:54.524840 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93c9fc-749c-427d-b52e-53cba2b7a62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:54.526225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93c9fc-749c-427d-b52e-53cba2b7a62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:54.526710 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93c9fc-749c-427d-b52e-53cba2b7a62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:54.531539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-26fa9682-7fd1-47bc-bb7e-d148ec2b2969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e3aeb509dd49b29b1ff4d2199fa767'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:54.531801 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93c9fc-749c-427d-b52e-53cba2b7a62f admin admin] PATH_INFO: `/v3/users/7d53021f33754461b04b6a0755d239b6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:54.539765 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93c9fc-749c-427d-b52e-53cba2b7a62f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d53021f33754461b04b6a0755d239b6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:54.546752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93c9fc-749c-427d-b52e-53cba2b7a62f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:54.554541 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-26fa9682-7fd1-47bc-bb7e-d148ec2b2969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e3aeb509dd49b29b1ff4d2199fa767'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:54.556829 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-26fa9682-7fd1-47bc-bb7e-d148ec2b2969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e3aeb509dd49b29b1ff4d2199fa767'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:54.574517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-26fa9682-7fd1-47bc-bb7e-d148ec2b2969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e3aeb509dd49b29b1ff4d2199fa767'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:54.576574 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-26fa9682-7fd1-47bc-bb7e-d148ec2b2969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e3aeb509dd49b29b1ff4d2199fa767'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:54.646254 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 897/1795] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:01:54 2022] DELETE /identity/v3/users/11e3aeb509dd49b29b1ff4d2199fa767 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:54.647999 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c18ff6-f8f5-4316-9108-2254aa05ac5b None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:54.651006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c18ff6-f8f5-4316-9108-2254aa05ac5b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:54.652805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c18ff6-f8f5-4316-9108-2254aa05ac5b None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:54.654808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 898/1796] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jun 7 22:01:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 22:01:54.655945 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3df992-8b0a-4d33-b1e9-c8ed68d383b9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:54.656589 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3df992-8b0a-4d33-b1e9-c8ed68d383b9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:54.660786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3df992-8b0a-4d33-b1e9-c8ed68d383b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:54.710334 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0d3df992-8b0a-4d33-b1e9-c8ed68d383b9 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:54.718632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0d3df992-8b0a-4d33-b1e9-c8ed68d383b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:54.769514 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7a93c9fc-749c-427d-b52e-53cba2b7a62f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d53021f33754461b04b6a0755d239b6'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:54.802203 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7a93c9fc-749c-427d-b52e-53cba2b7a62f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d53021f33754461b04b6a0755d239b6'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:54.827529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7a93c9fc-749c-427d-b52e-53cba2b7a62f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d53021f33754461b04b6a0755d239b6'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:54.830571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7a93c9fc-749c-427d-b52e-53cba2b7a62f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d53021f33754461b04b6a0755d239b6'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:54.831319 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7a93c9fc-749c-427d-b52e-53cba2b7a62f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d53021f33754461b04b6a0755d239b6'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:54.839212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 899/1797] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:54.840819 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781f8d9-7296-4310-8f3e-fb89ee42f0c4 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:54.843593 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781f8d9-7296-4310-8f3e-fb89ee42f0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:54.843890 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781f8d9-7296-4310-8f3e-fb89ee42f0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:54.883311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:54.883507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3781f8d9-7296-4310-8f3e-fb89ee42f0c4 None None] MFA Rules not processed for user `aab50bc9064e444184afb1b4c585ce39`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:54.885762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3781f8d9-7296-4310-8f3e-fb89ee42f0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:54.900633 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 899/1798] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:01:54 2022] DELETE /identity/v3/users/7d53021f33754461b04b6a0755d239b6 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:54.935509 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93c9fc-749c-427d-b52e-53cba2b7a62f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:54.944878 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7a93c9fc-749c-427d-b52e-53cba2b7a62f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:54.977771 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 900/1799] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 7 22:01:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:55.075197 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781f8d9-7296-4310-8f3e-fb89ee42f0c4 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:55.077373 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3781f8d9-7296-4310-8f3e-fb89ee42f0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:55.094052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781f8d9-7296-4310-8f3e-fb89ee42f0c4 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:55.209353 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93c9fc-749c-427d-b52e-53cba2b7a62f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:55.214569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:55.219460 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313d138-9ba8-48a0-8098-4788c0f11e04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:55.220166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313d138-9ba8-48a0-8098-4788c0f11e04 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:55.220418 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313d138-9ba8-48a0-8098-4788c0f11e04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:55.220760 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313d138-9ba8-48a0-8098-4788c0f11e04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:55.241732 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6aaeaf-c42d-4560-a5e7-0d6f3802f9f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:55.242696 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aaeaf-c42d-4560-a5e7-0d6f3802f9f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:55.243188 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aaeaf-c42d-4560-a5e7-0d6f3802f9f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:55.243757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aaeaf-c42d-4560-a5e7-0d6f3802f9f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:55.256956 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6aaeaf-c42d-4560-a5e7-0d6f3802f9f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:55.258549 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6aaeaf-c42d-4560-a5e7-0d6f3802f9f3 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:55.270210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 901/1800] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:55.355180 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6aaeaf-c42d-4560-a5e7-0d6f3802f9f3 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:55.357310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fd6aaeaf-c42d-4560-a5e7-0d6f3802f9f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:55.389496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313d138-9ba8-48a0-8098-4788c0f11e04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:55.392768 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313d138-9ba8-48a0-8098-4788c0f11e04 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:55.446258 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 900/1801] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:01:55.540965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6aaeaf-c42d-4560-a5e7-0d6f3802f9f3 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:55.547084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08c236-3fdc-4241-ad6f-7463d7ffb4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:55.548243 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08c236-3fdc-4241-ad6f-7463d7ffb4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:55.548728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08c236-3fdc-4241-ad6f-7463d7ffb4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:55.549207 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08c236-3fdc-4241-ad6f-7463d7ffb4a2 admin admin] PATH_INFO: `/v3/users/b0c9d706323941ee9ab0909d1ddd93d6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:55.551248 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08c236-3fdc-4241-ad6f-7463d7ffb4a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0c9d706323941ee9ab0909d1ddd93d6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:55.553800 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08c236-3fdc-4241-ad6f-7463d7ffb4a2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:55.659623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-bc08c236-3fdc-4241-ad6f-7463d7ffb4a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0c9d706323941ee9ab0909d1ddd93d6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:55.670545 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-bc08c236-3fdc-4241-ad6f-7463d7ffb4a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0c9d706323941ee9ab0909d1ddd93d6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:55.671687 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-bc08c236-3fdc-4241-ad6f-7463d7ffb4a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0c9d706323941ee9ab0909d1ddd93d6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:55.694638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-bc08c236-3fdc-4241-ad6f-7463d7ffb4a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0c9d706323941ee9ab0909d1ddd93d6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:55.695419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-bc08c236-3fdc-4241-ad6f-7463d7ffb4a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0c9d706323941ee9ab0909d1ddd93d6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:55.724455 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 902/1802] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:01:55 2022] DELETE /identity/v3/users/b0c9d706323941ee9ab0909d1ddd93d6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:55.728256 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923c7ee-9a7d-4daa-bf45-c9cf89fb7473 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:55.728485 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923c7ee-9a7d-4daa-bf45-c9cf89fb7473 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:55.728830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923c7ee-9a7d-4daa-bf45-c9cf89fb7473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:55.763759 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4923c7ee-9a7d-4daa-bf45-c9cf89fb7473 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:55.766483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4923c7ee-9a7d-4daa-bf45-c9cf89fb7473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:55.886966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08c236-3fdc-4241-ad6f-7463d7ffb4a2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:55.889221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-bc08c236-3fdc-4241-ad6f-7463d7ffb4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:55.928456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 901/1803] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:55.941355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923c7ee-9a7d-4daa-bf45-c9cf89fb7473 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:55.949027 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4923c7ee-9a7d-4daa-bf45-c9cf89fb7473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:56.114960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08c236-3fdc-4241-ad6f-7463d7ffb4a2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:56.161306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34255e-a8e7-415a-8d55-28ea59c2cd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:56.162527 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34255e-a8e7-415a-8d55-28ea59c2cd38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:56.163219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34255e-a8e7-415a-8d55-28ea59c2cd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:56.163631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34255e-a8e7-415a-8d55-28ea59c2cd38 admin admin] PATH_INFO: `/v3/projects/b6c81eb635704c439ad0633bb9679fd1` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:56.175456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34255e-a8e7-415a-8d55-28ea59c2cd38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c81eb635704c439ad0633bb9679fd1)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:56.186375 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:56.187807 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34255e-a8e7-415a-8d55-28ea59c2cd38 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:56.210279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923c7ee-9a7d-4daa-bf45-c9cf89fb7473 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:56.218947 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:56.227455 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39b659-677d-4273-801c-f7ff6a3711df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:56.228143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b659-677d-4273-801c-f7ff6a3711df service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:56.233392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b659-677d-4273-801c-f7ff6a3711df service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:56.234896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b659-677d-4273-801c-f7ff6a3711df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:56.279419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39b659-677d-4273-801c-f7ff6a3711df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:56.280895 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39b659-677d-4273-801c-f7ff6a3711df service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:56.327412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 902/1804] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:01:56.341813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1a34255e-a8e7-415a-8d55-28ea59c2cd38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c81eb635704c439ad0633bb9679fd1', 'request_id': 'req-1a34255e-a8e7-415a-8d55-28ea59c2cd38'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:56.377701 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1a34255e-a8e7-415a-8d55-28ea59c2cd38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c81eb635704c439ad0633bb9679fd1', 'request_id': 'req-1a34255e-a8e7-415a-8d55-28ea59c2cd38'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:56.396965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1a34255e-a8e7-415a-8d55-28ea59c2cd38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c81eb635704c439ad0633bb9679fd1', 'request_id': 'req-1a34255e-a8e7-415a-8d55-28ea59c2cd38'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:56.444464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1a34255e-a8e7-415a-8d55-28ea59c2cd38 admin admin] The token cache is being invalidate because project b6c81eb635704c439ad0633bb9679fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:01:56.445666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1a34255e-a8e7-415a-8d55-28ea59c2cd38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:56.448586 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1a34255e-a8e7-415a-8d55-28ea59c2cd38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:56.454277 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 903/1805] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:01:55 2022] DELETE /identity/v3/projects/b6c81eb635704c439ad0633bb9679fd1 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:01:56.456076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d85c1b-cbaf-46ce-b916-e2cf93c75cc8 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:56.456418 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d85c1b-cbaf-46ce-b916-e2cf93c75cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:56.457143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d85c1b-cbaf-46ce-b916-e2cf93c75cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:56.498564 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-34d85c1b-cbaf-46ce-b916-e2cf93c75cc8 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:56.501156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-34d85c1b-cbaf-46ce-b916-e2cf93c75cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:56.637027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e4672-59e0-4c10-8cd2-fedeb6393cd2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:56.639690 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e4672-59e0-4c10-8cd2-fedeb6393cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:56.640090 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e4672-59e0-4c10-8cd2-fedeb6393cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:56.665351 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 903/1806] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:56.712679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-7c0e4672-59e0-4c10-8cd2-fedeb6393cd2 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:56.715686 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7c0e4672-59e0-4c10-8cd2-fedeb6393cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:56.743003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d85c1b-cbaf-46ce-b916-e2cf93c75cc8 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:56.764411 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 904/1807] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:56.766964 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d85c1b-cbaf-46ce-b916-e2cf93c75cc8 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:56.773365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affe978-0977-40fe-808d-efd198cb5769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:56.774080 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affe978-0977-40fe-808d-efd198cb5769 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:56.774643 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affe978-0977-40fe-808d-efd198cb5769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:56.774922 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affe978-0977-40fe-808d-efd198cb5769 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:56.776305 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affe978-0977-40fe-808d-efd198cb5769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:01:56.776605 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affe978-0977-40fe-808d-efd198cb5769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:56.778939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affe978-0977-40fe-808d-efd198cb5769 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:56.818714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 904/1808] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:01:56.826283 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e4672-59e0-4c10-8cd2-fedeb6393cd2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:56.840121 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e4672-59e0-4c10-8cd2-fedeb6393cd2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:56.847241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7046c-45a1-49e3-a92c-879e98f6e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:56.863974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7046c-45a1-49e3-a92c-879e98f6e304 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:56.866292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7046c-45a1-49e3-a92c-879e98f6e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:56.867442 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7046c-45a1-49e3-a92c-879e98f6e304 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:56.872840 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7046c-45a1-49e3-a92c-879e98f6e304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:56.879042 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7046c-45a1-49e3-a92c-879e98f6e304 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:56.961592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 905/1809] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:56 2022] POST /identity/v3/projects => generated 363 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:56.965908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affe978-0977-40fe-808d-efd198cb5769 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:56.976920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affe978-0977-40fe-808d-efd198cb5769 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:57.100801 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7046c-45a1-49e3-a92c-879e98f6e304 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:57.103759 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7de7046c-45a1-49e3-a92c-879e98f6e304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:57.118785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b31bfd-1e6c-47c5-9e1f-960e68089474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:57.119883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b31bfd-1e6c-47c5-9e1f-960e68089474 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:57.120474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b31bfd-1e6c-47c5-9e1f-960e68089474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:57.120884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b31bfd-1e6c-47c5-9e1f-960e68089474 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:57.122587 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b31bfd-1e6c-47c5-9e1f-960e68089474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:57.125025 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b31bfd-1e6c-47c5-9e1f-960e68089474 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:57.178980 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 905/1810] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:56 2022] POST /identity/v3/users => generated 282 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:01:57.185352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b31bfd-1e6c-47c5-9e1f-960e68089474 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:57.198643 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b31bfd-1e6c-47c5-9e1f-960e68089474 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:57.220837 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80350fd9-4d0b-41c0-a027-6309a0926e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:57.223373 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80350fd9-4d0b-41c0-a027-6309a0926e4c admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:57.223655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80350fd9-4d0b-41c0-a027-6309a0926e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:57.223930 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80350fd9-4d0b-41c0-a027-6309a0926e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:57.227314 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80350fd9-4d0b-41c0-a027-6309a0926e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:57.237017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80350fd9-4d0b-41c0-a027-6309a0926e4c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:57.259162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 906/1811] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:57.267092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80350fd9-4d0b-41c0-a027-6309a0926e4c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:57.281906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7046c-45a1-49e3-a92c-879e98f6e304 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:57.285429 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80350fd9-4d0b-41c0-a027-6309a0926e4c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:57.290975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a582b23-02d3-425d-b24f-529872db8448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:57.292269 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a582b23-02d3-425d-b24f-529872db8448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:57.292558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a582b23-02d3-425d-b24f-529872db8448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:57.292831 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a582b23-02d3-425d-b24f-529872db8448 admin admin] PATH_INFO: `/v3/projects/7a9a8b710e9844c0b71282f0ffcba769` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:57.295735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a582b23-02d3-425d-b24f-529872db8448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9a8b710e9844c0b71282f0ffcba769)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:57.298260 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a582b23-02d3-425d-b24f-529872db8448 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:57.301166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4753805-8b09-4fc2-b172-77634c2a5784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:57.301842 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4753805-8b09-4fc2-b172-77634c2a5784 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:57.302170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4753805-8b09-4fc2-b172-77634c2a5784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:57.302440 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4753805-8b09-4fc2-b172-77634c2a5784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:57.303182 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4753805-8b09-4fc2-b172-77634c2a5784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:57.307662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4753805-8b09-4fc2-b172-77634c2a5784 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:57.337621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 907/1812] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:57.339172 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4753805-8b09-4fc2-b172-77634c2a5784 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:57.359337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4753805-8b09-4fc2-b172-77634c2a5784 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:57.375888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c3552-4f34-48c7-a394-d57650d6f059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:57.376755 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c3552-4f34-48c7-a394-d57650d6f059 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:57.377261 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c3552-4f34-48c7-a394-d57650d6f059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:57.377378 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c3552-4f34-48c7-a394-d57650d6f059 admin admin] PATH_INFO: `/v3/projects/3b9157b526164c58a17508e4549a5ced/users/9fd2da9e09934ce582b93f4c83c43b4a/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:57.412240 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1a582b23-02d3-425d-b24f-529872db8448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9a8b710e9844c0b71282f0ffcba769', 'request_id': 'req-1a582b23-02d3-425d-b24f-529872db8448'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:57.416616 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c3552-4f34-48c7-a394-d57650d6f059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9157b526164c58a17508e4549a5ced, user_id=9fd2da9e09934ce582b93f4c83c43b4a, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:57.420053 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c3552-4f34-48c7-a394-d57650d6f059 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:57.427229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1a582b23-02d3-425d-b24f-529872db8448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9a8b710e9844c0b71282f0ffcba769', 'request_id': 'req-1a582b23-02d3-425d-b24f-529872db8448'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:57.435090 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1a582b23-02d3-425d-b24f-529872db8448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9a8b710e9844c0b71282f0ffcba769', 'request_id': 'req-1a582b23-02d3-425d-b24f-529872db8448'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:57.443598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:57.458028 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 908/1813] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:57 2022] PUT /identity/v3/projects/3b9157b526164c58a17508e4549a5ced/users/9fd2da9e09934ce582b93f4c83c43b4a/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:57.469740 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fafe35-2940-4e2a-9b47-980135a4997c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:57.471265 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1a582b23-02d3-425d-b24f-529872db8448 admin admin] The token cache is being invalidate because project 7a9a8b710e9844c0b71282f0ffcba769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:01:57.471556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1a582b23-02d3-425d-b24f-529872db8448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:57.472236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-1a582b23-02d3-425d-b24f-529872db8448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:57.474180 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 906/1814] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:01:57 2022] DELETE /identity/v3/projects/7a9a8b710e9844c0b71282f0ffcba769 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:57.477795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a582b23-02d3-425d-b24f-529872db8448 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:57.479720 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1a582b23-02d3-425d-b24f-529872db8448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:57.481847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fafe35-2940-4e2a-9b47-980135a4997c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:57.482176 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fafe35-2940-4e2a-9b47-980135a4997c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:57.527795 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b1fafe35-2940-4e2a-9b47-980135a4997c None None] MFA Rules not processed for user `9fd2da9e09934ce582b93f4c83c43b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:57.529899 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b1fafe35-2940-4e2a-9b47-980135a4997c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:57.546193 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:57.614485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a582b23-02d3-425d-b24f-529872db8448 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:57.658342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 909/1815] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:57 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:57.662491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fafe35-2940-4e2a-9b47-980135a4997c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:57.664874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b1fafe35-2940-4e2a-9b47-980135a4997c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:57.785349 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fafe35-2940-4e2a-9b47-980135a4997c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:57.806900 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888d7b-b602-4186-b8fd-3664e34cfb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:57.807998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888d7b-b602-4186-b8fd-3664e34cfb4c admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:57.817071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888d7b-b602-4186-b8fd-3664e34cfb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:57.821067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9d288-23b2-464e-a8a7-b7d12d8229af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:57.822020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9d288-23b2-464e-a8a7-b7d12d8229af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:57.822468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9d288-23b2-464e-a8a7-b7d12d8229af admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:57.822547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9d288-23b2-464e-a8a7-b7d12d8229af admin admin] PATH_INFO: `/v3/users/5d6022ecf6764ec8b37d2d2d94f1405f` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:57.826601 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0888d7b-b602-4186-b8fd-3664e34cfb4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:57.828206 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0888d7b-b602-4186-b8fd-3664e34cfb4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:57.829551 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9d288-23b2-464e-a8a7-b7d12d8229af admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6022ecf6764ec8b37d2d2d94f1405f)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:57.830431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0888d7b-b602-4186-b8fd-3664e34cfb4c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:57.831568 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9d288-23b2-464e-a8a7-b7d12d8229af admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:57.867292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 910/1816] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:01:57 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:01:57.872364 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888d7b-b602-4186-b8fd-3664e34cfb4c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:57.916541 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2ba9d288-23b2-464e-a8a7-b7d12d8229af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6022ecf6764ec8b37d2d2d94f1405f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:57.940872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2ba9d288-23b2-464e-a8a7-b7d12d8229af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6022ecf6764ec8b37d2d2d94f1405f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:57.941822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2ba9d288-23b2-464e-a8a7-b7d12d8229af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6022ecf6764ec8b37d2d2d94f1405f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:57.962142 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2ba9d288-23b2-464e-a8a7-b7d12d8229af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6022ecf6764ec8b37d2d2d94f1405f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:57.963067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2ba9d288-23b2-464e-a8a7-b7d12d8229af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6022ecf6764ec8b37d2d2d94f1405f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:57.984756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0888d7b-b602-4186-b8fd-3664e34cfb4c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:57.996683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da18928-5a14-465a-afda-949c47d7b7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:57.997727 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da18928-5a14-465a-afda-949c47d7b7fa admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:57.997727 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da18928-5a14-465a-afda-949c47d7b7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:57.997893 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da18928-5a14-465a-afda-949c47d7b7fa admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:57.998625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da18928-5a14-465a-afda-949c47d7b7fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:58.005888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da18928-5a14-465a-afda-949c47d7b7fa admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:58.020396 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 907/1817] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:01:57 2022] DELETE /identity/v3/users/5d6022ecf6764ec8b37d2d2d94f1405f => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:58.046800 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 911/1818] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:01:57 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:01:58.047963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9d288-23b2-464e-a8a7-b7d12d8229af admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:58.049415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2ba9d288-23b2-464e-a8a7-b7d12d8229af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:58.105677 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:58.189076 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9d288-23b2-464e-a8a7-b7d12d8229af admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:58.198269 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cf105-99bd-4b67-8fcc-9df258433eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:58.198987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cf105-99bd-4b67-8fcc-9df258433eab admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:58.199326 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cf105-99bd-4b67-8fcc-9df258433eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:58.199620 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cf105-99bd-4b67-8fcc-9df258433eab admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:58.200358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cf105-99bd-4b67-8fcc-9df258433eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:58.202005 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cf105-99bd-4b67-8fcc-9df258433eab admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:58.229463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da18928-5a14-465a-afda-949c47d7b7fa admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:58.230334 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 908/1819] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:01:58.243611 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da18928-5a14-465a-afda-949c47d7b7fa admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:58.252271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291b400-8619-4d14-944f-95e78693dfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:58.258222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291b400-8619-4d14-944f-95e78693dfae admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:58.258548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291b400-8619-4d14-944f-95e78693dfae admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:58.258831 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291b400-8619-4d14-944f-95e78693dfae admin admin] PATH_INFO: `/v3/projects/4af96757c6304c0badf0b4a33410981f/users/097719ccc8f2488caa058e94069c130a/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:58.300237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291b400-8619-4d14-944f-95e78693dfae admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af96757c6304c0badf0b4a33410981f, user_id=097719ccc8f2488caa058e94069c130a, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:58.303574 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291b400-8619-4d14-944f-95e78693dfae admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:58.326099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:58.333002 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 912/1820] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:58 2022] PUT /identity/v3/projects/4af96757c6304c0badf0b4a33410981f/users/097719ccc8f2488caa058e94069c130a/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:58.336684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cf105-99bd-4b67-8fcc-9df258433eab admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:58.352035 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cf105-99bd-4b67-8fcc-9df258433eab admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:58.524272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010db16-43ec-4aa9-adfd-3313f07a25bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:58.525184 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010db16-43ec-4aa9-adfd-3313f07a25bc admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:58.525476 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010db16-43ec-4aa9-adfd-3313f07a25bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:58.525815 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010db16-43ec-4aa9-adfd-3313f07a25bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:58.526598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010db16-43ec-4aa9-adfd-3313f07a25bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:58.528218 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010db16-43ec-4aa9-adfd-3313f07a25bc admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:58.549041 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 909/1821] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:01:58.552855 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291b400-8619-4d14-944f-95e78693dfae admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:58.563996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291b400-8619-4d14-944f-95e78693dfae admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:58.576766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612bf3e-fe44-4edc-8919-66199e3d98ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:58.577946 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612bf3e-fe44-4edc-8919-66199e3d98ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:58.578407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612bf3e-fe44-4edc-8919-66199e3d98ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:58.578824 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612bf3e-fe44-4edc-8919-66199e3d98ae admin admin] PATH_INFO: `/v3/projects/4af96757c6304c0badf0b4a33410981f/users/097719ccc8f2488caa058e94069c130a/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:58.588539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612bf3e-fe44-4edc-8919-66199e3d98ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af96757c6304c0badf0b4a33410981f, user_id=097719ccc8f2488caa058e94069c130a, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:58.591492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612bf3e-fe44-4edc-8919-66199e3d98ae admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:58.628942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 913/1822] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:01:58 2022] PUT /identity/v3/projects/4af96757c6304c0badf0b4a33410981f/users/097719ccc8f2488caa058e94069c130a/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:58.632169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71149b95-55e5-45aa-aa66-89c75a717d59 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:58.633367 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71149b95-55e5-45aa-aa66-89c75a717d59 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:58.635002 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71149b95-55e5-45aa-aa66-89c75a717d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:58.707999 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-71149b95-55e5-45aa-aa66-89c75a717d59 None None] MFA Rules not processed for user `097719ccc8f2488caa058e94069c130a`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:58.710105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-71149b95-55e5-45aa-aa66-89c75a717d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:58.869774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 910/1823] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:01:58.890824 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612bf3e-fe44-4edc-8919-66199e3d98ae admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:58.892834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a612bf3e-fe44-4edc-8919-66199e3d98ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:59.050459 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71149b95-55e5-45aa-aa66-89c75a717d59 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:59.052620 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-71149b95-55e5-45aa-aa66-89c75a717d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:59.072942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612bf3e-fe44-4edc-8919-66199e3d98ae admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:59.092316 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f11e21-6518-4d13-9270-f548c756d759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:59.093281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f11e21-6518-4d13-9270-f548c756d759 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:59.093561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f11e21-6518-4d13-9270-f548c756d759 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:59.093831 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f11e21-6518-4d13-9270-f548c756d759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:59.128526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f11e21-6518-4d13-9270-f548c756d759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:59.130115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f11e21-6518-4d13-9270-f548c756d759 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:59.165808 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 914/1824] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:01:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:01:59.183547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:59.209635 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71149b95-55e5-45aa-aa66-89c75a717d59 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:59.215000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec72eb-e6ba-49fe-84ac-ffb8b660b091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:59.215842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec72eb-e6ba-49fe-84ac-ffb8b660b091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:59.216650 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec72eb-e6ba-49fe-84ac-ffb8b660b091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:59.216650 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec72eb-e6ba-49fe-84ac-ffb8b660b091 admin admin] PATH_INFO: `/v3/projects/85b9e7b6edbf42f2999a83e3605c0def` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:59.217656 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec72eb-e6ba-49fe-84ac-ffb8b660b091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b9e7b6edbf42f2999a83e3605c0def)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:59.219624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec72eb-e6ba-49fe-84ac-ffb8b660b091 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:59.318302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-adec72eb-e6ba-49fe-84ac-ffb8b660b091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b9e7b6edbf42f2999a83e3605c0def', 'request_id': 'req-adec72eb-e6ba-49fe-84ac-ffb8b660b091'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:59.341289 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-adec72eb-e6ba-49fe-84ac-ffb8b660b091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b9e7b6edbf42f2999a83e3605c0def', 'request_id': 'req-adec72eb-e6ba-49fe-84ac-ffb8b660b091'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:59.365372 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-adec72eb-e6ba-49fe-84ac-ffb8b660b091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b9e7b6edbf42f2999a83e3605c0def', 'request_id': 'req-adec72eb-e6ba-49fe-84ac-ffb8b660b091'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:59.406689 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-adec72eb-e6ba-49fe-84ac-ffb8b660b091 admin admin] The token cache is being invalidate because project 85b9e7b6edbf42f2999a83e3605c0def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:01:59.407235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-adec72eb-e6ba-49fe-84ac-ffb8b660b091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:59.409963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-adec72eb-e6ba-49fe-84ac-ffb8b660b091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:59.417532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 911/1825] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:01:59 2022] DELETE /identity/v3/projects/85b9e7b6edbf42f2999a83e3605c0def => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:59.421129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f11e21-6518-4d13-9270-f548c756d759 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:59.451365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f11e21-6518-4d13-9270-f548c756d759 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:59.517704 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c89de-718e-4735-ae11-b46ee2b0e6ac None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:59.518080 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c89de-718e-4735-ae11-b46ee2b0e6ac None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:59.518395 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c89de-718e-4735-ae11-b46ee2b0e6ac None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:59.520521 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 912/1826] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 7 22:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 22:01:59.532042 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c89de-718e-4735-ae11-b46ee2b0e6ac None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:01:59.534630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-dc4c89de-718e-4735-ae11-b46ee2b0e6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:59.672415 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee94ff9-0a7a-4c40-a537-b5b9df7edd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:59.673495 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee94ff9-0a7a-4c40-a537-b5b9df7edd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:59.673788 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee94ff9-0a7a-4c40-a537-b5b9df7edd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:59.674070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee94ff9-0a7a-4c40-a537-b5b9df7edd97 admin admin] PATH_INFO: `/v3/users/baa12e9c082641259f0d49b5a2285366` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:59.676991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee94ff9-0a7a-4c40-a537-b5b9df7edd97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baa12e9c082641259f0d49b5a2285366)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:59.686318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee94ff9-0a7a-4c40-a537-b5b9df7edd97 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:59.692969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c89de-718e-4735-ae11-b46ee2b0e6ac None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:01:59.703897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cc5ce-1ff6-4f96-aa24-4fbefc36ed8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:01:59.704943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cc5ce-1ff6-4f96-aa24-4fbefc36ed8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:59.705223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cc5ce-1ff6-4f96-aa24-4fbefc36ed8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:59.705553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cc5ce-1ff6-4f96-aa24-4fbefc36ed8a admin admin] PATH_INFO: `/v3/projects/55bd151f91b44e2dbdcd0876b44eb457` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:59.709885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cc5ce-1ff6-4f96-aa24-4fbefc36ed8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=55bd151f91b44e2dbdcd0876b44eb457)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:01:59.714768 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cc5ce-1ff6-4f96-aa24-4fbefc36ed8a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:01:59.821674 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-eee94ff9-0a7a-4c40-a537-b5b9df7edd97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baa12e9c082641259f0d49b5a2285366'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:59.840388 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-eee94ff9-0a7a-4c40-a537-b5b9df7edd97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baa12e9c082641259f0d49b5a2285366'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:59.844943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7f8cc5ce-1ff6-4f96-aa24-4fbefc36ed8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55bd151f91b44e2dbdcd0876b44eb457', 'request_id': 'req-7f8cc5ce-1ff6-4f96-aa24-4fbefc36ed8a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:59.854163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7f8cc5ce-1ff6-4f96-aa24-4fbefc36ed8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55bd151f91b44e2dbdcd0876b44eb457', 'request_id': 'req-7f8cc5ce-1ff6-4f96-aa24-4fbefc36ed8a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:59.871111 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-eee94ff9-0a7a-4c40-a537-b5b9df7edd97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baa12e9c082641259f0d49b5a2285366'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:59.872304 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-eee94ff9-0a7a-4c40-a537-b5b9df7edd97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baa12e9c082641259f0d49b5a2285366'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:59.873339 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-eee94ff9-0a7a-4c40-a537-b5b9df7edd97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baa12e9c082641259f0d49b5a2285366'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:59.885011 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7f8cc5ce-1ff6-4f96-aa24-4fbefc36ed8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55bd151f91b44e2dbdcd0876b44eb457', 'request_id': 'req-7f8cc5ce-1ff6-4f96-aa24-4fbefc36ed8a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:59.897663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:01:59.904966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7f8cc5ce-1ff6-4f96-aa24-4fbefc36ed8a admin admin] The token cache is being invalidate because project 55bd151f91b44e2dbdcd0876b44eb457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:01:59.906116 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7f8cc5ce-1ff6-4f96-aa24-4fbefc36ed8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:59.907948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7f8cc5ce-1ff6-4f96-aa24-4fbefc36ed8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:01:59.909728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 913/1827] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:01:59 2022] DELETE /identity/v3/projects/55bd151f91b44e2dbdcd0876b44eb457 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:01:59.913963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeefdb3-3e5b-4040-a792-6d15953bd69d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:59.915188 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeefdb3-3e5b-4040-a792-6d15953bd69d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:59.915824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeefdb3-3e5b-4040-a792-6d15953bd69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:59.932359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 915/1828] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:01:59 2022] DELETE /identity/v3/users/baa12e9c082641259f0d49b5a2285366 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:01:59.932359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289728b3-8f30-4f9e-a84d-8b2629dd35d2 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:01:59.932359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289728b3-8f30-4f9e-a84d-8b2629dd35d2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:01:59.932359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289728b3-8f30-4f9e-a84d-8b2629dd35d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:01:59.966547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-289728b3-8f30-4f9e-a84d-8b2629dd35d2 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:01:59.968130 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-289728b3-8f30-4f9e-a84d-8b2629dd35d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:01:59.973960 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:00.024464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-dfeefdb3-3e5b-4040-a792-6d15953bd69d None None] MFA Rules not processed for user `1d5760a3f9f946978b1251d3e2aaa943`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:00.030549 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-dfeefdb3-3e5b-4040-a792-6d15953bd69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:00.133605 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 916/1829] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:00.140482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391d4d-4572-45c2-a5c8-8228aeed43ac None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:00.140750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391d4d-4572-45c2-a5c8-8228aeed43ac None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:00.141007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391d4d-4572-45c2-a5c8-8228aeed43ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:00.201888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-56391d4d-4572-45c2-a5c8-8228aeed43ac None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:00.203254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-56391d4d-4572-45c2-a5c8-8228aeed43ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:00.205099 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 914/1830] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 7 22:01:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:00.219268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeefdb3-3e5b-4040-a792-6d15953bd69d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:00.220927 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-dfeefdb3-3e5b-4040-a792-6d15953bd69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:00.229341 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 917/1831] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:00.234801 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56391d4d-4572-45c2-a5c8-8228aeed43ac None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:00.241772 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeefdb3-3e5b-4040-a792-6d15953bd69d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:00.245837 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56391d4d-4572-45c2-a5c8-8228aeed43ac None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:00.251693 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9be2b-a3fb-4fc5-bf88-2566f98bfde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:00.252229 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910777a-ed18-4746-879c-d9897380df34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:00.252996 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9be2b-a3fb-4fc5-bf88-2566f98bfde9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:00.253109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910777a-ed18-4746-879c-d9897380df34 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:00.253496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910777a-ed18-4746-879c-d9897380df34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:00.254471 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9be2b-a3fb-4fc5-bf88-2566f98bfde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:00.254656 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910777a-ed18-4746-879c-d9897380df34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:00.255079 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9be2b-a3fb-4fc5-bf88-2566f98bfde9 admin admin] PATH_INFO: `/v3/users/9fd2da9e09934ce582b93f4c83c43b4a` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:00.255653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910777a-ed18-4746-879c-d9897380df34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:00.256058 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910777a-ed18-4746-879c-d9897380df34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:00.257413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9be2b-a3fb-4fc5-bf88-2566f98bfde9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd2da9e09934ce582b93f4c83c43b4a)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:00.258137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910777a-ed18-4746-879c-d9897380df34 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:00.267061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9be2b-a3fb-4fc5-bf88-2566f98bfde9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:00.279303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 918/1832] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:02:00.304332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910777a-ed18-4746-879c-d9897380df34 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:00.333870 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910777a-ed18-4746-879c-d9897380df34 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:00.343609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c2dd0-db09-4054-838f-7112b149d72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:00.347227 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c2dd0-db09-4054-838f-7112b149d72a admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:00.347669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c2dd0-db09-4054-838f-7112b149d72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:00.348052 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c2dd0-db09-4054-838f-7112b149d72a admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:00.351279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c2dd0-db09-4054-838f-7112b149d72a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:00.354905 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c2dd0-db09-4054-838f-7112b149d72a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:00.388307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-87c9be2b-a3fb-4fc5-bf88-2566f98bfde9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd2da9e09934ce582b93f4c83c43b4a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:00.415047 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-87c9be2b-a3fb-4fc5-bf88-2566f98bfde9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd2da9e09934ce582b93f4c83c43b4a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:00.419795 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 919/1833] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:00 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:00.421520 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c2dd0-db09-4054-838f-7112b149d72a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:00.426423 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-87c9be2b-a3fb-4fc5-bf88-2566f98bfde9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd2da9e09934ce582b93f4c83c43b4a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:00.449320 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-87c9be2b-a3fb-4fc5-bf88-2566f98bfde9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd2da9e09934ce582b93f4c83c43b4a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:00.450731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-87c9be2b-a3fb-4fc5-bf88-2566f98bfde9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd2da9e09934ce582b93f4c83c43b4a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:00.500222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 915/1834] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:00 2022] DELETE /identity/v3/users/9fd2da9e09934ce582b93f4c83c43b4a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:00.507475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec6a4-e7ed-4691-addc-273bfc32cded None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:00.507767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec6a4-e7ed-4691-addc-273bfc32cded None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:00.508048 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec6a4-e7ed-4691-addc-273bfc32cded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:00.530301 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-545ec6a4-e7ed-4691-addc-273bfc32cded None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:00.531908 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-545ec6a4-e7ed-4691-addc-273bfc32cded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:00.627477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c2dd0-db09-4054-838f-7112b149d72a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:00.678870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 916/1835] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:00.680588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ec6a4-e7ed-4691-addc-273bfc32cded None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:00.683427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-545ec6a4-e7ed-4691-addc-273bfc32cded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:00.693008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:00.787750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157e829-a425-4a8b-abb3-9c5feb3783be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:00.790084 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157e829-a425-4a8b-abb3-9c5feb3783be admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:00.790761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157e829-a425-4a8b-abb3-9c5feb3783be admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:00.791518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157e829-a425-4a8b-abb3-9c5feb3783be admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:00.792552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157e829-a425-4a8b-abb3-9c5feb3783be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:00.796172 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157e829-a425-4a8b-abb3-9c5feb3783be admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:00.836935 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 920/1836] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:00 2022] POST /identity/v3/users => generated 293 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:00.838949 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157e829-a425-4a8b-abb3-9c5feb3783be admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:00.842311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6157e829-a425-4a8b-abb3-9c5feb3783be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:00.854936 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:00.973418 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157e829-a425-4a8b-abb3-9c5feb3783be admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:00.980760 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f964342-ab3f-48d0-883d-dbd94b898151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:00.981967 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f964342-ab3f-48d0-883d-dbd94b898151 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:00.982412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f964342-ab3f-48d0-883d-dbd94b898151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:00.983029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f964342-ab3f-48d0-883d-dbd94b898151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:00.990241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ec6a4-e7ed-4691-addc-273bfc32cded None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:01.003668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f964342-ab3f-48d0-883d-dbd94b898151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:01.006377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f964342-ab3f-48d0-883d-dbd94b898151 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:01.011500 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe17f0d-8bbc-4b37-838c-3ffaaa7530cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:01.012183 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe17f0d-8bbc-4b37-838c-3ffaaa7530cb service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:01.018274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe17f0d-8bbc-4b37-838c-3ffaaa7530cb service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:01.018536 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe17f0d-8bbc-4b37-838c-3ffaaa7530cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:01.026072 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0fe17f0d-8bbc-4b37-838c-3ffaaa7530cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:01.029892 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 921/1837] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:01.031094 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f964342-ab3f-48d0-883d-dbd94b898151 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:01.032679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7f964342-ab3f-48d0-883d-dbd94b898151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:01.049109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f964342-ab3f-48d0-883d-dbd94b898151 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:01.057236 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c073d-bba2-4d18-8ce2-811257b9d189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:01.057484 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe17f0d-8bbc-4b37-838c-3ffaaa7530cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:01.058563 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c073d-bba2-4d18-8ce2-811257b9d189 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:01.059163 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c073d-bba2-4d18-8ce2-811257b9d189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:01.061140 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c073d-bba2-4d18-8ce2-811257b9d189 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:01.061618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe17f0d-8bbc-4b37-838c-3ffaaa7530cb service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:01.062497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c073d-bba2-4d18-8ce2-811257b9d189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:01.064838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c073d-bba2-4d18-8ce2-811257b9d189 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:01.075228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 917/1838] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:01.090166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 922/1839] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:01.095055 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe17f0d-8bbc-4b37-838c-3ffaaa7530cb service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:01.117419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe17f0d-8bbc-4b37-838c-3ffaaa7530cb service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:01.125394 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992168c-61a9-44eb-a7e2-b01f353ccc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:01.126320 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992168c-61a9-44eb-a7e2-b01f353ccc83 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:01.130895 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992168c-61a9-44eb-a7e2-b01f353ccc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:01.131584 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992168c-61a9-44eb-a7e2-b01f353ccc83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:01.132398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992168c-61a9-44eb-a7e2-b01f353ccc83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:01.134504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992168c-61a9-44eb-a7e2-b01f353ccc83 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:01.151552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 918/1840] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:01.157104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c073d-bba2-4d18-8ce2-811257b9d189 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:01.168542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c073d-bba2-4d18-8ce2-811257b9d189 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:01.184525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f55769-dfe4-4a7d-aba5-7bf323b9a82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:01.185442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f55769-dfe4-4a7d-aba5-7bf323b9a82e admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:01.185752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f55769-dfe4-4a7d-aba5-7bf323b9a82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:01.186140 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f55769-dfe4-4a7d-aba5-7bf323b9a82e admin admin] PATH_INFO: `/v3/projects/963da5105d6742659925c7a2685e8deb/users/cec136916fbc484182856eda1362aa1a/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:01.235755 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f55769-dfe4-4a7d-aba5-7bf323b9a82e admin admin] RBAC: Authorizing `identity:create_grant(project_id=963da5105d6742659925c7a2685e8deb, user_id=cec136916fbc484182856eda1362aa1a, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:01.240160 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f55769-dfe4-4a7d-aba5-7bf323b9a82e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:01.260250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 923/1841] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:01 2022] PUT /identity/v3/projects/963da5105d6742659925c7a2685e8deb/users/cec136916fbc484182856eda1362aa1a/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:01.272525 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f6d48-6a5b-45e7-a493-2ee95f36a313 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:01.272817 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f6d48-6a5b-45e7-a493-2ee95f36a313 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:01.273098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f6d48-6a5b-45e7-a493-2ee95f36a313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:01.357541 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f22f6d48-6a5b-45e7-a493-2ee95f36a313 None None] MFA Rules not processed for user `cec136916fbc484182856eda1362aa1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:01.359134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f22f6d48-6a5b-45e7-a493-2ee95f36a313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:01.534703 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 919/1842] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:01.541078 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f55769-dfe4-4a7d-aba5-7bf323b9a82e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:01.650371 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f55769-dfe4-4a7d-aba5-7bf323b9a82e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:01.657260 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5e46c-0d09-4404-aaed-cd15829337e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:01.660975 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5e46c-0d09-4404-aaed-cd15829337e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:01.661490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5e46c-0d09-4404-aaed-cd15829337e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:01.662380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5e46c-0d09-4404-aaed-cd15829337e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:01.664239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5e46c-0d09-4404-aaed-cd15829337e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:01.666510 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5e46c-0d09-4404-aaed-cd15829337e8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:01.707951 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 924/1843] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:01 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:01.710984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f6d48-6a5b-45e7-a493-2ee95f36a313 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:01.733776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f6d48-6a5b-45e7-a493-2ee95f36a313 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:01.820399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c95887-36fd-4dd7-8d41-394bc978830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:01.822134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95887-36fd-4dd7-8d41-394bc978830a admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:01.822424 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95887-36fd-4dd7-8d41-394bc978830a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:01.822703 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95887-36fd-4dd7-8d41-394bc978830a admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:01.823914 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c95887-36fd-4dd7-8d41-394bc978830a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:01.826844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c95887-36fd-4dd7-8d41-394bc978830a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:01.847083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:01.858949 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 920/1844] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:01 2022] POST /identity/v3/users => generated 300 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:01.859979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5e46c-0d09-4404-aaed-cd15829337e8 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:01.872299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5e46c-0d09-4404-aaed-cd15829337e8 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:01.878785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de2f9d-d1d0-40f1-a59a-80f1a68c188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:01.879630 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de2f9d-d1d0-40f1-a59a-80f1a68c188b admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:01.879841 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de2f9d-d1d0-40f1-a59a-80f1a68c188b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:01.880077 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de2f9d-d1d0-40f1-a59a-80f1a68c188b admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:01.880813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de2f9d-d1d0-40f1-a59a-80f1a68c188b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:01.884176 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de2f9d-d1d0-40f1-a59a-80f1a68c188b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:01.908313 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 925/1845] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:01.908909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c95887-36fd-4dd7-8d41-394bc978830a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:01.927186 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c95887-36fd-4dd7-8d41-394bc978830a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:01.933224 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30522cfe-d610-48e2-90cd-9362ce1a11e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:01.934813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30522cfe-d610-48e2-90cd-9362ce1a11e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:01.935847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30522cfe-d610-48e2-90cd-9362ce1a11e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:01.936307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30522cfe-d610-48e2-90cd-9362ce1a11e6 admin admin] PATH_INFO: `/v3/projects/1148881a536f48068ad1bb9a23d48a4a/users/f76db08934884dc68ae89c7cf3e738ef/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:01.966166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30522cfe-d610-48e2-90cd-9362ce1a11e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1148881a536f48068ad1bb9a23d48a4a, user_id=f76db08934884dc68ae89c7cf3e738ef, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:01.969640 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30522cfe-d610-48e2-90cd-9362ce1a11e6 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:01.995313 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 921/1846] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:01 2022] PUT /identity/v3/projects/1148881a536f48068ad1bb9a23d48a4a/users/f76db08934884dc68ae89c7cf3e738ef/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:01.997811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de2f9d-d1d0-40f1-a59a-80f1a68c188b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:02.013708 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de2f9d-d1d0-40f1-a59a-80f1a68c188b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:02.107709 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:02.139539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea95af-2d37-463e-8713-717c7e6f380a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:02.140307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea95af-2d37-463e-8713-717c7e6f380a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:02.140669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea95af-2d37-463e-8713-717c7e6f380a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:02.141550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea95af-2d37-463e-8713-717c7e6f380a admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:02.142402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea95af-2d37-463e-8713-717c7e6f380a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:02.144939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea95af-2d37-463e-8713-717c7e6f380a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:02.158951 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 926/1847] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:02.164746 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30522cfe-d610-48e2-90cd-9362ce1a11e6 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:02.178407 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30522cfe-d610-48e2-90cd-9362ce1a11e6 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:02.184950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f1ec6-ead6-4e61-91d8-31bba57fa42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:02.186414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f1ec6-ead6-4e61-91d8-31bba57fa42e admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:02.186901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f1ec6-ead6-4e61-91d8-31bba57fa42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:02.187613 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f1ec6-ead6-4e61-91d8-31bba57fa42e admin admin] PATH_INFO: `/v3/projects/1148881a536f48068ad1bb9a23d48a4a/users/f76db08934884dc68ae89c7cf3e738ef/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:02.190039 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f1ec6-ead6-4e61-91d8-31bba57fa42e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1148881a536f48068ad1bb9a23d48a4a, user_id=f76db08934884dc68ae89c7cf3e738ef, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:02.193638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f1ec6-ead6-4e61-91d8-31bba57fa42e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:02.218038 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 922/1848] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:02 2022] PUT /identity/v3/projects/1148881a536f48068ad1bb9a23d48a4a/users/f76db08934884dc68ae89c7cf3e738ef/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:02.219817 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930202e-0472-43fe-9c38-20057b2a3692 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:02.220156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930202e-0472-43fe-9c38-20057b2a3692 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:02.220496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930202e-0472-43fe-9c38-20057b2a3692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:02.265076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7930202e-0472-43fe-9c38-20057b2a3692 None None] MFA Rules not processed for user `f76db08934884dc68ae89c7cf3e738ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:02.267060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7930202e-0472-43fe-9c38-20057b2a3692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:02.382114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 927/1849] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:02.393542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f1ec6-ead6-4e61-91d8-31bba57fa42e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:02.396027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9a3f1ec6-ead6-4e61-91d8-31bba57fa42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:02.510575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930202e-0472-43fe-9c38-20057b2a3692 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:02.512938 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7930202e-0472-43fe-9c38-20057b2a3692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:02.515378 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f1ec6-ead6-4e61-91d8-31bba57fa42e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:02.522191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f284af8-47b9-4075-9520-6b4a11191ead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:02.528790 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f284af8-47b9-4075-9520-6b4a11191ead service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:02.529842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f284af8-47b9-4075-9520-6b4a11191ead service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:02.530361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f284af8-47b9-4075-9520-6b4a11191ead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:02.552082 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f284af8-47b9-4075-9520-6b4a11191ead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:02.555687 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f284af8-47b9-4075-9520-6b4a11191ead service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:02.572444 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 923/1850] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:02.653007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930202e-0472-43fe-9c38-20057b2a3692 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:02.662583 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e69560-23f0-4c99-81c4-cc02f795446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:02.663472 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e69560-23f0-4c99-81c4-cc02f795446a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:02.663756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e69560-23f0-4c99-81c4-cc02f795446a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:02.664035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e69560-23f0-4c99-81c4-cc02f795446a admin admin] PATH_INFO: `/v3/projects/3b9157b526164c58a17508e4549a5ced` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:02.670606 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e69560-23f0-4c99-81c4-cc02f795446a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9157b526164c58a17508e4549a5ced)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:02.670606 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e69560-23f0-4c99-81c4-cc02f795446a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:02.759523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-42e69560-23f0-4c99-81c4-cc02f795446a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9157b526164c58a17508e4549a5ced', 'request_id': 'req-42e69560-23f0-4c99-81c4-cc02f795446a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:02.767930 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-42e69560-23f0-4c99-81c4-cc02f795446a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9157b526164c58a17508e4549a5ced', 'request_id': 'req-42e69560-23f0-4c99-81c4-cc02f795446a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:02.778063 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-42e69560-23f0-4c99-81c4-cc02f795446a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9157b526164c58a17508e4549a5ced', 'request_id': 'req-42e69560-23f0-4c99-81c4-cc02f795446a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:02.784310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f284af8-47b9-4075-9520-6b4a11191ead service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:02.789488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:02.796171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-42e69560-23f0-4c99-81c4-cc02f795446a admin admin] The token cache is being invalidate because project 3b9157b526164c58a17508e4549a5ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:02.796946 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-42e69560-23f0-4c99-81c4-cc02f795446a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:02.798000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-42e69560-23f0-4c99-81c4-cc02f795446a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:02.800338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 928/1851] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:02 2022] DELETE /identity/v3/projects/3b9157b526164c58a17508e4549a5ced => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:02.801425 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f284af8-47b9-4075-9520-6b4a11191ead service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:02.806033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e69560-23f0-4c99-81c4-cc02f795446a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:02.807358 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-42e69560-23f0-4c99-81c4-cc02f795446a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:02.891518 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4f6ca-af96-4b72-8cc6-fbd9ff6e62bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:02.900891 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4f6ca-af96-4b72-8cc6-fbd9ff6e62bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:02.900891 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4f6ca-af96-4b72-8cc6-fbd9ff6e62bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:02.900891 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4f6ca-af96-4b72-8cc6-fbd9ff6e62bb admin admin] PATH_INFO: `/v3/users/cec136916fbc484182856eda1362aa1a` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:02.900891 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4f6ca-af96-4b72-8cc6-fbd9ff6e62bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec136916fbc484182856eda1362aa1a)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:02.900891 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4f6ca-af96-4b72-8cc6-fbd9ff6e62bb admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:02.919608 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e69560-23f0-4c99-81c4-cc02f795446a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:02.957151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e794aa-ca55-422b-912b-c71d44d5fd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:02.960806 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e794aa-ca55-422b-912b-c71d44d5fd78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:02.964783 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e794aa-ca55-422b-912b-c71d44d5fd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:02.965382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e794aa-ca55-422b-912b-c71d44d5fd78 admin admin] PATH_INFO: `/v3/users/097719ccc8f2488caa058e94069c130a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:02.971396 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e794aa-ca55-422b-912b-c71d44d5fd78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=097719ccc8f2488caa058e94069c130a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:02.976143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e794aa-ca55-422b-912b-c71d44d5fd78 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:02.990944 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e0c4f6ca-af96-4b72-8cc6-fbd9ff6e62bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec136916fbc484182856eda1362aa1a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:03.010140 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e0c4f6ca-af96-4b72-8cc6-fbd9ff6e62bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec136916fbc484182856eda1362aa1a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:03.010942 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e0c4f6ca-af96-4b72-8cc6-fbd9ff6e62bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec136916fbc484182856eda1362aa1a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:03.030253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e0c4f6ca-af96-4b72-8cc6-fbd9ff6e62bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec136916fbc484182856eda1362aa1a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:03.031456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e0c4f6ca-af96-4b72-8cc6-fbd9ff6e62bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec136916fbc484182856eda1362aa1a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:03.035914 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:03.072788 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 924/1852] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:02 2022] DELETE /identity/v3/users/cec136916fbc484182856eda1362aa1a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:03.073825 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4f6ca-af96-4b72-8cc6-fbd9ff6e62bb admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:03.077240 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e0c4f6ca-af96-4b72-8cc6-fbd9ff6e62bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:03.079898 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e2e794aa-ca55-422b-912b-c71d44d5fd78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '097719ccc8f2488caa058e94069c130a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:03.090067 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e2e794aa-ca55-422b-912b-c71d44d5fd78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '097719ccc8f2488caa058e94069c130a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:03.100839 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e2e794aa-ca55-422b-912b-c71d44d5fd78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '097719ccc8f2488caa058e94069c130a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:03.101761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e2e794aa-ca55-422b-912b-c71d44d5fd78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '097719ccc8f2488caa058e94069c130a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:03.102915 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e2e794aa-ca55-422b-912b-c71d44d5fd78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '097719ccc8f2488caa058e94069c130a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:03.135000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 929/1853] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:02 2022] DELETE /identity/v3/users/097719ccc8f2488caa058e94069c130a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:03.136723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8d669-dd36-4bf2-ac75-b89e611676a3 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:03.137366 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8d669-dd36-4bf2-ac75-b89e611676a3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:03.137946 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8d669-dd36-4bf2-ac75-b89e611676a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:03.164413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-75d8d669-dd36-4bf2-ac75-b89e611676a3 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:03.165846 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-75d8d669-dd36-4bf2-ac75-b89e611676a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:03.169236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4f6ca-af96-4b72-8cc6-fbd9ff6e62bb admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:03.273954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 930/1854] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:03.281723 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4891f-8587-4edd-bbca-d1ed919a92da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:03.282788 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4891f-8587-4edd-bbca-d1ed919a92da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:03.283074 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4891f-8587-4edd-bbca-d1ed919a92da admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:03.283349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4891f-8587-4edd-bbca-d1ed919a92da admin admin] PATH_INFO: `/v3/projects/7e27a3d79cdb4704af319909c258e18a` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:03.284703 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4891f-8587-4edd-bbca-d1ed919a92da admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e27a3d79cdb4704af319909c258e18a)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:03.287704 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4891f-8587-4edd-bbca-d1ed919a92da admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:03.308068 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8d669-dd36-4bf2-ac75-b89e611676a3 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:03.311968 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-75d8d669-dd36-4bf2-ac75-b89e611676a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:03.394533 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:03.407845 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7ef4891f-8587-4edd-bbca-d1ed919a92da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e27a3d79cdb4704af319909c258e18a', 'request_id': 'req-7ef4891f-8587-4edd-bbca-d1ed919a92da'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:03.427804 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7ef4891f-8587-4edd-bbca-d1ed919a92da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e27a3d79cdb4704af319909c258e18a', 'request_id': 'req-7ef4891f-8587-4edd-bbca-d1ed919a92da'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:03.448461 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7ef4891f-8587-4edd-bbca-d1ed919a92da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e27a3d79cdb4704af319909c258e18a', 'request_id': 'req-7ef4891f-8587-4edd-bbca-d1ed919a92da'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:03.466292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7ef4891f-8587-4edd-bbca-d1ed919a92da admin admin] The token cache is being invalidate because project 7e27a3d79cdb4704af319909c258e18a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:03.466874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7ef4891f-8587-4edd-bbca-d1ed919a92da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:03.467712 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7ef4891f-8587-4edd-bbca-d1ed919a92da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:03.470715 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 925/1855] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:03 2022] DELETE /identity/v3/projects/7e27a3d79cdb4704af319909c258e18a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:03.478229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0e429-983a-43fd-aa86-834da8e0c58b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:03.479309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0e429-983a-43fd-aa86-834da8e0c58b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:03.479738 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0e429-983a-43fd-aa86-834da8e0c58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:03.495892 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8d669-dd36-4bf2-ac75-b89e611676a3 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:03.505185 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ffd0e429-983a-43fd-aa86-834da8e0c58b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:03.506477 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ffd0e429-983a-43fd-aa86-834da8e0c58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:03.546193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:03.598942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7c1cb-9881-421b-9e46-8b1e6dbd10fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:03.599776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7c1cb-9881-421b-9e46-8b1e6dbd10fe service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:03.600157 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7c1cb-9881-421b-9e46-8b1e6dbd10fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:03.601914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7c1cb-9881-421b-9e46-8b1e6dbd10fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:03.604075 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3af7c1cb-9881-421b-9e46-8b1e6dbd10fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:03.672030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 926/1856] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:03.679780 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300cb1f-fdb0-4819-aa91-7415f7019162 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:03.680071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300cb1f-fdb0-4819-aa91-7415f7019162 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:03.680356 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300cb1f-fdb0-4819-aa91-7415f7019162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:03.708130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6300cb1f-fdb0-4819-aa91-7415f7019162 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:03.709557 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6300cb1f-fdb0-4819-aa91-7415f7019162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:03.720774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 927/1857] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:03.726266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300cb1f-fdb0-4819-aa91-7415f7019162 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:03.752505 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7c1cb-9881-421b-9e46-8b1e6dbd10fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:03.756121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7c1cb-9881-421b-9e46-8b1e6dbd10fe service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:03.759889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300cb1f-fdb0-4819-aa91-7415f7019162 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:03.768908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 931/1858] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:03.771859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87556f0e-65ae-4cb1-9d5a-1ee62d2659d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:03.772654 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87556f0e-65ae-4cb1-9d5a-1ee62d2659d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:03.773048 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87556f0e-65ae-4cb1-9d5a-1ee62d2659d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:03.773422 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87556f0e-65ae-4cb1-9d5a-1ee62d2659d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:03.774334 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87556f0e-65ae-4cb1-9d5a-1ee62d2659d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:03.775458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87556f0e-65ae-4cb1-9d5a-1ee62d2659d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:03.777281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87556f0e-65ae-4cb1-9d5a-1ee62d2659d0 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:03.803061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 928/1859] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:02:03.812699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7c1cb-9881-421b-9e46-8b1e6dbd10fe service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:03.834042 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7c1cb-9881-421b-9e46-8b1e6dbd10fe service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:03.842299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e11f7d-80e8-4e2c-ad4b-f6147eb581e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:03.843037 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e11f7d-80e8-4e2c-ad4b-f6147eb581e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:03.843317 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e11f7d-80e8-4e2c-ad4b-f6147eb581e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:03.844130 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e11f7d-80e8-4e2c-ad4b-f6147eb581e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:03.844839 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e11f7d-80e8-4e2c-ad4b-f6147eb581e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:03.847803 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e11f7d-80e8-4e2c-ad4b-f6147eb581e8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:03.898578 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 932/1860] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:03 2022] POST /identity/v3/projects => generated 387 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:03.903120 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87556f0e-65ae-4cb1-9d5a-1ee62d2659d0 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:03.927073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87556f0e-65ae-4cb1-9d5a-1ee62d2659d0 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:04.081710 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209836ca-116b-4c7d-8331-6ca798ca8dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:04.082848 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209836ca-116b-4c7d-8331-6ca798ca8dec admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:04.083237 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209836ca-116b-4c7d-8331-6ca798ca8dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:04.083524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209836ca-116b-4c7d-8331-6ca798ca8dec admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:04.084533 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209836ca-116b-4c7d-8331-6ca798ca8dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:04.091745 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209836ca-116b-4c7d-8331-6ca798ca8dec admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:04.152119 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 929/1861] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:03 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:04.153757 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e11f7d-80e8-4e2c-ad4b-f6147eb581e8 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:04.169977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e11f7d-80e8-4e2c-ad4b-f6147eb581e8 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:04.180258 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f1847-e777-4437-921c-cc320ffeb6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:04.181162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f1847-e777-4437-921c-cc320ffeb6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:04.181545 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f1847-e777-4437-921c-cc320ffeb6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:04.181965 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f1847-e777-4437-921c-cc320ffeb6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:04.182823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f1847-e777-4437-921c-cc320ffeb6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:04.184685 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f1847-e777-4437-921c-cc320ffeb6d6 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:04.225422 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209836ca-116b-4c7d-8331-6ca798ca8dec admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:04.228092 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-209836ca-116b-4c7d-8331-6ca798ca8dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:04.229295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 933/1862] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:04.233567 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f1847-e777-4437-921c-cc320ffeb6d6 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:04.251349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209836ca-116b-4c7d-8331-6ca798ca8dec admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:04.252484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f1847-e777-4437-921c-cc320ffeb6d6 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:04.259411 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337d900-9862-44f0-ac60-ec1096f1bcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:04.260397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d900-9862-44f0-ac60-ec1096f1bcbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:04.260896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d900-9862-44f0-ac60-ec1096f1bcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:04.262030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d900-9862-44f0-ac60-ec1096f1bcbf admin admin] PATH_INFO: `/v3/projects/4af96757c6304c0badf0b4a33410981f` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:04.268468 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ac1e3-5997-4ee6-ac57-38f67ce0b38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:04.269678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ac1e3-5997-4ee6-ac57-38f67ce0b38e admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:04.269678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ac1e3-5997-4ee6-ac57-38f67ce0b38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:04.270084 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ac1e3-5997-4ee6-ac57-38f67ce0b38e admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:04.270947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ac1e3-5997-4ee6-ac57-38f67ce0b38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:04.273404 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ac1e3-5997-4ee6-ac57-38f67ce0b38e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:04.278292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337d900-9862-44f0-ac60-ec1096f1bcbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4af96757c6304c0badf0b4a33410981f)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:04.280489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337d900-9862-44f0-ac60-ec1096f1bcbf admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:04.298505 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 934/1863] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:02:04.303457 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ac1e3-5997-4ee6-ac57-38f67ce0b38e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:04.319591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ac1e3-5997-4ee6-ac57-38f67ce0b38e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:04.340222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746050d-e4b0-4714-8338-474c9f949813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:04.341478 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746050d-e4b0-4714-8338-474c9f949813 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:04.341999 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746050d-e4b0-4714-8338-474c9f949813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:04.342318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746050d-e4b0-4714-8338-474c9f949813 admin admin] PATH_INFO: `/v3/projects/100ee40345c74deeb0a23a856929afbe/users/74191a77497242449f8b17b9969a3f69/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:04.371590 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746050d-e4b0-4714-8338-474c9f949813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100ee40345c74deeb0a23a856929afbe, user_id=74191a77497242449f8b17b9969a3f69, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:04.374900 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746050d-e4b0-4714-8338-474c9f949813 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:04.391256 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6337d900-9862-44f0-ac60-ec1096f1bcbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4af96757c6304c0badf0b4a33410981f', 'request_id': 'req-6337d900-9862-44f0-ac60-ec1096f1bcbf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:04.392479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 935/1864] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:04 2022] PUT /identity/v3/projects/100ee40345c74deeb0a23a856929afbe/users/74191a77497242449f8b17b9969a3f69/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:04.404359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ebbc4-dfb5-4738-9185-2427bb01f9d3 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:04.404646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ebbc4-dfb5-4738-9185-2427bb01f9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:04.404924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ebbc4-dfb5-4738-9185-2427bb01f9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:04.409615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6337d900-9862-44f0-ac60-ec1096f1bcbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4af96757c6304c0badf0b4a33410981f', 'request_id': 'req-6337d900-9862-44f0-ac60-ec1096f1bcbf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:04.418539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6337d900-9862-44f0-ac60-ec1096f1bcbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4af96757c6304c0badf0b4a33410981f', 'request_id': 'req-6337d900-9862-44f0-ac60-ec1096f1bcbf'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:04.435569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6337d900-9862-44f0-ac60-ec1096f1bcbf admin admin] The token cache is being invalidate because project 4af96757c6304c0badf0b4a33410981f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:04.435996 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6337d900-9862-44f0-ac60-ec1096f1bcbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:04.436708 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6337d900-9862-44f0-ac60-ec1096f1bcbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:04.436951 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-706ebbc4-dfb5-4738-9185-2427bb01f9d3 None None] MFA Rules not processed for user `74191a77497242449f8b17b9969a3f69`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:04.438174 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-706ebbc4-dfb5-4738-9185-2427bb01f9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:04.438893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 930/1865] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:04 2022] DELETE /identity/v3/projects/4af96757c6304c0badf0b4a33410981f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:04.443220 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b3abd-deab-4120-a421-8b63e67918d1 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:04.443580 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b3abd-deab-4120-a421-8b63e67918d1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:04.443928 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b3abd-deab-4120-a421-8b63e67918d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:04.445463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:04.466024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-364b3abd-deab-4120-a421-8b63e67918d1 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:04.467355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-364b3abd-deab-4120-a421-8b63e67918d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:04.479459 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:04.526400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 936/1866] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:04.530948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ebbc4-dfb5-4738-9185-2427bb01f9d3 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:04.534262 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-706ebbc4-dfb5-4738-9185-2427bb01f9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:04.547626 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 931/1867] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:04.556542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6aadf-72a2-4611-ae0e-ffe31be079a8 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:04.557379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6aadf-72a2-4611-ae0e-ffe31be079a8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:04.557379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6aadf-72a2-4611-ae0e-ffe31be079a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:04.581071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-45d6aadf-72a2-4611-ae0e-ffe31be079a8 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:04.582842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-45d6aadf-72a2-4611-ae0e-ffe31be079a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:04.593657 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 932/1868] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:04.598582 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6aadf-72a2-4611-ae0e-ffe31be079a8 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:04.609942 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6aadf-72a2-4611-ae0e-ffe31be079a8 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:04.618325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd5fb3-7830-4ea3-83ee-2a650796a6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:04.619149 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd5fb3-7830-4ea3-83ee-2a650796a6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:04.619907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd5fb3-7830-4ea3-83ee-2a650796a6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:04.620194 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd5fb3-7830-4ea3-83ee-2a650796a6d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:04.621205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd5fb3-7830-4ea3-83ee-2a650796a6d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:04.621871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd5fb3-7830-4ea3-83ee-2a650796a6d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:04.623940 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd5fb3-7830-4ea3-83ee-2a650796a6d7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:04.627819 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ebbc4-dfb5-4738-9185-2427bb01f9d3 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:04.633435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91360ec-ce96-4df2-938c-2e677ccb0fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:04.634568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91360ec-ce96-4df2-938c-2e677ccb0fbe admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:04.634944 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91360ec-ce96-4df2-938c-2e677ccb0fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:04.635383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91360ec-ce96-4df2-938c-2e677ccb0fbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:04.636169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91360ec-ce96-4df2-938c-2e677ccb0fbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:04.638533 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91360ec-ce96-4df2-938c-2e677ccb0fbe admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:04.649230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 933/1869] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 22:02:04.655555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd5fb3-7830-4ea3-83ee-2a650796a6d7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:04.667444 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd5fb3-7830-4ea3-83ee-2a650796a6d7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:04.673826 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc05b6f-3f05-4e7e-be17-5dbd819e13a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:04.674515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc05b6f-3f05-4e7e-be17-5dbd819e13a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:04.674801 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc05b6f-3f05-4e7e-be17-5dbd819e13a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:04.675077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc05b6f-3f05-4e7e-be17-5dbd819e13a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:04.678012 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc05b6f-3f05-4e7e-be17-5dbd819e13a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:04.678133 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 937/1870] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:04 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:04.678577 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc05b6f-3f05-4e7e-be17-5dbd819e13a2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:04.679950 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91360ec-ce96-4df2-938c-2e677ccb0fbe admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:04.714998 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 934/1871] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:04 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:02:04.716149 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc05b6f-3f05-4e7e-be17-5dbd819e13a2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:04.762589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91360ec-ce96-4df2-938c-2e677ccb0fbe admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:04.791319 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc05b6f-3f05-4e7e-be17-5dbd819e13a2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:04.796712 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f828cd-51b5-4881-9eac-6633b9fbf184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:04.797477 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f828cd-51b5-4881-9eac-6633b9fbf184 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:04.797832 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f828cd-51b5-4881-9eac-6633b9fbf184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:04.798201 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f828cd-51b5-4881-9eac-6633b9fbf184 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:04.798974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f828cd-51b5-4881-9eac-6633b9fbf184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:04.801019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f828cd-51b5-4881-9eac-6633b9fbf184 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:04.822221 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:04.837166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 935/1872] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:04 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:04.841129 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f828cd-51b5-4881-9eac-6633b9fbf184 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:04.854358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f828cd-51b5-4881-9eac-6633b9fbf184 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:04.860526 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb9fe9-ec49-4b02-812f-d0878665eda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:04.861409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb9fe9-ec49-4b02-812f-d0878665eda4 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:04.861671 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb9fe9-ec49-4b02-812f-d0878665eda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:04.862191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb9fe9-ec49-4b02-812f-d0878665eda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:04.862980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb9fe9-ec49-4b02-812f-d0878665eda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:04.864718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb9fe9-ec49-4b02-812f-d0878665eda4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:04.869551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5872e8-fdb2-4c02-a57e-fdd822e6c665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:04.878592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 936/1873] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:02:04.880350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb9fe9-ec49-4b02-812f-d0878665eda4 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:04.883445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a8bb9fe9-ec49-4b02-812f-d0878665eda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:04.886513 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5872e8-fdb2-4c02-a57e-fdd822e6c665 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:04.887400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5872e8-fdb2-4c02-a57e-fdd822e6c665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:04.888494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5872e8-fdb2-4c02-a57e-fdd822e6c665 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:04.890319 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5872e8-fdb2-4c02-a57e-fdd822e6c665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:04.892357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5872e8-fdb2-4c02-a57e-fdd822e6c665 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:04.912637 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb9fe9-ec49-4b02-812f-d0878665eda4 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:04.917083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 938/1874] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:04 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:02:04.920910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5872e8-fdb2-4c02-a57e-fdd822e6c665 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:04.930264 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab6a66-fd17-46ec-86d8-f464694076ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:04.931156 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab6a66-fd17-46ec-86d8-f464694076ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:04.931442 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab6a66-fd17-46ec-86d8-f464694076ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:04.931718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab6a66-fd17-46ec-86d8-f464694076ac admin admin] PATH_INFO: `/v3/projects/963da5105d6742659925c7a2685e8deb` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:04.932069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5872e8-fdb2-4c02-a57e-fdd822e6c665 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:04.935288 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab6a66-fd17-46ec-86d8-f464694076ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=963da5105d6742659925c7a2685e8deb)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:04.938388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab6a66-fd17-46ec-86d8-f464694076ac admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:04.938992 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc26f9-90a9-4ec3-8cd7-80fe8b189f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:04.939866 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc26f9-90a9-4ec3-8cd7-80fe8b189f01 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:04.940456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc26f9-90a9-4ec3-8cd7-80fe8b189f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:04.940796 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc26f9-90a9-4ec3-8cd7-80fe8b189f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:04.943040 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc26f9-90a9-4ec3-8cd7-80fe8b189f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:04.945013 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc26f9-90a9-4ec3-8cd7-80fe8b189f01 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:04.966831 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 939/1875] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:04.968991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc26f9-90a9-4ec3-8cd7-80fe8b189f01 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:04.987043 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc26f9-90a9-4ec3-8cd7-80fe8b189f01 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:04.997800 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8a3b7-be55-4b49-bcbc-45a7e143a22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:04.998796 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8a3b7-be55-4b49-bcbc-45a7e143a22a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:04.999689 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8a3b7-be55-4b49-bcbc-45a7e143a22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:04.999689 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8a3b7-be55-4b49-bcbc-45a7e143a22a admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:04.999999 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8a3b7-be55-4b49-bcbc-45a7e143a22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:05.001629 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8a3b7-be55-4b49-bcbc-45a7e143a22a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:05.018914 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:05.019114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 940/1876] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:05.023334 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b0ab6a66-fd17-46ec-86d8-f464694076ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '963da5105d6742659925c7a2685e8deb', 'request_id': 'req-b0ab6a66-fd17-46ec-86d8-f464694076ac'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:05.024506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8a3b7-be55-4b49-bcbc-45a7e143a22a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:05.033462 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b0ab6a66-fd17-46ec-86d8-f464694076ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '963da5105d6742659925c7a2685e8deb', 'request_id': 'req-b0ab6a66-fd17-46ec-86d8-f464694076ac'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:05.041035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8a3b7-be55-4b49-bcbc-45a7e143a22a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:05.048199 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b0ab6a66-fd17-46ec-86d8-f464694076ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '963da5105d6742659925c7a2685e8deb', 'request_id': 'req-b0ab6a66-fd17-46ec-86d8-f464694076ac'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:05.065356 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b0ab6a66-fd17-46ec-86d8-f464694076ac admin admin] The token cache is being invalidate because project 963da5105d6742659925c7a2685e8deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:05.065356 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b0ab6a66-fd17-46ec-86d8-f464694076ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:05.066972 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b0ab6a66-fd17-46ec-86d8-f464694076ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:05.069076 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 937/1877] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:04 2022] DELETE /identity/v3/projects/963da5105d6742659925c7a2685e8deb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:05.070016 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab6a66-fd17-46ec-86d8-f464694076ac admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:05.071523 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b0ab6a66-fd17-46ec-86d8-f464694076ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:05.132537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bd68f-1313-4d15-9e35-afd2d703cacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:05.139499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bd68f-1313-4d15-9e35-afd2d703cacb admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:05.140337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bd68f-1313-4d15-9e35-afd2d703cacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:05.140772 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bd68f-1313-4d15-9e35-afd2d703cacb admin admin] PATH_INFO: `/v3/projects/5c6e3caf44bf4da99d7f617299f2f3c6/users/c49c7b1c16934b7db8080822fee80c07/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:05.216124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bd68f-1313-4d15-9e35-afd2d703cacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6e3caf44bf4da99d7f617299f2f3c6, user_id=c49c7b1c16934b7db8080822fee80c07, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:05.227105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bd68f-1313-4d15-9e35-afd2d703cacb admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:05.248604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab6a66-fd17-46ec-86d8-f464694076ac admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:05.263943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36f01f-0cbb-4ce5-b78a-1a2f70b8029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:05.268322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36f01f-0cbb-4ce5-b78a-1a2f70b8029d admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:05.268677 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36f01f-0cbb-4ce5-b78a-1a2f70b8029d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:05.268965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36f01f-0cbb-4ce5-b78a-1a2f70b8029d admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:05.270316 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36f01f-0cbb-4ce5-b78a-1a2f70b8029d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:05.272284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36f01f-0cbb-4ce5-b78a-1a2f70b8029d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:05.284201 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 941/1878] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:05 2022] PUT /identity/v3/projects/5c6e3caf44bf4da99d7f617299f2f3c6/users/c49c7b1c16934b7db8080822fee80c07/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:05.286598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bd68f-1313-4d15-9e35-afd2d703cacb admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:05.288367 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 938/1879] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:05.291888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6d6bd68f-1313-4d15-9e35-afd2d703cacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:05.291983 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b413e0-448e-4fd1-ab9d-7d9f2f468cab None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:05.292374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b413e0-448e-4fd1-ab9d-7d9f2f468cab None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:05.292922 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b413e0-448e-4fd1-ab9d-7d9f2f468cab None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:05.299387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 939/1880] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 7 22:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 22:02:05.299387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12f157-07a6-48e0-ac9d-d14f8f834d21 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:05.299387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12f157-07a6-48e0-ac9d-d14f8f834d21 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:05.299387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12f157-07a6-48e0-ac9d-d14f8f834d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:05.336027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0d12f157-07a6-48e0-ac9d-d14f8f834d21 None None] MFA Rules not processed for user `c49c7b1c16934b7db8080822fee80c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:05.337482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0d12f157-07a6-48e0-ac9d-d14f8f834d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:05.407147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bd68f-1313-4d15-9e35-afd2d703cacb admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:05.418778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f151e5-027c-492a-a8fc-82874b7ec9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:05.420831 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f151e5-027c-492a-a8fc-82874b7ec9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:05.421134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f151e5-027c-492a-a8fc-82874b7ec9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:05.421416 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f151e5-027c-492a-a8fc-82874b7ec9ce admin admin] PATH_INFO: `/v3/users/f76db08934884dc68ae89c7cf3e738ef` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:05.426677 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f151e5-027c-492a-a8fc-82874b7ec9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f76db08934884dc68ae89c7cf3e738ef)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:05.426792 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 940/1881] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:05.428424 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f151e5-027c-492a-a8fc-82874b7ec9ce admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:05.431360 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12f157-07a6-48e0-ac9d-d14f8f834d21 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:05.455064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12f157-07a6-48e0-ac9d-d14f8f834d21 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:05.467511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20aa07-ddb1-4e89-a759-0a683e185d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:05.468425 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20aa07-ddb1-4e89-a759-0a683e185d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:05.468712 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20aa07-ddb1-4e89-a759-0a683e185d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:05.468995 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20aa07-ddb1-4e89-a759-0a683e185d8e admin admin] PATH_INFO: `/v3/projects/4d75d4443bdd4c8ead2bed6cafc8b850/users/20037243a6b84f46812e7298067fcb02/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:05.528864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:05.536563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20aa07-ddb1-4e89-a759-0a683e185d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d75d4443bdd4c8ead2bed6cafc8b850, user_id=20037243a6b84f46812e7298067fcb02, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:05.540321 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20aa07-ddb1-4e89-a759-0a683e185d8e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:05.565283 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a5f151e5-027c-492a-a8fc-82874b7ec9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f76db08934884dc68ae89c7cf3e738ef'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:05.568649 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 941/1882] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:05 2022] PUT /identity/v3/projects/4d75d4443bdd4c8ead2bed6cafc8b850/users/20037243a6b84f46812e7298067fcb02/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:05.570583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3619a-9843-4419-9649-1cd9a6398ca0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:05.570932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3619a-9843-4419-9649-1cd9a6398ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:05.571222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3619a-9843-4419-9649-1cd9a6398ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:05.576562 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a5f151e5-027c-492a-a8fc-82874b7ec9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f76db08934884dc68ae89c7cf3e738ef'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:05.600152 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b7a3619a-9843-4419-9649-1cd9a6398ca0 None None] MFA Rules not processed for user `1d5760a3f9f946978b1251d3e2aaa943`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:05.602292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b7a3619a-9843-4419-9649-1cd9a6398ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:05.606509 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a5f151e5-027c-492a-a8fc-82874b7ec9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f76db08934884dc68ae89c7cf3e738ef'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:05.607799 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a5f151e5-027c-492a-a8fc-82874b7ec9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f76db08934884dc68ae89c7cf3e738ef'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:05.609439 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a5f151e5-027c-492a-a8fc-82874b7ec9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f76db08934884dc68ae89c7cf3e738ef'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:05.649343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 942/1883] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:05 2022] DELETE /identity/v3/users/f76db08934884dc68ae89c7cf3e738ef => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:05.650324 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f151e5-027c-492a-a8fc-82874b7ec9ce admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:05.656534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a5f151e5-027c-492a-a8fc-82874b7ec9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:05.687280 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:05.784548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 942/1884] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 7 22:02:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:05.788234 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acad0c-2bc4-47a1-bdc2-eca9f3dce4cc None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:05.788552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acad0c-2bc4-47a1-bdc2-eca9f3dce4cc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:05.788818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acad0c-2bc4-47a1-bdc2-eca9f3dce4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:05.852367 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f151e5-027c-492a-a8fc-82874b7ec9ce admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:05.866357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0d4ec-317b-44d1-a5d5-79ccfa073bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:05.868705 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0d4ec-317b-44d1-a5d5-79ccfa073bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:05.868976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0d4ec-317b-44d1-a5d5-79ccfa073bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:05.870425 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0d4ec-317b-44d1-a5d5-79ccfa073bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:05.874364 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0d4ec-317b-44d1-a5d5-79ccfa073bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:05.875710 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-89acad0c-2bc4-47a1-bdc2-eca9f3dce4cc None None] MFA Rules not processed for user `20037243a6b84f46812e7298067fcb02`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:05.876957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-89acad0c-2bc4-47a1-bdc2-eca9f3dce4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:05.879670 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0d4ec-317b-44d1-a5d5-79ccfa073bc4 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:05.935491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 943/1885] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:05 2022] POST /identity/v3/projects => generated 377 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:05.936563 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0d4ec-317b-44d1-a5d5-79ccfa073bc4 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:05.938494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9ff0d4ec-317b-44d1-a5d5-79ccfa073bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:05.975676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 943/1886] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:05.977132 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acad0c-2bc4-47a1-bdc2-eca9f3dce4cc None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:05.992684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acad0c-2bc4-47a1-bdc2-eca9f3dce4cc None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:06.102936 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0d4ec-317b-44d1-a5d5-79ccfa073bc4 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:06.108864 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e275ad0-d491-4f95-b5bc-22b6ad7bb648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:06.110162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e275ad0-d491-4f95-b5bc-22b6ad7bb648 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:06.110445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e275ad0-d491-4f95-b5bc-22b6ad7bb648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:06.112008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e275ad0-d491-4f95-b5bc-22b6ad7bb648 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:06.112700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e275ad0-d491-4f95-b5bc-22b6ad7bb648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:06.117571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f25aa-ddad-4b63-98e9-233f308c4291 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:06.118451 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f25aa-ddad-4b63-98e9-233f308c4291 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:06.119957 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f25aa-ddad-4b63-98e9-233f308c4291 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:06.120229 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f25aa-ddad-4b63-98e9-233f308c4291 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:06.121493 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e275ad0-d491-4f95-b5bc-22b6ad7bb648 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:06.144810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f25aa-ddad-4b63-98e9-233f308c4291 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:06.148530 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f25aa-ddad-4b63-98e9-233f308c4291 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:06.161527 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 944/1887] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:05 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:06.161527 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e275ad0-d491-4f95-b5bc-22b6ad7bb648 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:06.166209 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9e275ad0-d491-4f95-b5bc-22b6ad7bb648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:06.180088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 944/1888] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:06.180956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f25aa-ddad-4b63-98e9-233f308c4291 service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:06.189382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e275ad0-d491-4f95-b5bc-22b6ad7bb648 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:06.198301 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5e7d3-ae0a-4d87-9090-05f1f434b62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:06.198974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5e7d3-ae0a-4d87-9090-05f1f434b62f admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:06.199421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5e7d3-ae0a-4d87-9090-05f1f434b62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:06.199786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5e7d3-ae0a-4d87-9090-05f1f434b62f admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:06.200490 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5e7d3-ae0a-4d87-9090-05f1f434b62f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:06.203525 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5e7d3-ae0a-4d87-9090-05f1f434b62f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:06.205736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f25aa-ddad-4b63-98e9-233f308c4291 service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:06.217662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde30d23-ff42-447d-ad17-42e927c9f910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:06.218358 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde30d23-ff42-447d-ad17-42e927c9f910 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:06.218649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde30d23-ff42-447d-ad17-42e927c9f910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:06.218902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde30d23-ff42-447d-ad17-42e927c9f910 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:06.219882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde30d23-ff42-447d-ad17-42e927c9f910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:06.224632 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde30d23-ff42-447d-ad17-42e927c9f910 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:06.241502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 945/1889] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:06.245173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde30d23-ff42-447d-ad17-42e927c9f910 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:06.264503 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 945/1890] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:06 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:06.265740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5e7d3-ae0a-4d87-9090-05f1f434b62f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:06.275562 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde30d23-ff42-447d-ad17-42e927c9f910 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:06.280078 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:06.326385 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:06.424623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c6541-f688-4670-aa80-c24b7979efed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:06.427169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c6541-f688-4670-aa80-c24b7979efed admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:06.427468 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c6541-f688-4670-aa80-c24b7979efed admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:06.427749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c6541-f688-4670-aa80-c24b7979efed admin admin] PATH_INFO: `/v3/projects/6bf6b215e874414ca2deea7c2af97acd/users/db2456ddea1e49e082a4ae2bc262c802/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:06.429825 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5e7d3-ae0a-4d87-9090-05f1f434b62f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:06.441025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10011171-fe7b-4466-96d0-7e2cb92ece0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:06.441890 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10011171-fe7b-4466-96d0-7e2cb92ece0d admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:06.442429 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10011171-fe7b-4466-96d0-7e2cb92ece0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:06.442829 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10011171-fe7b-4466-96d0-7e2cb92ece0d admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:06.444575 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10011171-fe7b-4466-96d0-7e2cb92ece0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:06.447456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10011171-fe7b-4466-96d0-7e2cb92ece0d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:06.452434 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c6541-f688-4670-aa80-c24b7979efed admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf6b215e874414ca2deea7c2af97acd, user_id=db2456ddea1e49e082a4ae2bc262c802, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:06.460598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c6541-f688-4670-aa80-c24b7979efed admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:06.490307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 946/1891] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:06 2022] PUT /identity/v3/projects/6bf6b215e874414ca2deea7c2af97acd/users/db2456ddea1e49e082a4ae2bc262c802/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:06.490307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c6541-f688-4670-aa80-c24b7979efed admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:06.490722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-328c6541-f688-4670-aa80-c24b7979efed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:06.498144 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 946/1892] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:06 2022] POST /identity/v3/users => generated 299 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:06.500229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10011171-fe7b-4466-96d0-7e2cb92ece0d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:06.527273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10011171-fe7b-4466-96d0-7e2cb92ece0d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:06.634469 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c6541-f688-4670-aa80-c24b7979efed admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:06.645810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc30d86-29c5-4973-be15-82055f6a6732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:06.646740 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc30d86-29c5-4973-be15-82055f6a6732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:06.647024 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc30d86-29c5-4973-be15-82055f6a6732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:06.647294 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc30d86-29c5-4973-be15-82055f6a6732 admin admin] PATH_INFO: `/v3/projects/1148881a536f48068ad1bb9a23d48a4a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:06.650883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc30d86-29c5-4973-be15-82055f6a6732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1148881a536f48068ad1bb9a23d48a4a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:06.655370 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc30d86-29c5-4973-be15-82055f6a6732 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:06.741908 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432db43-192b-45c7-b119-07eaa8feb52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:06.742677 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432db43-192b-45c7-b119-07eaa8feb52f admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:06.743007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432db43-192b-45c7-b119-07eaa8feb52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:06.743288 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432db43-192b-45c7-b119-07eaa8feb52f admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:06.744868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432db43-192b-45c7-b119-07eaa8feb52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:06.747165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3fc30d86-29c5-4973-be15-82055f6a6732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1148881a536f48068ad1bb9a23d48a4a', 'request_id': 'req-3fc30d86-29c5-4973-be15-82055f6a6732'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:06.749142 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432db43-192b-45c7-b119-07eaa8feb52f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:06.757844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3fc30d86-29c5-4973-be15-82055f6a6732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1148881a536f48068ad1bb9a23d48a4a', 'request_id': 'req-3fc30d86-29c5-4973-be15-82055f6a6732'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:06.763894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 947/1893] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:06.765092 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432db43-192b-45c7-b119-07eaa8feb52f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:06.765729 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3fc30d86-29c5-4973-be15-82055f6a6732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1148881a536f48068ad1bb9a23d48a4a', 'request_id': 'req-3fc30d86-29c5-4973-be15-82055f6a6732'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:06.787413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432db43-192b-45c7-b119-07eaa8feb52f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:06.790764 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3fc30d86-29c5-4973-be15-82055f6a6732 admin admin] The token cache is being invalidate because project 1148881a536f48068ad1bb9a23d48a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:06.791061 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3fc30d86-29c5-4973-be15-82055f6a6732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:06.793890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3fc30d86-29c5-4973-be15-82055f6a6732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:06.800253 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 947/1894] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:06 2022] DELETE /identity/v3/projects/1148881a536f48068ad1bb9a23d48a4a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:06.800253 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc30d86-29c5-4973-be15-82055f6a6732 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:06.803517 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3fc30d86-29c5-4973-be15-82055f6a6732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:06.840328 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:06.901018 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f8acc-d0ef-46fd-9b38-c8b678779a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:06.902472 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f8acc-d0ef-46fd-9b38-c8b678779a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:06.903031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f8acc-d0ef-46fd-9b38-c8b678779a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:06.903662 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f8acc-d0ef-46fd-9b38-c8b678779a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:06.904667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f8acc-d0ef-46fd-9b38-c8b678779a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:06.906882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f8acc-d0ef-46fd-9b38-c8b678779a55 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:06.915362 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc30d86-29c5-4973-be15-82055f6a6732 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:06.921468 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957bcd0-f3b5-4eb5-9471-36b3393d9cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:06.922653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957bcd0-f3b5-4eb5-9471-36b3393d9cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:06.925502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957bcd0-f3b5-4eb5-9471-36b3393d9cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:06.925903 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957bcd0-f3b5-4eb5-9471-36b3393d9cd5 admin admin] PATH_INFO: `/v3/projects/6bf6b215e874414ca2deea7c2af97acd/users/db2456ddea1e49e082a4ae2bc262c802/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:06.928815 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957bcd0-f3b5-4eb5-9471-36b3393d9cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf6b215e874414ca2deea7c2af97acd, user_id=db2456ddea1e49e082a4ae2bc262c802, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:06.932234 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 948/1895] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:06.934647 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c188d8e-e082-48dc-aeec-1c1becf145a4 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:06.935135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c188d8e-e082-48dc-aeec-1c1becf145a4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:06.935630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c188d8e-e082-48dc-aeec-1c1becf145a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:06.938284 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957bcd0-f3b5-4eb5-9471-36b3393d9cd5 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:06.960176 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 948/1896] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:06 2022] PUT /identity/v3/projects/6bf6b215e874414ca2deea7c2af97acd/users/db2456ddea1e49e082a4ae2bc262c802/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:06.961089 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957bcd0-f3b5-4eb5-9471-36b3393d9cd5 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:06.963108 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4957bcd0-f3b5-4eb5-9471-36b3393d9cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:06.970217 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3c188d8e-e082-48dc-aeec-1c1becf145a4 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:06.972194 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3c188d8e-e082-48dc-aeec-1c1becf145a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:07.081618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:07.118437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957bcd0-f3b5-4eb5-9471-36b3393d9cd5 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:07.125600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 949/1897] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:07.125600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f79fb-5358-4935-b9c8-1eb1d7ca9de6 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:07.125600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f79fb-5358-4935-b9c8-1eb1d7ca9de6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:07.125600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f79fb-5358-4935-b9c8-1eb1d7ca9de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:07.134844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00e38f-65bc-488f-9eec-d56ab3395286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:07.136086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00e38f-65bc-488f-9eec-d56ab3395286 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:07.136794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00e38f-65bc-488f-9eec-d56ab3395286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:07.137486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00e38f-65bc-488f-9eec-d56ab3395286 admin admin] PATH_INFO: `/v3/projects/e09afcf72b8c4923a5b3b4efe98f8896/users/4cac485c7c274fccbb96e94618613672/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:07.158407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00e38f-65bc-488f-9eec-d56ab3395286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09afcf72b8c4923a5b3b4efe98f8896, user_id=4cac485c7c274fccbb96e94618613672, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:07.174427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00e38f-65bc-488f-9eec-d56ab3395286 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:07.195231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2a7f79fb-5358-4935-b9c8-1eb1d7ca9de6 None None] MFA Rules not processed for user `db2456ddea1e49e082a4ae2bc262c802`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:07.197487 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2a7f79fb-5358-4935-b9c8-1eb1d7ca9de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:07.203097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 949/1898] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:06 2022] PUT /identity/v3/projects/e09afcf72b8c4923a5b3b4efe98f8896/users/4cac485c7c274fccbb96e94618613672/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:07.204643 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445f579-88b4-4730-b1d5-53f963726952 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:07.205117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445f579-88b4-4730-b1d5-53f963726952 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:07.207735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445f579-88b4-4730-b1d5-53f963726952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:07.239902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1445f579-88b4-4730-b1d5-53f963726952 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:07.241970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1445f579-88b4-4730-b1d5-53f963726952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:07.341093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 950/1899] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:07.342319 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445f579-88b4-4730-b1d5-53f963726952 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:07.368911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445f579-88b4-4730-b1d5-53f963726952 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:07.375169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a818657-6fe3-4808-a06f-30afa32ecb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:07.376685 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a818657-6fe3-4808-a06f-30afa32ecb35 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:07.376685 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a818657-6fe3-4808-a06f-30afa32ecb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:07.377194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a818657-6fe3-4808-a06f-30afa32ecb35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:07.380226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a818657-6fe3-4808-a06f-30afa32ecb35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:07.383194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a818657-6fe3-4808-a06f-30afa32ecb35 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:07.390336 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 950/1900] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:07.390336 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f79fb-5358-4935-b9c8-1eb1d7ca9de6 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:07.408651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 951/1901] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:07.411026 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f79fb-5358-4935-b9c8-1eb1d7ca9de6 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:07.414769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a818657-6fe3-4808-a06f-30afa32ecb35 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:07.417211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7a818657-6fe3-4808-a06f-30afa32ecb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:07.427597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff623ee-aab5-45e9-a139-e7589335faac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:07.428594 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff623ee-aab5-45e9-a139-e7589335faac admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:07.431894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff623ee-aab5-45e9-a139-e7589335faac admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:07.432721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff623ee-aab5-45e9-a139-e7589335faac admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:07.433155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff623ee-aab5-45e9-a139-e7589335faac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:07.433609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff623ee-aab5-45e9-a139-e7589335faac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:07.435307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff623ee-aab5-45e9-a139-e7589335faac admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:07.470140 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 951/1902] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:02:07.471147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff623ee-aab5-45e9-a139-e7589335faac admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:07.507284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff623ee-aab5-45e9-a139-e7589335faac admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:07.524342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:07.527896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5c256-ed0c-46f8-a8f3-c7a3a1331605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:07.530006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5c256-ed0c-46f8-a8f3-c7a3a1331605 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:07.530006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5c256-ed0c-46f8-a8f3-c7a3a1331605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:07.530006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5c256-ed0c-46f8-a8f3-c7a3a1331605 admin admin] PATH_INFO: `/v3/projects/e09afcf72b8c4923a5b3b4efe98f8896/users/4cac485c7c274fccbb96e94618613672/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:07.538354 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5c256-ed0c-46f8-a8f3-c7a3a1331605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09afcf72b8c4923a5b3b4efe98f8896, user_id=4cac485c7c274fccbb96e94618613672, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:07.542355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5c256-ed0c-46f8-a8f3-c7a3a1331605 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:07.579689 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 952/1903] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:07 2022] PUT /identity/v3/projects/e09afcf72b8c4923a5b3b4efe98f8896/users/4cac485c7c274fccbb96e94618613672/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:07.580072 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5c256-ed0c-46f8-a8f3-c7a3a1331605 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:07.612147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a818657-6fe3-4808-a06f-30afa32ecb35 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:07.691627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da01bd-534a-43ab-aaea-6f67d4b1b6ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:07.692661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da01bd-534a-43ab-aaea-6f67d4b1b6ad service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:07.693046 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da01bd-534a-43ab-aaea-6f67d4b1b6ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:07.693415 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da01bd-534a-43ab-aaea-6f67d4b1b6ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:07.711791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5c256-ed0c-46f8-a8f3-c7a3a1331605 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:07.723184 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cc793-462a-4378-965b-4756be2243bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:07.723861 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cc793-462a-4378-965b-4756be2243bb admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:07.724143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cc793-462a-4378-965b-4756be2243bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:07.726057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cc793-462a-4378-965b-4756be2243bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:07.728510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cc793-462a-4378-965b-4756be2243bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:07.731446 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cc793-462a-4378-965b-4756be2243bb admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:07.773511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 953/1904] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:07 2022] POST /identity/v3/projects => generated 367 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:07.775064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e588d-9f33-4035-9409-b2612a2ed54f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:07.775477 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e588d-9f33-4035-9409-b2612a2ed54f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:07.775825 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e588d-9f33-4035-9409-b2612a2ed54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:07.797105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da01bd-534a-43ab-aaea-6f67d4b1b6ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:07.799120 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da01bd-534a-43ab-aaea-6f67d4b1b6ad service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:07.804947 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d35e588d-9f33-4035-9409-b2612a2ed54f None None] MFA Rules not processed for user `4cac485c7c274fccbb96e94618613672`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:07.806902 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d35e588d-9f33-4035-9409-b2612a2ed54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:07.811756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 952/1905] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:07.812918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da01bd-534a-43ab-aaea-6f67d4b1b6ad service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:07.828519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da01bd-534a-43ab-aaea-6f67d4b1b6ad service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:07.866425 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:07.961110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a6bfa-471b-4cc5-a8ea-044427e76a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:07.963032 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6bfa-471b-4cc5-a8ea-044427e76a38 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:07.964283 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6bfa-471b-4cc5-a8ea-044427e76a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:07.964662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6bfa-471b-4cc5-a8ea-044427e76a38 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:07.967886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a6bfa-471b-4cc5-a8ea-044427e76a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:07.969172 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a6bfa-471b-4cc5-a8ea-044427e76a38 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:07.977806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 954/1906] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:07.987546 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e588d-9f33-4035-9409-b2612a2ed54f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:08.020275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 953/1907] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:07 2022] POST /identity/v3/users => generated 284 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:08.022298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a6bfa-471b-4cc5-a8ea-044427e76a38 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:08.046149 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a6bfa-471b-4cc5-a8ea-044427e76a38 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:08.069181 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba007cc-bdaa-49e5-912a-b82b81765c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:08.069913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba007cc-bdaa-49e5-912a-b82b81765c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:08.070214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba007cc-bdaa-49e5-912a-b82b81765c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:08.071852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba007cc-bdaa-49e5-912a-b82b81765c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:08.074098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba007cc-bdaa-49e5-912a-b82b81765c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:08.075688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba007cc-bdaa-49e5-912a-b82b81765c16 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:08.095165 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e588d-9f33-4035-9409-b2612a2ed54f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:08.106860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef457cbc-600a-4963-b968-4c992b5c5c4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:08.107871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef457cbc-600a-4963-b968-4c992b5c5c4b service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:08.108300 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef457cbc-600a-4963-b968-4c992b5c5c4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:08.109688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef457cbc-600a-4963-b968-4c992b5c5c4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:08.113400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 954/1908] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:02:08.114919 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba007cc-bdaa-49e5-912a-b82b81765c16 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:08.128587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef457cbc-600a-4963-b968-4c992b5c5c4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:08.130593 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef457cbc-600a-4963-b968-4c992b5c5c4b service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:08.132782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba007cc-bdaa-49e5-912a-b82b81765c16 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:08.141387 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ff7e1-f7e7-404b-bf4c-9ffc679a25c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:08.142202 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff7e1-f7e7-404b-bf4c-9ffc679a25c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:08.142674 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff7e1-f7e7-404b-bf4c-9ffc679a25c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:08.142977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff7e1-f7e7-404b-bf4c-9ffc679a25c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:08.143771 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ff7e1-f7e7-404b-bf4c-9ffc679a25c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:08.148672 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 955/1909] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:08.150660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ff7e1-f7e7-404b-bf4c-9ffc679a25c2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:08.156673 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:08.168657 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 955/1910] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:08.172184 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef457cbc-600a-4963-b968-4c992b5c5c4b service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:08.191608 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef457cbc-600a-4963-b968-4c992b5c5c4b service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:08.197303 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330986c-e888-4042-91c2-884308146bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:08.198237 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330986c-e888-4042-91c2-884308146bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:08.198688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330986c-e888-4042-91c2-884308146bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:08.199080 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330986c-e888-4042-91c2-884308146bf7 admin admin] PATH_INFO: `/v3/projects/14e77a383e3540a2bce30b5a78b1dfd5/users/935799ab1b7b4774a1ce8f3310af0896/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:08.243732 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330986c-e888-4042-91c2-884308146bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e77a383e3540a2bce30b5a78b1dfd5, user_id=935799ab1b7b4774a1ce8f3310af0896, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:08.246708 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330986c-e888-4042-91c2-884308146bf7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:08.267882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 956/1911] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:08 2022] PUT /identity/v3/projects/14e77a383e3540a2bce30b5a78b1dfd5/users/935799ab1b7b4774a1ce8f3310af0896/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:08.279957 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864b111-12b6-4070-8414-2be085c26c4f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:08.280265 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864b111-12b6-4070-8414-2be085c26c4f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:08.280522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864b111-12b6-4070-8414-2be085c26c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:08.317063 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8864b111-12b6-4070-8414-2be085c26c4f None None] MFA Rules not processed for user `935799ab1b7b4774a1ce8f3310af0896`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:08.318826 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8864b111-12b6-4070-8414-2be085c26c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:08.408379 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 956/1912] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:08.414243 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330986c-e888-4042-91c2-884308146bf7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:08.529577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864b111-12b6-4070-8414-2be085c26c4f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:08.594403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330986c-e888-4042-91c2-884308146bf7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:08.605171 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd39a3-1cc1-4eba-a0b3-6b6901628ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:08.607621 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd39a3-1cc1-4eba-a0b3-6b6901628ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:08.607973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd39a3-1cc1-4eba-a0b3-6b6901628ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:08.608186 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd39a3-1cc1-4eba-a0b3-6b6901628ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:08.608924 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd39a3-1cc1-4eba-a0b3-6b6901628ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:08.612186 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd39a3-1cc1-4eba-a0b3-6b6901628ec8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:08.653029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864b111-12b6-4070-8414-2be085c26c4f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:08.659297 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ad9ca-a8f4-496a-8a2d-c9c9af65baee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:08.660819 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ad9ca-a8f4-496a-8a2d-c9c9af65baee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:08.661128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ad9ca-a8f4-496a-8a2d-c9c9af65baee admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:08.661373 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ad9ca-a8f4-496a-8a2d-c9c9af65baee admin admin] PATH_INFO: `/v3/users/c49c7b1c16934b7db8080822fee80c07` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:08.662798 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ad9ca-a8f4-496a-8a2d-c9c9af65baee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c49c7b1c16934b7db8080822fee80c07)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:08.665110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ad9ca-a8f4-496a-8a2d-c9c9af65baee admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:08.666044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 957/1913] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:08 2022] POST /identity/v3/projects => generated 365 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:08.670491 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd39a3-1cc1-4eba-a0b3-6b6901628ec8 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:08.707401 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:08.799548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd39a3-1cc1-4eba-a0b3-6b6901628ec8 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:08.819290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e223f-989c-46a9-889d-dba076ca2157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:08.821038 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e223f-989c-46a9-889d-dba076ca2157 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:08.822061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e223f-989c-46a9-889d-dba076ca2157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:08.822343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e223f-989c-46a9-889d-dba076ca2157 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:08.823051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e223f-989c-46a9-889d-dba076ca2157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:08.825966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e223f-989c-46a9-889d-dba076ca2157 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:08.827460 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-157ad9ca-a8f4-496a-8a2d-c9c9af65baee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c49c7b1c16934b7db8080822fee80c07'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:08.841336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-157ad9ca-a8f4-496a-8a2d-c9c9af65baee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c49c7b1c16934b7db8080822fee80c07'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:08.859886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-157ad9ca-a8f4-496a-8a2d-c9c9af65baee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c49c7b1c16934b7db8080822fee80c07'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:08.860582 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-157ad9ca-a8f4-496a-8a2d-c9c9af65baee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c49c7b1c16934b7db8080822fee80c07'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:08.861282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-157ad9ca-a8f4-496a-8a2d-c9c9af65baee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c49c7b1c16934b7db8080822fee80c07'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:08.873803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 958/1914] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:08 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:02:08.879571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e223f-989c-46a9-889d-dba076ca2157 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:08.881013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-047e223f-989c-46a9-889d-dba076ca2157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:08.891427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 957/1915] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:08 2022] DELETE /identity/v3/users/c49c7b1c16934b7db8080822fee80c07 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:08.896796 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492aa701-2e94-4c6d-b52f-848d0bf71a94 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:08.898151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492aa701-2e94-4c6d-b52f-848d0bf71a94 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:08.898440 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492aa701-2e94-4c6d-b52f-848d0bf71a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:08.898694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e223f-989c-46a9-889d-dba076ca2157 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:08.936851 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-492aa701-2e94-4c6d-b52f-848d0bf71a94 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:08.938101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-492aa701-2e94-4c6d-b52f-848d0bf71a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:08.943417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:09.015457 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8b21c-74f2-4832-ac65-d699a184c619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:09.015925 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8b21c-74f2-4832-ac65-d699a184c619 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:09.016155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8b21c-74f2-4832-ac65-d699a184c619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:09.016433 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8b21c-74f2-4832-ac65-d699a184c619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:09.017854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8b21c-74f2-4832-ac65-d699a184c619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:09.026132 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8b21c-74f2-4832-ac65-d699a184c619 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:09.055907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 959/1916] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:09.058622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8b21c-74f2-4832-ac65-d699a184c619 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:09.077259 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8b21c-74f2-4832-ac65-d699a184c619 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:09.094224 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d076f-2340-4c03-915d-fc769c2054ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:09.095132 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d076f-2340-4c03-915d-fc769c2054ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:09.095410 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d076f-2340-4c03-915d-fc769c2054ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:09.095771 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d076f-2340-4c03-915d-fc769c2054ce admin admin] PATH_INFO: `/v3/projects/c08792d665ba4787afa67c57bc1e8d42/users/7762e769e2af40618719d75b2c0487c7/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:09.120064 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 958/1917] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:09.126929 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492aa701-2e94-4c6d-b52f-848d0bf71a94 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:09.128615 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-492aa701-2e94-4c6d-b52f-848d0bf71a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:09.138107 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d076f-2340-4c03-915d-fc769c2054ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08792d665ba4787afa67c57bc1e8d42, user_id=7762e769e2af40618719d75b2c0487c7, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:09.141660 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d076f-2340-4c03-915d-fc769c2054ce admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:09.166152 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 960/1918] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:09 2022] PUT /identity/v3/projects/c08792d665ba4787afa67c57bc1e8d42/users/7762e769e2af40618719d75b2c0487c7/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:09.182263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d076f-2340-4c03-915d-fc769c2054ce admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:09.228819 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492aa701-2e94-4c6d-b52f-848d0bf71a94 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:09.309663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c71969-bd5a-4b8a-bcf2-bd114aac804a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:09.311360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c71969-bd5a-4b8a-bcf2-bd114aac804a service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:09.312077 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c71969-bd5a-4b8a-bcf2-bd114aac804a service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:09.312552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c71969-bd5a-4b8a-bcf2-bd114aac804a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:09.315025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d076f-2340-4c03-915d-fc769c2054ce admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:09.322051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbb991-556c-4309-93e1-bd89084f6e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:09.323260 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbb991-556c-4309-93e1-bd89084f6e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:09.323618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbb991-556c-4309-93e1-bd89084f6e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:09.323967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbb991-556c-4309-93e1-bd89084f6e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:09.324925 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbb991-556c-4309-93e1-bd89084f6e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:09.327379 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c71969-bd5a-4b8a-bcf2-bd114aac804a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:09.327524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbb991-556c-4309-93e1-bd89084f6e91 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:09.329484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c71969-bd5a-4b8a-bcf2-bd114aac804a service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:09.344860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 961/1919] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:09.346073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbb991-556c-4309-93e1-bd89084f6e91 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:09.356010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b4cbb991-556c-4309-93e1-bd89084f6e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:09.356546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 959/1920] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:09.357503 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c71969-bd5a-4b8a-bcf2-bd114aac804a service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:09.380173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c71969-bd5a-4b8a-bcf2-bd114aac804a service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:09.395160 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b4064-5caf-4ccb-bd5c-76fe14c950f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:09.398099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b4064-5caf-4ccb-bd5c-76fe14c950f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:09.398470 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b4064-5caf-4ccb-bd5c-76fe14c950f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:09.398940 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b4064-5caf-4ccb-bd5c-76fe14c950f8 admin admin] PATH_INFO: `/v3/projects/c08792d665ba4787afa67c57bc1e8d42/users/7762e769e2af40618719d75b2c0487c7/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:09.402254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b4064-5caf-4ccb-bd5c-76fe14c950f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08792d665ba4787afa67c57bc1e8d42, user_id=7762e769e2af40618719d75b2c0487c7, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:09.405995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b4064-5caf-4ccb-bd5c-76fe14c950f8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:09.415243 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:09.448235 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 960/1921] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:09 2022] PUT /identity/v3/projects/c08792d665ba4787afa67c57bc1e8d42/users/7762e769e2af40618719d75b2c0487c7/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:09.454662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5b078-f578-4f93-983e-a88c2f48bddc None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:09.457699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5b078-f578-4f93-983e-a88c2f48bddc None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:09.457838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5b078-f578-4f93-983e-a88c2f48bddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:09.519493 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbb991-556c-4309-93e1-bd89084f6e91 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:09.536024 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-fba5b078-f578-4f93-983e-a88c2f48bddc None None] MFA Rules not processed for user `7762e769e2af40618719d75b2c0487c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:09.537291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fba5b078-f578-4f93-983e-a88c2f48bddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:09.594817 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacf6c5-8ebd-409c-899e-b39d11bfe0df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:09.595767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:09.596967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacf6c5-8ebd-409c-899e-b39d11bfe0df service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:09.596967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacf6c5-8ebd-409c-899e-b39d11bfe0df service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:09.596967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacf6c5-8ebd-409c-899e-b39d11bfe0df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:09.616426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1aacf6c5-8ebd-409c-899e-b39d11bfe0df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:09.635254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 961/1922] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:09.648011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5b078-f578-4f93-983e-a88c2f48bddc None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:09.650237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fba5b078-f578-4f93-983e-a88c2f48bddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:09.670189 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5b078-f578-4f93-983e-a88c2f48bddc None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:09.674332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cf497-14e8-4606-9f47-9f5524a009b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:09.675086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cf497-14e8-4606-9f47-9f5524a009b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:09.675970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cf497-14e8-4606-9f47-9f5524a009b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:09.676318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cf497-14e8-4606-9f47-9f5524a009b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:09.686961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cf497-14e8-4606-9f47-9f5524a009b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:09.688528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cf497-14e8-4606-9f47-9f5524a009b9 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:09.700190 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 962/1923] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:09.736391 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacf6c5-8ebd-409c-899e-b39d11bfe0df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:09.739775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacf6c5-8ebd-409c-899e-b39d11bfe0df service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:09.761273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 962/1924] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:09.799561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cf497-14e8-4606-9f47-9f5524a009b9 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:09.801706 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4e5cf497-14e8-4606-9f47-9f5524a009b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:09.853851 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacf6c5-8ebd-409c-899e-b39d11bfe0df service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:09.882442 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacf6c5-8ebd-409c-899e-b39d11bfe0df service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:09.909542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556fef4-8c73-4cb0-97bd-3b2dad093d6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:09.911168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556fef4-8c73-4cb0-97bd-3b2dad093d6a service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:09.911505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556fef4-8c73-4cb0-97bd-3b2dad093d6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:09.911730 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556fef4-8c73-4cb0-97bd-3b2dad093d6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:09.919787 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e556fef4-8c73-4cb0-97bd-3b2dad093d6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:10.014313 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cf497-14e8-4606-9f47-9f5524a009b9 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:10.019735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c8df9-6667-499f-8f35-48a0bf3f97b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:10.020764 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c8df9-6667-499f-8f35-48a0bf3f97b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:10.021282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c8df9-6667-499f-8f35-48a0bf3f97b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:10.021730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c8df9-6667-499f-8f35-48a0bf3f97b4 admin admin] PATH_INFO: `/v3/projects/5c6e3caf44bf4da99d7f617299f2f3c6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:10.023347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c8df9-6667-499f-8f35-48a0bf3f97b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c6e3caf44bf4da99d7f617299f2f3c6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:10.027902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c8df9-6667-499f-8f35-48a0bf3f97b4 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:10.087024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556fef4-8c73-4cb0-97bd-3b2dad093d6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:10.089550 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556fef4-8c73-4cb0-97bd-3b2dad093d6a service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:10.115564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 963/1925] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:02:10.136674 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-392c8df9-6667-499f-8f35-48a0bf3f97b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c6e3caf44bf4da99d7f617299f2f3c6', 'request_id': 'req-392c8df9-6667-499f-8f35-48a0bf3f97b4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:10.149375 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-392c8df9-6667-499f-8f35-48a0bf3f97b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c6e3caf44bf4da99d7f617299f2f3c6', 'request_id': 'req-392c8df9-6667-499f-8f35-48a0bf3f97b4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:10.157987 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-392c8df9-6667-499f-8f35-48a0bf3f97b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c6e3caf44bf4da99d7f617299f2f3c6', 'request_id': 'req-392c8df9-6667-499f-8f35-48a0bf3f97b4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:10.192573 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-392c8df9-6667-499f-8f35-48a0bf3f97b4 admin admin] The token cache is being invalidate because project 5c6e3caf44bf4da99d7f617299f2f3c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:10.193065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-392c8df9-6667-499f-8f35-48a0bf3f97b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:10.194275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-392c8df9-6667-499f-8f35-48a0bf3f97b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:10.196806 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 963/1926] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:09 2022] DELETE /identity/v3/projects/5c6e3caf44bf4da99d7f617299f2f3c6 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:10.200918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556fef4-8c73-4cb0-97bd-3b2dad093d6a service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:10.212786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556fef4-8c73-4cb0-97bd-3b2dad093d6a service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:10.246621 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:10.377510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f281926-a623-4a14-baae-e94ee85ea1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:10.378961 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f281926-a623-4a14-baae-e94ee85ea1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:10.379403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f281926-a623-4a14-baae-e94ee85ea1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:10.381405 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f281926-a623-4a14-baae-e94ee85ea1da admin admin] PATH_INFO: `/v3/users/db2456ddea1e49e082a4ae2bc262c802` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:10.384882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f281926-a623-4a14-baae-e94ee85ea1da admin admin] RBAC: Authorizing `identity:delete_user(user_id=db2456ddea1e49e082a4ae2bc262c802)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:10.389913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f281926-a623-4a14-baae-e94ee85ea1da admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:10.460626 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6f281926-a623-4a14-baae-e94ee85ea1da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db2456ddea1e49e082a4ae2bc262c802'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:10.481431 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6f281926-a623-4a14-baae-e94ee85ea1da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db2456ddea1e49e082a4ae2bc262c802'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:10.484993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6f281926-a623-4a14-baae-e94ee85ea1da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db2456ddea1e49e082a4ae2bc262c802'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:10.498334 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6f281926-a623-4a14-baae-e94ee85ea1da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db2456ddea1e49e082a4ae2bc262c802'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:10.499226 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6f281926-a623-4a14-baae-e94ee85ea1da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db2456ddea1e49e082a4ae2bc262c802'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:10.529032 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 964/1927] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:10 2022] DELETE /identity/v3/users/db2456ddea1e49e082a4ae2bc262c802 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:10.855211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c8df9-6667-499f-8f35-48a0bf3f97b4 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:10.857046 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-392c8df9-6667-499f-8f35-48a0bf3f97b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:10.880203 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c8df9-6667-499f-8f35-48a0bf3f97b4 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:10.943210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:10.949956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05af4f-b456-46df-b291-588a1023a15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:10.950846 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05af4f-b456-46df-b291-588a1023a15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:10.951463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05af4f-b456-46df-b291-588a1023a15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:10.952050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05af4f-b456-46df-b291-588a1023a15d admin admin] PATH_INFO: `/v3/projects/6bf6b215e874414ca2deea7c2af97acd` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:10.954710 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05af4f-b456-46df-b291-588a1023a15d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf6b215e874414ca2deea7c2af97acd)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:10.958109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05af4f-b456-46df-b291-588a1023a15d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:11.011367 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5f05af4f-b456-46df-b291-588a1023a15d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf6b215e874414ca2deea7c2af97acd', 'request_id': 'req-5f05af4f-b456-46df-b291-588a1023a15d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:11.017759 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5f05af4f-b456-46df-b291-588a1023a15d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf6b215e874414ca2deea7c2af97acd', 'request_id': 'req-5f05af4f-b456-46df-b291-588a1023a15d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:11.024046 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5f05af4f-b456-46df-b291-588a1023a15d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf6b215e874414ca2deea7c2af97acd', 'request_id': 'req-5f05af4f-b456-46df-b291-588a1023a15d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:11.046451 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5f05af4f-b456-46df-b291-588a1023a15d admin admin] The token cache is being invalidate because project 6bf6b215e874414ca2deea7c2af97acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:11.046815 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5f05af4f-b456-46df-b291-588a1023a15d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:11.047511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5f05af4f-b456-46df-b291-588a1023a15d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:11.049178 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 964/1928] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:10 2022] DELETE /identity/v3/projects/6bf6b215e874414ca2deea7c2af97acd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:11.054525 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62e84a-0aca-487a-8865-26295a14c3d8 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:11.054888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62e84a-0aca-487a-8865-26295a14c3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:11.055240 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62e84a-0aca-487a-8865-26295a14c3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:11.074995 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ca62e84a-0aca-487a-8865-26295a14c3d8 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:11.076357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ca62e84a-0aca-487a-8865-26295a14c3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:11.138523 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 965/1929] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:11.145911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6549a4-c51e-4f6e-90f7-6a2403623ca1 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:11.146373 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6549a4-c51e-4f6e-90f7-6a2403623ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:11.146498 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6549a4-c51e-4f6e-90f7-6a2403623ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:11.164483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ab6549a4-c51e-4f6e-90f7-6a2403623ca1 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:11.165690 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ab6549a4-c51e-4f6e-90f7-6a2403623ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:11.174820 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 965/1930] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:11.180197 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62e84a-0aca-487a-8865-26295a14c3d8 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:11.190009 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62e84a-0aca-487a-8865-26295a14c3d8 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:11.195124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb572d-e160-4229-a81b-6481f581bdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:11.195786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb572d-e160-4229-a81b-6481f581bdbc admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:11.196072 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb572d-e160-4229-a81b-6481f581bdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:11.196352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb572d-e160-4229-a81b-6481f581bdbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:11.197078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb572d-e160-4229-a81b-6481f581bdbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:11.197384 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb572d-e160-4229-a81b-6481f581bdbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:11.199022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb572d-e160-4229-a81b-6481f581bdbc admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:11.212104 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 966/1931] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:02:11.221980 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6549a4-c51e-4f6e-90f7-6a2403623ca1 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:11.232884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6549a4-c51e-4f6e-90f7-6a2403623ca1 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:11.239262 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ddb40-ae91-4792-bcdd-67643f2d8074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:11.239863 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ddb40-ae91-4792-bcdd-67643f2d8074 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:11.240149 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ddb40-ae91-4792-bcdd-67643f2d8074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:11.240425 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ddb40-ae91-4792-bcdd-67643f2d8074 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:11.241277 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ddb40-ae91-4792-bcdd-67643f2d8074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:11.243345 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ddb40-ae91-4792-bcdd-67643f2d8074 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:11.282981 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 966/1932] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:11 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:11.288038 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb572d-e160-4229-a81b-6481f581bdbc admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:11.303331 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb572d-e160-4229-a81b-6481f581bdbc admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:11.384172 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:11.432463 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6acdbc-f0ad-4cb5-9f2b-ec865ffb3558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:11.433809 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6acdbc-f0ad-4cb5-9f2b-ec865ffb3558 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:11.434130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6acdbc-f0ad-4cb5-9f2b-ec865ffb3558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:11.435068 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6acdbc-f0ad-4cb5-9f2b-ec865ffb3558 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:11.435210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6acdbc-f0ad-4cb5-9f2b-ec865ffb3558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:11.437735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6acdbc-f0ad-4cb5-9f2b-ec865ffb3558 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:11.463388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 967/1933] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:11 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:11.466875 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ddb40-ae91-4792-bcdd-67643f2d8074 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:11.484853 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ddb40-ae91-4792-bcdd-67643f2d8074 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:11.497142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5affb4c-80be-409b-a4ff-fe322fcc3944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:11.498105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5affb4c-80be-409b-a4ff-fe322fcc3944 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:11.499931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5affb4c-80be-409b-a4ff-fe322fcc3944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:11.500326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5affb4c-80be-409b-a4ff-fe322fcc3944 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:11.501207 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5affb4c-80be-409b-a4ff-fe322fcc3944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:11.505669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5affb4c-80be-409b-a4ff-fe322fcc3944 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:11.530132 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 967/1934] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:11.534279 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6acdbc-f0ad-4cb5-9f2b-ec865ffb3558 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:11.547203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6acdbc-f0ad-4cb5-9f2b-ec865ffb3558 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:11.552626 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfd168-2735-4645-8371-749fa77aff06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:11.553484 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfd168-2735-4645-8371-749fa77aff06 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:11.553905 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfd168-2735-4645-8371-749fa77aff06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:11.554221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfd168-2735-4645-8371-749fa77aff06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:11.554959 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfd168-2735-4645-8371-749fa77aff06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:11.556651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfd168-2735-4645-8371-749fa77aff06 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:11.571567 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 968/1935] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:11.572899 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5affb4c-80be-409b-a4ff-fe322fcc3944 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:11.583568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5affb4c-80be-409b-a4ff-fe322fcc3944 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:11.588976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300a1af-f29c-40d3-9011-fe601179580b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:11.589898 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300a1af-f29c-40d3-9011-fe601179580b admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:11.590212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300a1af-f29c-40d3-9011-fe601179580b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:11.590531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300a1af-f29c-40d3-9011-fe601179580b admin admin] PATH_INFO: `/v3/projects/4494902efea946499a6a98a17e7e4dc5/users/2dec4c5577ea4d1bbb49ae57fa568d4f/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:11.638755 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300a1af-f29c-40d3-9011-fe601179580b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4494902efea946499a6a98a17e7e4dc5, user_id=2dec4c5577ea4d1bbb49ae57fa568d4f, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:11.642345 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300a1af-f29c-40d3-9011-fe601179580b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:11.672506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 968/1936] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:11 2022] PUT /identity/v3/projects/4494902efea946499a6a98a17e7e4dc5/users/2dec4c5577ea4d1bbb49ae57fa568d4f/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:11.673692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c6bc3-f1e5-4a7c-b72d-fd770f0e0ca1 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:11.674003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c6bc3-f1e5-4a7c-b72d-fd770f0e0ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:11.674510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c6bc3-f1e5-4a7c-b72d-fd770f0e0ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:11.749538 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-790c6bc3-f1e5-4a7c-b72d-fd770f0e0ca1 None None] MFA Rules not processed for user `2dec4c5577ea4d1bbb49ae57fa568d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:11.750866 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-790c6bc3-f1e5-4a7c-b72d-fd770f0e0ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:11.883815 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 969/1937] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:11.888246 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300a1af-f29c-40d3-9011-fe601179580b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:12.046678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300a1af-f29c-40d3-9011-fe601179580b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:12.069556 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166d30b-3921-427a-9aa2-aed200f315a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:12.070272 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166d30b-3921-427a-9aa2-aed200f315a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:12.070554 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166d30b-3921-427a-9aa2-aed200f315a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:12.070828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166d30b-3921-427a-9aa2-aed200f315a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:12.071525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166d30b-3921-427a-9aa2-aed200f315a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:12.077618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166d30b-3921-427a-9aa2-aed200f315a1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:12.148735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 969/1938] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:11 2022] POST /identity/v3/projects => generated 381 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:12.150030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c6bc3-f1e5-4a7c-b72d-fd770f0e0ca1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:12.174509 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c6bc3-f1e5-4a7c-b72d-fd770f0e0ca1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:12.295787 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ab570-f805-4a94-a1af-3dfe476115b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:12.296442 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ab570-f805-4a94-a1af-3dfe476115b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:12.296878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ab570-f805-4a94-a1af-3dfe476115b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:12.297226 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ab570-f805-4a94-a1af-3dfe476115b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:12.298019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ab570-f805-4a94-a1af-3dfe476115b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:12.300038 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ab570-f805-4a94-a1af-3dfe476115b4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:12.322735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 970/1939] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:12 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:12.326466 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166d30b-3921-427a-9aa2-aed200f315a1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:12.338941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166d30b-3921-427a-9aa2-aed200f315a1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:12.345322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23982cf5-8a0c-4ff4-a1e1-be1e68c5cb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:12.346155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23982cf5-8a0c-4ff4-a1e1-be1e68c5cb8a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:12.346406 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23982cf5-8a0c-4ff4-a1e1-be1e68c5cb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:12.346676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23982cf5-8a0c-4ff4-a1e1-be1e68c5cb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:12.348150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23982cf5-8a0c-4ff4-a1e1-be1e68c5cb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:12.350525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23982cf5-8a0c-4ff4-a1e1-be1e68c5cb8a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:12.353831 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:12.376126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 970/1940] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:12.387451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ab570-f805-4a94-a1af-3dfe476115b4 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:12.401692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ab570-f805-4a94-a1af-3dfe476115b4 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:12.408963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c5459-c724-4aa1-be79-566fe741618d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:12.410743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c5459-c724-4aa1-be79-566fe741618d admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:12.411029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c5459-c724-4aa1-be79-566fe741618d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:12.411315 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c5459-c724-4aa1-be79-566fe741618d admin admin] PATH_INFO: `/v3/projects/276df7ef0d1945b3979f896182caf351/users/2997cc1b13134e4fa665679027bda87c/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:12.431443 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c5459-c724-4aa1-be79-566fe741618d admin admin] RBAC: Authorizing `identity:create_grant(project_id=276df7ef0d1945b3979f896182caf351, user_id=2997cc1b13134e4fa665679027bda87c, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:12.434187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c5459-c724-4aa1-be79-566fe741618d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:12.449521 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 971/1941] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:12 2022] PUT /identity/v3/projects/276df7ef0d1945b3979f896182caf351/users/2997cc1b13134e4fa665679027bda87c/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:12.453707 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23982cf5-8a0c-4ff4-a1e1-be1e68c5cb8a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:12.464948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23982cf5-8a0c-4ff4-a1e1-be1e68c5cb8a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:12.541548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea6d9b-748f-463d-8b42-af88a21497f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:12.542247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea6d9b-748f-463d-8b42-af88a21497f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:12.542557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea6d9b-748f-463d-8b42-af88a21497f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:12.542834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea6d9b-748f-463d-8b42-af88a21497f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:12.543556 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea6d9b-748f-463d-8b42-af88a21497f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:12.545155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea6d9b-748f-463d-8b42-af88a21497f7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:12.556881 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 971/1942] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:12.561560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c5459-c724-4aa1-be79-566fe741618d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:12.572219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c5459-c724-4aa1-be79-566fe741618d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:12.577137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bd8e6-4707-4e58-9eaa-a78aa4297251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:12.578130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bd8e6-4707-4e58-9eaa-a78aa4297251 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:12.578409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bd8e6-4707-4e58-9eaa-a78aa4297251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:12.578706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bd8e6-4707-4e58-9eaa-a78aa4297251 admin admin] PATH_INFO: `/v3/projects/276df7ef0d1945b3979f896182caf351/users/2997cc1b13134e4fa665679027bda87c/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:12.580647 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bd8e6-4707-4e58-9eaa-a78aa4297251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276df7ef0d1945b3979f896182caf351, user_id=2997cc1b13134e4fa665679027bda87c, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:12.583840 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bd8e6-4707-4e58-9eaa-a78aa4297251 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:12.586151 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:12.595484 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 972/1943] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:12 2022] PUT /identity/v3/projects/276df7ef0d1945b3979f896182caf351/users/2997cc1b13134e4fa665679027bda87c/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:12.607687 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10385de-4993-4554-b071-2703f5fd11ef None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:12.607977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10385de-4993-4554-b071-2703f5fd11ef None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:12.608260 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10385de-4993-4554-b071-2703f5fd11ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:12.634192 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e10385de-4993-4554-b071-2703f5fd11ef None None] MFA Rules not processed for user `2997cc1b13134e4fa665679027bda87c`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:12.635389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e10385de-4993-4554-b071-2703f5fd11ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:12.705583 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 972/1944] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:12.717787 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bd8e6-4707-4e58-9eaa-a78aa4297251 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:12.719481 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-af2bd8e6-4707-4e58-9eaa-a78aa4297251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:12.776694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bd8e6-4707-4e58-9eaa-a78aa4297251 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:12.780383 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e993d1a-4054-452f-8f97-6f8b8b842010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:12.781042 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e993d1a-4054-452f-8f97-6f8b8b842010 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:12.781324 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e993d1a-4054-452f-8f97-6f8b8b842010 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:12.781623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e993d1a-4054-452f-8f97-6f8b8b842010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:12.792145 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e993d1a-4054-452f-8f97-6f8b8b842010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:12.793674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e993d1a-4054-452f-8f97-6f8b8b842010 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:12.804051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 973/1945] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:12.899839 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10385de-4993-4554-b071-2703f5fd11ef None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:12.909632 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10385de-4993-4554-b071-2703f5fd11ef None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:12.913860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e90c01-2aa3-460f-bdf4-ef43a96c3412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:12.914659 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e90c01-2aa3-460f-bdf4-ef43a96c3412 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:12.914942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e90c01-2aa3-460f-bdf4-ef43a96c3412 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:12.915214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e90c01-2aa3-460f-bdf4-ef43a96c3412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:12.975543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e90c01-2aa3-460f-bdf4-ef43a96c3412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:12.977046 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e90c01-2aa3-460f-bdf4-ef43a96c3412 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:12.986876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 973/1946] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:13.289181 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e993d1a-4054-452f-8f97-6f8b8b842010 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:13.376054 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e993d1a-4054-452f-8f97-6f8b8b842010 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:13.393460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9712d-b7d7-48f0-a51c-c35851368ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:13.396381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9712d-b7d7-48f0-a51c-c35851368ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:13.396979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9712d-b7d7-48f0-a51c-c35851368ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:13.397842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9712d-b7d7-48f0-a51c-c35851368ba5 admin admin] PATH_INFO: `/v3/users/2dec4c5577ea4d1bbb49ae57fa568d4f` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:13.400230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9712d-b7d7-48f0-a51c-c35851368ba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dec4c5577ea4d1bbb49ae57fa568d4f)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:13.402645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9712d-b7d7-48f0-a51c-c35851368ba5 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:13.496069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-20a9712d-b7d7-48f0-a51c-c35851368ba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dec4c5577ea4d1bbb49ae57fa568d4f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:13.531100 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-20a9712d-b7d7-48f0-a51c-c35851368ba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dec4c5577ea4d1bbb49ae57fa568d4f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:13.532431 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-20a9712d-b7d7-48f0-a51c-c35851368ba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dec4c5577ea4d1bbb49ae57fa568d4f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:13.551492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-20a9712d-b7d7-48f0-a51c-c35851368ba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dec4c5577ea4d1bbb49ae57fa568d4f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:13.552317 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-20a9712d-b7d7-48f0-a51c-c35851368ba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dec4c5577ea4d1bbb49ae57fa568d4f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:13.594132 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 974/1947] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:13 2022] DELETE /identity/v3/users/2dec4c5577ea4d1bbb49ae57fa568d4f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:13.595715 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4938e-d4a4-4bb9-bf5f-0b746f59b3f5 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:13.596158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4938e-d4a4-4bb9-bf5f-0b746f59b3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:13.596326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4938e-d4a4-4bb9-bf5f-0b746f59b3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:13.634975 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f0b4938e-d4a4-4bb9-bf5f-0b746f59b3f5 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:13.639522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f0b4938e-d4a4-4bb9-bf5f-0b746f59b3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:13.673732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:13.767196 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 974/1948] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:13.782451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9712d-b7d7-48f0-a51c-c35851368ba5 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:13.782451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-20a9712d-b7d7-48f0-a51c-c35851368ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:13.821767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:13.896792 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9712d-b7d7-48f0-a51c-c35851368ba5 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:13.905282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f5c0d-53b7-46bb-af4d-9252bc512a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:13.905282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5c0d-53b7-46bb-af4d-9252bc512a5a service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:13.905282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5c0d-53b7-46bb-af4d-9252bc512a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:13.905282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5c0d-53b7-46bb-af4d-9252bc512a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:13.939464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f5c0d-53b7-46bb-af4d-9252bc512a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:13.945273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f5c0d-53b7-46bb-af4d-9252bc512a5a service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:13.959712 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 975/1949] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:14.113185 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4938e-d4a4-4bb9-bf5f-0b746f59b3f5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:14.114998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f0b4938e-d4a4-4bb9-bf5f-0b746f59b3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:14.146848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4938e-d4a4-4bb9-bf5f-0b746f59b3f5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:14.160814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c47bf-4f68-4763-af09-c2e3ebbc12d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:14.164700 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c47bf-4f68-4763-af09-c2e3ebbc12d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:14.166836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c47bf-4f68-4763-af09-c2e3ebbc12d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:14.167352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c47bf-4f68-4763-af09-c2e3ebbc12d1 admin admin] PATH_INFO: `/v3/users/e8a39672839340a382c0df424625865d` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:14.171002 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c47bf-4f68-4763-af09-c2e3ebbc12d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a39672839340a382c0df424625865d)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:14.177408 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c47bf-4f68-4763-af09-c2e3ebbc12d1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:14.307234 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-311c47bf-4f68-4763-af09-c2e3ebbc12d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a39672839340a382c0df424625865d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:14.321539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-311c47bf-4f68-4763-af09-c2e3ebbc12d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a39672839340a382c0df424625865d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:14.337643 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-311c47bf-4f68-4763-af09-c2e3ebbc12d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a39672839340a382c0df424625865d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:14.339357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-311c47bf-4f68-4763-af09-c2e3ebbc12d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a39672839340a382c0df424625865d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:14.340338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-311c47bf-4f68-4763-af09-c2e3ebbc12d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a39672839340a382c0df424625865d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:14.423792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 975/1950] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:14 2022] DELETE /identity/v3/users/e8a39672839340a382c0df424625865d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:14.429424 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02a28-c1e9-4c47-ac9e-2e3827000295 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:14.430319 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02a28-c1e9-4c47-ac9e-2e3827000295 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:14.430695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02a28-c1e9-4c47-ac9e-2e3827000295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:14.495552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f6c02a28-c1e9-4c47-ac9e-2e3827000295 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:14.496838 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f6c02a28-c1e9-4c47-ac9e-2e3827000295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:14.573035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c47bf-4f68-4763-af09-c2e3ebbc12d1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:14.577309 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-311c47bf-4f68-4763-af09-c2e3ebbc12d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:14.641821 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 976/1951] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:14.642815 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c02a28-c1e9-4c47-ac9e-2e3827000295 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:14.644360 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f6c02a28-c1e9-4c47-ac9e-2e3827000295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:14.660559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c02a28-c1e9-4c47-ac9e-2e3827000295 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:14.666396 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c47bf-4f68-4763-af09-c2e3ebbc12d1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:14.666874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a01cd2-7a86-4f14-829f-d477047f9e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:14.667983 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a01cd2-7a86-4f14-829f-d477047f9e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:14.668288 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a01cd2-7a86-4f14-829f-d477047f9e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:14.668656 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a01cd2-7a86-4f14-829f-d477047f9e89 admin admin] PATH_INFO: `/v3/projects/4494902efea946499a6a98a17e7e4dc5` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:14.669954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a01cd2-7a86-4f14-829f-d477047f9e89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4494902efea946499a6a98a17e7e4dc5)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:14.670097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d864bdb-5173-44d6-a74f-5ab3fe34e762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:14.670742 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d864bdb-5173-44d6-a74f-5ab3fe34e762 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:14.671022 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d864bdb-5173-44d6-a74f-5ab3fe34e762 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:14.671293 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d864bdb-5173-44d6-a74f-5ab3fe34e762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:14.674419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1d864bdb-5173-44d6-a74f-5ab3fe34e762 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:14.674662 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a01cd2-7a86-4f14-829f-d477047f9e89 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:14.742653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:14.753599 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-14a01cd2-7a86-4f14-829f-d477047f9e89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4494902efea946499a6a98a17e7e4dc5', 'request_id': 'req-14a01cd2-7a86-4f14-829f-d477047f9e89'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:14.759671 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-14a01cd2-7a86-4f14-829f-d477047f9e89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4494902efea946499a6a98a17e7e4dc5', 'request_id': 'req-14a01cd2-7a86-4f14-829f-d477047f9e89'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:14.764527 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d864bdb-5173-44d6-a74f-5ab3fe34e762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:14.766453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d864bdb-5173-44d6-a74f-5ab3fe34e762 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:14.769108 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-14a01cd2-7a86-4f14-829f-d477047f9e89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4494902efea946499a6a98a17e7e4dc5', 'request_id': 'req-14a01cd2-7a86-4f14-829f-d477047f9e89'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:14.778713 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 976/1952] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:02:14.785800 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-14a01cd2-7a86-4f14-829f-d477047f9e89 admin admin] The token cache is being invalidate because project 4494902efea946499a6a98a17e7e4dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:14.786352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-14a01cd2-7a86-4f14-829f-d477047f9e89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:14.787582 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-14a01cd2-7a86-4f14-829f-d477047f9e89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:14.789628 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 977/1953] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:14 2022] DELETE /identity/v3/projects/4494902efea946499a6a98a17e7e4dc5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:14.791142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d864bdb-5173-44d6-a74f-5ab3fe34e762 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:14.794234 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a01cd2-7a86-4f14-829f-d477047f9e89 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:14.795586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1d864bdb-5173-44d6-a74f-5ab3fe34e762 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:14.798697 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-14a01cd2-7a86-4f14-829f-d477047f9e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:14.868485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:14.906301 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a01cd2-7a86-4f14-829f-d477047f9e89 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:14.913477 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cdf27-3478-4b3b-9ffa-f2adee981c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:14.914512 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cdf27-3478-4b3b-9ffa-f2adee981c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:14.914795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cdf27-3478-4b3b-9ffa-f2adee981c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:14.915125 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cdf27-3478-4b3b-9ffa-f2adee981c0e admin admin] PATH_INFO: `/v3/users/2997cc1b13134e4fa665679027bda87c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:14.916888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cdf27-3478-4b3b-9ffa-f2adee981c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2997cc1b13134e4fa665679027bda87c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:14.918923 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d864bdb-5173-44d6-a74f-5ab3fe34e762 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:14.919488 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cdf27-3478-4b3b-9ffa-f2adee981c0e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:14.995509 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13e4f1-25c7-4c14-b924-c996ad43ac07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:14.996544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13e4f1-25c7-4c14-b924-c996ad43ac07 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:14.997009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13e4f1-25c7-4c14-b924-c996ad43ac07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:14.997735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13e4f1-25c7-4c14-b924-c996ad43ac07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:15.001402 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c54cdf27-3478-4b3b-9ffa-f2adee981c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2997cc1b13134e4fa665679027bda87c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:15.003027 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-dc13e4f1-25c7-4c14-b924-c996ad43ac07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:15.012802 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c54cdf27-3478-4b3b-9ffa-f2adee981c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2997cc1b13134e4fa665679027bda87c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:15.013882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c54cdf27-3478-4b3b-9ffa-f2adee981c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2997cc1b13134e4fa665679027bda87c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:15.018905 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13e4f1-25c7-4c14-b924-c996ad43ac07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:15.020963 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13e4f1-25c7-4c14-b924-c996ad43ac07 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:15.025088 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c54cdf27-3478-4b3b-9ffa-f2adee981c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2997cc1b13134e4fa665679027bda87c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:15.026327 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-c54cdf27-3478-4b3b-9ffa-f2adee981c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2997cc1b13134e4fa665679027bda87c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:15.045617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 977/1954] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:15.056896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 978/1955] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:14 2022] DELETE /identity/v3/users/2997cc1b13134e4fa665679027bda87c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:15.569535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13e4f1-25c7-4c14-b924-c996ad43ac07 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:15.572961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-dc13e4f1-25c7-4c14-b924-c996ad43ac07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:15.618441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13e4f1-25c7-4c14-b924-c996ad43ac07 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:15.706042 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af652bf0-1dd7-46bb-8df4-c937364baad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:15.707776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af652bf0-1dd7-46bb-8df4-c937364baad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:15.708285 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af652bf0-1dd7-46bb-8df4-c937364baad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:15.708663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af652bf0-1dd7-46bb-8df4-c937364baad2 admin admin] PATH_INFO: `/v3/projects/77522851741e42438399da55d8b86a0d` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:15.710048 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af652bf0-1dd7-46bb-8df4-c937364baad2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77522851741e42438399da55d8b86a0d)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:15.712263 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af652bf0-1dd7-46bb-8df4-c937364baad2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:15.781256 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:15.788680 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-af652bf0-1dd7-46bb-8df4-c937364baad2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77522851741e42438399da55d8b86a0d', 'request_id': 'req-af652bf0-1dd7-46bb-8df4-c937364baad2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:15.803629 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-af652bf0-1dd7-46bb-8df4-c937364baad2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77522851741e42438399da55d8b86a0d', 'request_id': 'req-af652bf0-1dd7-46bb-8df4-c937364baad2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:15.824182 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-af652bf0-1dd7-46bb-8df4-c937364baad2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77522851741e42438399da55d8b86a0d', 'request_id': 'req-af652bf0-1dd7-46bb-8df4-c937364baad2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:15.838620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-af652bf0-1dd7-46bb-8df4-c937364baad2 admin admin] The token cache is being invalidate because project 77522851741e42438399da55d8b86a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:15.839233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-af652bf0-1dd7-46bb-8df4-c937364baad2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:15.840106 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-af652bf0-1dd7-46bb-8df4-c937364baad2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:15.841981 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 978/1956] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:15 2022] DELETE /identity/v3/projects/77522851741e42438399da55d8b86a0d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:15.846501 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cdf27-3478-4b3b-9ffa-f2adee981c0e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:15.849214 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c54cdf27-3478-4b3b-9ffa-f2adee981c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:15.866848 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cdf27-3478-4b3b-9ffa-f2adee981c0e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:15.941825 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6969d7-dcb8-45fb-a7bc-07ad2575e451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:15.942902 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6969d7-dcb8-45fb-a7bc-07ad2575e451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:15.943236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6969d7-dcb8-45fb-a7bc-07ad2575e451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:15.943577 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6969d7-dcb8-45fb-a7bc-07ad2575e451 admin admin] PATH_INFO: `/v3/users/cefa9bfe61af4abaac05a5c9755555ae` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:15.944869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6969d7-dcb8-45fb-a7bc-07ad2575e451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cefa9bfe61af4abaac05a5c9755555ae)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:15.950852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af652bf0-1dd7-46bb-8df4-c937364baad2 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:15.953626 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-af652bf0-1dd7-46bb-8df4-c937364baad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:15.957078 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6969d7-dcb8-45fb-a7bc-07ad2575e451 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:15.971798 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af652bf0-1dd7-46bb-8df4-c937364baad2 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:15.989942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08417fd-f89f-407b-b2fc-75569012ae91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:15.990936 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08417fd-f89f-407b-b2fc-75569012ae91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:15.991214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08417fd-f89f-407b-b2fc-75569012ae91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:15.991594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08417fd-f89f-407b-b2fc-75569012ae91 admin admin] PATH_INFO: `/v3/projects/276df7ef0d1945b3979f896182caf351` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:15.996514 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08417fd-f89f-407b-b2fc-75569012ae91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=276df7ef0d1945b3979f896182caf351)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:16.000795 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08417fd-f89f-407b-b2fc-75569012ae91 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:16.069521 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6c6969d7-dcb8-45fb-a7bc-07ad2575e451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cefa9bfe61af4abaac05a5c9755555ae'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.087584 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6c6969d7-dcb8-45fb-a7bc-07ad2575e451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cefa9bfe61af4abaac05a5c9755555ae'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.088660 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6c6969d7-dcb8-45fb-a7bc-07ad2575e451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cefa9bfe61af4abaac05a5c9755555ae'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.105342 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6c6969d7-dcb8-45fb-a7bc-07ad2575e451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cefa9bfe61af4abaac05a5c9755555ae'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.105342 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6c6969d7-dcb8-45fb-a7bc-07ad2575e451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cefa9bfe61af4abaac05a5c9755555ae'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.105526 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:16.114324 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e08417fd-f89f-407b-b2fc-75569012ae91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276df7ef0d1945b3979f896182caf351', 'request_id': 'req-e08417fd-f89f-407b-b2fc-75569012ae91'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.135036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e08417fd-f89f-407b-b2fc-75569012ae91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276df7ef0d1945b3979f896182caf351', 'request_id': 'req-e08417fd-f89f-407b-b2fc-75569012ae91'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.143259 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 979/1957] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:15 2022] DELETE /identity/v3/users/cefa9bfe61af4abaac05a5c9755555ae => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:16.154957 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e08417fd-f89f-407b-b2fc-75569012ae91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276df7ef0d1945b3979f896182caf351', 'request_id': 'req-e08417fd-f89f-407b-b2fc-75569012ae91'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.171376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e08417fd-f89f-407b-b2fc-75569012ae91 admin admin] The token cache is being invalidate because project 276df7ef0d1945b3979f896182caf351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:16.171376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e08417fd-f89f-407b-b2fc-75569012ae91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.172271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e08417fd-f89f-407b-b2fc-75569012ae91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.174505 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 979/1958] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:15 2022] DELETE /identity/v3/projects/276df7ef0d1945b3979f896182caf351 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:16.180143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c34014-875f-45d2-9de5-6f8ec10ab201 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:16.180547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c34014-875f-45d2-9de5-6f8ec10ab201 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:16.180974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c34014-875f-45d2-9de5-6f8ec10ab201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:16.205771 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-15c34014-875f-45d2-9de5-6f8ec10ab201 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:16.207693 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-15c34014-875f-45d2-9de5-6f8ec10ab201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:16.235698 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08417fd-f89f-407b-b2fc-75569012ae91 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:16.240539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e08417fd-f89f-407b-b2fc-75569012ae91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:16.323534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 980/1959] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:16.331545 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368900dc-66a8-48d0-ad92-e4f12f84c74f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:16.331921 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368900dc-66a8-48d0-ad92-e4f12f84c74f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:16.332274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368900dc-66a8-48d0-ad92-e4f12f84c74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:16.355450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08417fd-f89f-407b-b2fc-75569012ae91 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:16.358283 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-368900dc-66a8-48d0-ad92-e4f12f84c74f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:16.359556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-368900dc-66a8-48d0-ad92-e4f12f84c74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:16.361398 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b92aba-ccbd-4e7e-9170-d33f0c06758c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:16.362319 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b92aba-ccbd-4e7e-9170-d33f0c06758c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:16.362604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b92aba-ccbd-4e7e-9170-d33f0c06758c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:16.363554 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b92aba-ccbd-4e7e-9170-d33f0c06758c admin admin] PATH_INFO: `/v3/users/935799ab1b7b4774a1ce8f3310af0896` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:16.365176 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b92aba-ccbd-4e7e-9170-d33f0c06758c admin admin] RBAC: Authorizing `identity:delete_user(user_id=935799ab1b7b4774a1ce8f3310af0896)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:16.367199 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b92aba-ccbd-4e7e-9170-d33f0c06758c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:16.373448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 981/1960] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:16.391028 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368900dc-66a8-48d0-ad92-e4f12f84c74f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:16.402779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368900dc-66a8-48d0-ad92-e4f12f84c74f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:16.408362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202a4f3-0441-42e1-a9a6-147e11414d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:16.409055 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a4f3-0441-42e1-a9a6-147e11414d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:16.409385 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a4f3-0441-42e1-a9a6-147e11414d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:16.409682 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a4f3-0441-42e1-a9a6-147e11414d96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:16.410619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202a4f3-0441-42e1-a9a6-147e11414d96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:16.410928 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202a4f3-0441-42e1-a9a6-147e11414d96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:16.413178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202a4f3-0441-42e1-a9a6-147e11414d96 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:16.429809 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 982/1961] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:02:16.436818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202a4f3-0441-42e1-a9a6-147e11414d96 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:16.443121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-00b92aba-ccbd-4e7e-9170-d33f0c06758c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935799ab1b7b4774a1ce8f3310af0896'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.453353 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-00b92aba-ccbd-4e7e-9170-d33f0c06758c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935799ab1b7b4774a1ce8f3310af0896'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.457507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=18,keystone:SELECT=79,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:16.460456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202a4f3-0441-42e1-a9a6-147e11414d96 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:16.466066 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-00b92aba-ccbd-4e7e-9170-d33f0c06758c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935799ab1b7b4774a1ce8f3310af0896'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.467024 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-00b92aba-ccbd-4e7e-9170-d33f0c06758c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935799ab1b7b4774a1ce8f3310af0896'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.468181 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-00b92aba-ccbd-4e7e-9170-d33f0c06758c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935799ab1b7b4774a1ce8f3310af0896'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.471859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a4990-fd46-4d7b-a2f7-051cc973222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:16.473712 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a4990-fd46-4d7b-a2f7-051cc973222f admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:16.474277 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a4990-fd46-4d7b-a2f7-051cc973222f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:16.475069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a4990-fd46-4d7b-a2f7-051cc973222f admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:16.476102 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a4990-fd46-4d7b-a2f7-051cc973222f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:16.478057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a4990-fd46-4d7b-a2f7-051cc973222f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:16.496898 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 980/1962] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:16 2022] DELETE /identity/v3/users/935799ab1b7b4774a1ce8f3310af0896 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:16.498512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1572a3-838e-4c7f-8066-6b17b44ca219 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:16.498796 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1572a3-838e-4c7f-8066-6b17b44ca219 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:16.500148 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1572a3-838e-4c7f-8066-6b17b44ca219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:16.520234 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-2f1572a3-838e-4c7f-8066-6b17b44ca219 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:16.521485 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2f1572a3-838e-4c7f-8066-6b17b44ca219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:16.526172 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 983/1963] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:16 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:16.527977 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a4990-fd46-4d7b-a2f7-051cc973222f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:16.530965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-369a4990-fd46-4d7b-a2f7-051cc973222f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:16.637980 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 981/1964] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:16.644570 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a4990-fd46-4d7b-a2f7-051cc973222f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:16.654631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1572a3-838e-4c7f-8066-6b17b44ca219 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:16.666338 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb1d79-e6a9-4ff4-8582-a606d3b38aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:16.667448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb1d79-e6a9-4ff4-8582-a606d3b38aab admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:16.667957 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2f1572a3-838e-4c7f-8066-6b17b44ca219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:16.668420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb1d79-e6a9-4ff4-8582-a606d3b38aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:16.669753 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb1d79-e6a9-4ff4-8582-a606d3b38aab admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:16.671401 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb1d79-e6a9-4ff4-8582-a606d3b38aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:16.676480 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb1d79-e6a9-4ff4-8582-a606d3b38aab admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:16.691978 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1572a3-838e-4c7f-8066-6b17b44ca219 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:16.698121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e9a6c-3449-4a5e-8b2c-86ca128015fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:16.699805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e9a6c-3449-4a5e-8b2c-86ca128015fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:16.700141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e9a6c-3449-4a5e-8b2c-86ca128015fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:16.700475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e9a6c-3449-4a5e-8b2c-86ca128015fe admin admin] PATH_INFO: `/v3/projects/10e3c5bc738a417eb9fd09cf64712d50` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:16.701837 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e9a6c-3449-4a5e-8b2c-86ca128015fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e3c5bc738a417eb9fd09cf64712d50)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:16.704041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e9a6c-3449-4a5e-8b2c-86ca128015fe admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:16.707970 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 984/1965] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:16 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:02:16.709401 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb1d79-e6a9-4ff4-8582-a606d3b38aab admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:16.715821 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fabb1d79-e6a9-4ff4-8582-a606d3b38aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:16.755811 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:16.768415 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-979e9a6c-3449-4a5e-8b2c-86ca128015fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e3c5bc738a417eb9fd09cf64712d50', 'request_id': 'req-979e9a6c-3449-4a5e-8b2c-86ca128015fe'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.777770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-979e9a6c-3449-4a5e-8b2c-86ca128015fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e3c5bc738a417eb9fd09cf64712d50', 'request_id': 'req-979e9a6c-3449-4a5e-8b2c-86ca128015fe'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.784300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-979e9a6c-3449-4a5e-8b2c-86ca128015fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e3c5bc738a417eb9fd09cf64712d50', 'request_id': 'req-979e9a6c-3449-4a5e-8b2c-86ca128015fe'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.801507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-979e9a6c-3449-4a5e-8b2c-86ca128015fe admin admin] The token cache is being invalidate because project 10e3c5bc738a417eb9fd09cf64712d50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:16.801712 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-979e9a6c-3449-4a5e-8b2c-86ca128015fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.802551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-979e9a6c-3449-4a5e-8b2c-86ca128015fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:16.804499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 982/1966] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:16 2022] DELETE /identity/v3/projects/10e3c5bc738a417eb9fd09cf64712d50 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:16.806091 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e9a6c-3449-4a5e-8b2c-86ca128015fe admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:16.810703 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-979e9a6c-3449-4a5e-8b2c-86ca128015fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:16.816770 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb1d79-e6a9-4ff4-8582-a606d3b38aab admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:16.885391 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9d57c-e7bb-48f5-8ac7-efbb62201cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:16.886825 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9d57c-e7bb-48f5-8ac7-efbb62201cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:16.887346 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9d57c-e7bb-48f5-8ac7-efbb62201cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:16.887815 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9d57c-e7bb-48f5-8ac7-efbb62201cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:16.891203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3ee9d57c-e7bb-48f5-8ac7-efbb62201cc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:16.909567 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e9a6c-3449-4a5e-8b2c-86ca128015fe admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:16.915903 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc22a36-fb99-46ba-b0c3-f8d27b4f7ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:16.916578 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc22a36-fb99-46ba-b0c3-f8d27b4f7ade admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:16.916861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc22a36-fb99-46ba-b0c3-f8d27b4f7ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:16.917133 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc22a36-fb99-46ba-b0c3-f8d27b4f7ade admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:16.917856 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc22a36-fb99-46ba-b0c3-f8d27b4f7ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:16.920208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc22a36-fb99-46ba-b0c3-f8d27b4f7ade admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:16.921539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:16.935776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 983/1967] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:16.935776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714359a-7080-4767-bc1f-a62e90e25f85 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:16.936311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714359a-7080-4767-bc1f-a62e90e25f85 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:16.936638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714359a-7080-4767-bc1f-a62e90e25f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:16.960216 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0714359a-7080-4767-bc1f-a62e90e25f85 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:16.962376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0714359a-7080-4767-bc1f-a62e90e25f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:16.977679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 984/1968] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:16.977679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714359a-7080-4767-bc1f-a62e90e25f85 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:16.977975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9d57c-e7bb-48f5-8ac7-efbb62201cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:16.977975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9d57c-e7bb-48f5-8ac7-efbb62201cc1 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:16.986075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 985/1969] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:16.987496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda696b-241b-473b-a345-4818ae6263bb None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:16.987875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda696b-241b-473b-a345-4818ae6263bb None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:16.988660 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda696b-241b-473b-a345-4818ae6263bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:16.988868 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714359a-7080-4767-bc1f-a62e90e25f85 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:16.993709 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1247ba8-c2b5-4240-a940-24ed052a72e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:16.994510 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247ba8-c2b5-4240-a940-24ed052a72e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:16.994861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247ba8-c2b5-4240-a940-24ed052a72e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:16.995213 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247ba8-c2b5-4240-a940-24ed052a72e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:16.996032 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1247ba8-c2b5-4240-a940-24ed052a72e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:16.997841 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1247ba8-c2b5-4240-a940-24ed052a72e7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:17.008045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-fdda696b-241b-473b-a345-4818ae6263bb None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:17.008740 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 985/1970] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:17.009398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fdda696b-241b-473b-a345-4818ae6263bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:17.012589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1247ba8-c2b5-4240-a940-24ed052a72e7 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:17.019537 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 986/1971] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:17.023365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda696b-241b-473b-a345-4818ae6263bb None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:17.026961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1247ba8-c2b5-4240-a940-24ed052a72e7 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:17.033221 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fc265-ae73-4d20-92b6-57b26cd84b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:17.034201 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fc265-ae73-4d20-92b6-57b26cd84b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:17.034478 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fc265-ae73-4d20-92b6-57b26cd84b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:17.035244 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda696b-241b-473b-a345-4818ae6263bb None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:17.035389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fc265-ae73-4d20-92b6-57b26cd84b64 admin admin] PATH_INFO: `/v3/projects/4d8022b2d4624c1a9997e3a640ad2523/users/ef231efddef942ccbeaeff5a4eb3af12/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:17.041045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1928ae8-0f82-4394-a068-e3aecf85b911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:17.041995 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1928ae8-0f82-4394-a068-e3aecf85b911 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:17.042311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1928ae8-0f82-4394-a068-e3aecf85b911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:17.043095 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1928ae8-0f82-4394-a068-e3aecf85b911 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:17.043780 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1928ae8-0f82-4394-a068-e3aecf85b911 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:17.044168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1928ae8-0f82-4394-a068-e3aecf85b911 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:17.045956 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1928ae8-0f82-4394-a068-e3aecf85b911 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:17.057575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fc265-ae73-4d20-92b6-57b26cd84b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8022b2d4624c1a9997e3a640ad2523, user_id=ef231efddef942ccbeaeff5a4eb3af12, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:17.059894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 987/1972] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 22:02:17.062313 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fc265-ae73-4d20-92b6-57b26cd84b64 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:17.063805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1928ae8-0f82-4394-a068-e3aecf85b911 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:17.075656 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1928ae8-0f82-4394-a068-e3aecf85b911 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:17.079905 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 986/1973] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:17 2022] PUT /identity/v3/projects/4d8022b2d4624c1a9997e3a640ad2523/users/ef231efddef942ccbeaeff5a4eb3af12/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:17.090826 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b086c8-2bdd-4528-a42f-8bd5b3780d9b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:17.091234 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b086c8-2bdd-4528-a42f-8bd5b3780d9b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:17.092593 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b086c8-2bdd-4528-a42f-8bd5b3780d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:17.126376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f3b086c8-2bdd-4528-a42f-8bd5b3780d9b None None] MFA Rules not processed for user `ef231efddef942ccbeaeff5a4eb3af12`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:17.127938 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f3b086c8-2bdd-4528-a42f-8bd5b3780d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:17.188239 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b95583-9c10-4946-a485-e30e95694b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:17.189012 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b95583-9c10-4946-a485-e30e95694b33 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:17.189417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b95583-9c10-4946-a485-e30e95694b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:17.189864 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b95583-9c10-4946-a485-e30e95694b33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:17.190853 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b95583-9c10-4946-a485-e30e95694b33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:17.193484 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b95583-9c10-4946-a485-e30e95694b33 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:17.217723 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:17.234302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 988/1974] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:17 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:02:17.235381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b95583-9c10-4946-a485-e30e95694b33 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:17.288543 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 987/1975] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:17.301501 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b086c8-2bdd-4528-a42f-8bd5b3780d9b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:17.303919 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f3b086c8-2bdd-4528-a42f-8bd5b3780d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:17.320511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b95583-9c10-4946-a485-e30e95694b33 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:17.326145 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920b765-2844-4b0e-9c0b-070427d1b8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:17.326963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b765-2844-4b0e-9c0b-070427d1b8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:17.327347 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b765-2844-4b0e-9c0b-070427d1b8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:17.327829 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b765-2844-4b0e-9c0b-070427d1b8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:17.328695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920b765-2844-4b0e-9c0b-070427d1b8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:17.332227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920b765-2844-4b0e-9c0b-070427d1b8b7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:17.364330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 989/1976] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:17 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:17.370901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920b765-2844-4b0e-9c0b-070427d1b8b7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:17.382887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920b765-2844-4b0e-9c0b-070427d1b8b7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:17.388808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71926ce6-6583-4a1b-a2c2-b5da13b2b67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:17.389662 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71926ce6-6583-4a1b-a2c2-b5da13b2b67e admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:17.390077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71926ce6-6583-4a1b-a2c2-b5da13b2b67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:17.390532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71926ce6-6583-4a1b-a2c2-b5da13b2b67e admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:17.391410 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71926ce6-6583-4a1b-a2c2-b5da13b2b67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:17.393341 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71926ce6-6583-4a1b-a2c2-b5da13b2b67e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:17.409018 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 990/1977] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:17.411257 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71926ce6-6583-4a1b-a2c2-b5da13b2b67e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:17.424115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b086c8-2bdd-4528-a42f-8bd5b3780d9b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:17.431124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71926ce6-6583-4a1b-a2c2-b5da13b2b67e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:17.436450 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d817f6-8945-4979-afd8-67bf9f437da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:17.437266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d817f6-8945-4979-afd8-67bf9f437da1 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:17.437863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d817f6-8945-4979-afd8-67bf9f437da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:17.438370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d817f6-8945-4979-afd8-67bf9f437da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:17.439208 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d817f6-8945-4979-afd8-67bf9f437da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:17.441560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d817f6-8945-4979-afd8-67bf9f437da1 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:17.457987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 991/1978] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:17.463163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d817f6-8945-4979-afd8-67bf9f437da1 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:17.488289 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d817f6-8945-4979-afd8-67bf9f437da1 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:17.498799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d6ed6-662b-47d0-b020-f71dfc9c349b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:17.500096 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d6ed6-662b-47d0-b020-f71dfc9c349b admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:17.500542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d6ed6-662b-47d0-b020-f71dfc9c349b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:17.501004 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d6ed6-662b-47d0-b020-f71dfc9c349b admin admin] PATH_INFO: `/v3/projects/4ceae2f175f7434ebc45eab9564fdb45/users/bb404196d36340aea36efb36f71625e3/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:17.518223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae687f21-09af-497c-a5fe-f8b719a76d38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:17.520674 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae687f21-09af-497c-a5fe-f8b719a76d38 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:17.525710 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae687f21-09af-497c-a5fe-f8b719a76d38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:17.526135 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae687f21-09af-497c-a5fe-f8b719a76d38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:17.534955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d6ed6-662b-47d0-b020-f71dfc9c349b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ceae2f175f7434ebc45eab9564fdb45, user_id=bb404196d36340aea36efb36f71625e3, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:17.538611 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d6ed6-662b-47d0-b020-f71dfc9c349b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:17.544469 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:17.560774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 992/1979] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:17 2022] PUT /identity/v3/projects/4ceae2f175f7434ebc45eab9564fdb45/users/bb404196d36340aea36efb36f71625e3/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:17.571846 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7afe17-82b8-49e5-af7e-b5016ea212ab None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:17.572081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7afe17-82b8-49e5-af7e-b5016ea212ab None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:17.572488 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7afe17-82b8-49e5-af7e-b5016ea212ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:17.601736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae687f21-09af-497c-a5fe-f8b719a76d38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:17.603633 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae687f21-09af-497c-a5fe-f8b719a76d38 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:17.615948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 988/1980] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:17.618424 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1d7afe17-82b8-49e5-af7e-b5016ea212ab None None] MFA Rules not processed for user `bb404196d36340aea36efb36f71625e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:17.620112 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1d7afe17-82b8-49e5-af7e-b5016ea212ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:17.702947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae687f21-09af-497c-a5fe-f8b719a76d38 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:17.704625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ae687f21-09af-497c-a5fe-f8b719a76d38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:17.721197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae687f21-09af-497c-a5fe-f8b719a76d38 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:17.765568 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 993/1981] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:17.771692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7afe17-82b8-49e5-af7e-b5016ea212ab None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:17.820564 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9740be-3661-41ca-9e72-07dd664e257f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:17.820564 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9740be-3661-41ca-9e72-07dd664e257f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:17.824660 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:17.826001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9740be-3661-41ca-9e72-07dd664e257f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:17.826373 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9740be-3661-41ca-9e72-07dd664e257f admin admin] PATH_INFO: `/v3/projects/14e77a383e3540a2bce30b5a78b1dfd5` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:17.828025 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9740be-3661-41ca-9e72-07dd664e257f admin admin] RBAC: Authorizing `identity:delete_project(project_id=14e77a383e3540a2bce30b5a78b1dfd5)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:17.829963 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9740be-3661-41ca-9e72-07dd664e257f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:17.878908 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7afe17-82b8-49e5-af7e-b5016ea212ab None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:17.885721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b721255-f42f-4e3b-846f-a015c5b32ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:17.887067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b721255-f42f-4e3b-846f-a015c5b32ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:17.887406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b721255-f42f-4e3b-846f-a015c5b32ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:17.887691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b721255-f42f-4e3b-846f-a015c5b32ac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:17.888400 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b721255-f42f-4e3b-846f-a015c5b32ac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:17.890598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b721255-f42f-4e3b-846f-a015c5b32ac0 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:17.906352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-db9740be-3661-41ca-9e72-07dd664e257f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14e77a383e3540a2bce30b5a78b1dfd5', 'request_id': 'req-db9740be-3661-41ca-9e72-07dd664e257f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:17.917208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-db9740be-3661-41ca-9e72-07dd664e257f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14e77a383e3540a2bce30b5a78b1dfd5', 'request_id': 'req-db9740be-3661-41ca-9e72-07dd664e257f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:17.924793 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 994/1982] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:17 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:17.924793 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b721255-f42f-4e3b-846f-a015c5b32ac0 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:17.925142 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3b721255-f42f-4e3b-846f-a015c5b32ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:17.928767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-db9740be-3661-41ca-9e72-07dd664e257f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14e77a383e3540a2bce30b5a78b1dfd5', 'request_id': 'req-db9740be-3661-41ca-9e72-07dd664e257f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:17.961341 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-db9740be-3661-41ca-9e72-07dd664e257f admin admin] The token cache is being invalidate because project 14e77a383e3540a2bce30b5a78b1dfd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:17.961341 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-db9740be-3661-41ca-9e72-07dd664e257f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:17.965070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-db9740be-3661-41ca-9e72-07dd664e257f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:17.972812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 989/1983] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:17 2022] DELETE /identity/v3/projects/14e77a383e3540a2bce30b5a78b1dfd5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:17.973438 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9740be-3661-41ca-9e72-07dd664e257f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:17.983274 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-db9740be-3661-41ca-9e72-07dd664e257f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:18.052838 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b721255-f42f-4e3b-846f-a015c5b32ac0 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:18.059206 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8954b-1e45-4f12-94b4-c82d872cb493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:18.060220 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8954b-1e45-4f12-94b4-c82d872cb493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:18.060597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8954b-1e45-4f12-94b4-c82d872cb493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:18.060985 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8954b-1e45-4f12-94b4-c82d872cb493 admin admin] PATH_INFO: `/v3/users/74191a77497242449f8b17b9969a3f69` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:18.062710 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8954b-1e45-4f12-94b4-c82d872cb493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74191a77497242449f8b17b9969a3f69)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:18.064912 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8954b-1e45-4f12-94b4-c82d872cb493 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:18.101681 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:18.140189 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9740be-3661-41ca-9e72-07dd664e257f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:18.151265 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-59f8954b-1e45-4f12-94b4-c82d872cb493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74191a77497242449f8b17b9969a3f69'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:18.154352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec4253-4da8-48d5-a205-8eac67b9615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:18.155049 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec4253-4da8-48d5-a205-8eac67b9615f admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:18.155331 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec4253-4da8-48d5-a205-8eac67b9615f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:18.155688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec4253-4da8-48d5-a205-8eac67b9615f admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:18.156300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec4253-4da8-48d5-a205-8eac67b9615f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:18.159282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec4253-4da8-48d5-a205-8eac67b9615f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:18.164882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-59f8954b-1e45-4f12-94b4-c82d872cb493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74191a77497242449f8b17b9969a3f69'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:18.165751 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-59f8954b-1e45-4f12-94b4-c82d872cb493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74191a77497242449f8b17b9969a3f69'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:18.183362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-59f8954b-1e45-4f12-94b4-c82d872cb493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74191a77497242449f8b17b9969a3f69'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:18.184384 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-59f8954b-1e45-4f12-94b4-c82d872cb493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74191a77497242449f8b17b9969a3f69'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:18.216156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 990/1984] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:17 2022] POST /identity/v3/users => generated 299 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:18.223457 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec4253-4da8-48d5-a205-8eac67b9615f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:18.228248 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4eec4253-4da8-48d5-a205-8eac67b9615f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:18.234641 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 995/1985] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:17 2022] DELETE /identity/v3/users/74191a77497242449f8b17b9969a3f69 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:18.234641 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8954b-1e45-4f12-94b4-c82d872cb493 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:18.235319 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-59f8954b-1e45-4f12-94b4-c82d872cb493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:18.256344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec4253-4da8-48d5-a205-8eac67b9615f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:18.293299 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:18.322878 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8954b-1e45-4f12-94b4-c82d872cb493 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:18.332208 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6f6c7-0a12-4d58-b901-6bd4000a6433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:18.332868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6f6c7-0a12-4d58-b901-6bd4000a6433 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:18.333207 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6f6c7-0a12-4d58-b901-6bd4000a6433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:18.333425 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6f6c7-0a12-4d58-b901-6bd4000a6433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:18.334188 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6f6c7-0a12-4d58-b901-6bd4000a6433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:18.335864 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6f6c7-0a12-4d58-b901-6bd4000a6433 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:18.336924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bf699-576c-493d-a80e-d1079c78c8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:18.337857 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bf699-576c-493d-a80e-d1079c78c8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:18.338509 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bf699-576c-493d-a80e-d1079c78c8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:18.338509 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bf699-576c-493d-a80e-d1079c78c8b5 admin admin] PATH_INFO: `/v3/users/7762e769e2af40618719d75b2c0487c7` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:18.339919 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bf699-576c-493d-a80e-d1079c78c8b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7762e769e2af40618719d75b2c0487c7)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:18.342044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bf699-576c-493d-a80e-d1079c78c8b5 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:18.350403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 996/1986] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:18.350403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ce4d7-3ba4-481b-beff-fdd044186998 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:18.350403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ce4d7-3ba4-481b-beff-fdd044186998 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:18.350403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ce4d7-3ba4-481b-beff-fdd044186998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:18.372575 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-576ce4d7-3ba4-481b-beff-fdd044186998 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:18.373897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-576ce4d7-3ba4-481b-beff-fdd044186998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:18.391030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 997/1987] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:18.392083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ce4d7-3ba4-481b-beff-fdd044186998 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:18.405464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ce4d7-3ba4-481b-beff-fdd044186998 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:18.410677 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e9290-712c-44a1-953b-166972e238c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:18.411573 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e9290-712c-44a1-953b-166972e238c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:18.411854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e9290-712c-44a1-953b-166972e238c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:18.412128 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e9290-712c-44a1-953b-166972e238c3 admin admin] PATH_INFO: `/v3/projects/74688b2e564d484e98518946deee146a/users/c6e28414e4164981a519e2d057166ec2/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:18.419353 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-af5bf699-576c-493d-a80e-d1079c78c8b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7762e769e2af40618719d75b2c0487c7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:18.427687 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e9290-712c-44a1-953b-166972e238c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74688b2e564d484e98518946deee146a, user_id=c6e28414e4164981a519e2d057166ec2, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:18.430374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e9290-712c-44a1-953b-166972e238c3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:18.430521 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-af5bf699-576c-493d-a80e-d1079c78c8b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7762e769e2af40618719d75b2c0487c7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:18.439082 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-af5bf699-576c-493d-a80e-d1079c78c8b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7762e769e2af40618719d75b2c0487c7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:18.440372 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-af5bf699-576c-493d-a80e-d1079c78c8b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7762e769e2af40618719d75b2c0487c7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:18.442251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-af5bf699-576c-493d-a80e-d1079c78c8b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7762e769e2af40618719d75b2c0487c7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:18.454544 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 998/1988] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:18 2022] PUT /identity/v3/projects/74688b2e564d484e98518946deee146a/users/c6e28414e4164981a519e2d057166ec2/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:18.454544 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e9290-712c-44a1-953b-166972e238c3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:18.455072 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-393e9290-712c-44a1-953b-166972e238c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:18.473512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 991/1989] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:18 2022] DELETE /identity/v3/users/7762e769e2af40618719d75b2c0487c7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:18.474689 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bf699-576c-493d-a80e-d1079c78c8b5 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:18.476438 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-af5bf699-576c-493d-a80e-d1079c78c8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:18.548517 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:18.555031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e9290-712c-44a1-953b-166972e238c3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:18.564027 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bf699-576c-493d-a80e-d1079c78c8b5 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:18.572134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf605f75-a0b8-43e2-ae2e-aeec376a9f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:18.572810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf605f75-a0b8-43e2-ae2e-aeec376a9f13 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:18.573097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf605f75-a0b8-43e2-ae2e-aeec376a9f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:18.573376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf605f75-a0b8-43e2-ae2e-aeec376a9f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:18.574148 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf605f75-a0b8-43e2-ae2e-aeec376a9f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:18.575970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf605f75-a0b8-43e2-ae2e-aeec376a9f13 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:18.587369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 992/1990] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:18.593310 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf605f75-a0b8-43e2-ae2e-aeec376a9f13 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:18.603924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf605f75-a0b8-43e2-ae2e-aeec376a9f13 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:18.609389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a2074-95b5-443c-a14e-422634a30a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:18.610560 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a2074-95b5-443c-a14e-422634a30a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:18.611122 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a2074-95b5-443c-a14e-422634a30a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:18.611503 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a2074-95b5-443c-a14e-422634a30a22 admin admin] PATH_INFO: `/v3/projects/74688b2e564d484e98518946deee146a/users/c6e28414e4164981a519e2d057166ec2/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:18.614678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a2074-95b5-443c-a14e-422634a30a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74688b2e564d484e98518946deee146a, user_id=c6e28414e4164981a519e2d057166ec2, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:18.617480 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a2074-95b5-443c-a14e-422634a30a22 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:18.630047 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b8f34-a0f0-44f8-9031-02fc1f870586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:18.630631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 993/1991] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:18 2022] PUT /identity/v3/projects/74688b2e564d484e98518946deee146a/users/c6e28414e4164981a519e2d057166ec2/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:18.631462 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b8f34-a0f0-44f8-9031-02fc1f870586 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:18.632027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b8f34-a0f0-44f8-9031-02fc1f870586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:18.632957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b8f34-a0f0-44f8-9031-02fc1f870586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:18.636634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0c0b8f34-a0f0-44f8-9031-02fc1f870586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:18.642329 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84790f0-cdab-473a-a1b1-e31d95f9cce0 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:18.642624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84790f0-cdab-473a-a1b1-e31d95f9cce0 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:18.642906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84790f0-cdab-473a-a1b1-e31d95f9cce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:18.659369 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b8f34-a0f0-44f8-9031-02fc1f870586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:18.661687 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b8f34-a0f0-44f8-9031-02fc1f870586 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:18.675006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 999/1992] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:18.680501 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f84790f0-cdab-473a-a1b1-e31d95f9cce0 None None] MFA Rules not processed for user `c6e28414e4164981a519e2d057166ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:18.682246 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f84790f0-cdab-473a-a1b1-e31d95f9cce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:18.788200 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 994/1993] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:18.801382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b8f34-a0f0-44f8-9031-02fc1f870586 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:18.802929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0c0b8f34-a0f0-44f8-9031-02fc1f870586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:18.870937 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b8f34-a0f0-44f8-9031-02fc1f870586 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:18.895335 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:18.943551 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19c98e-1fcd-4b87-a353-4efdcc219c0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:18.944210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19c98e-1fcd-4b87-a353-4efdcc219c0c service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:18.944495 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19c98e-1fcd-4b87-a353-4efdcc219c0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:18.944823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19c98e-1fcd-4b87-a353-4efdcc219c0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:18.955819 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19c98e-1fcd-4b87-a353-4efdcc219c0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:18.958222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19c98e-1fcd-4b87-a353-4efdcc219c0c service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:18.971004 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1000/1994] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:02:19.005610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84790f0-cdab-473a-a1b1-e31d95f9cce0 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:19.086773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84790f0-cdab-473a-a1b1-e31d95f9cce0 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:19.092540 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4d6eb-d083-4e39-a055-942320df153e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:19.093661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4d6eb-d083-4e39-a055-942320df153e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:19.093952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4d6eb-d083-4e39-a055-942320df153e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:19.094247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4d6eb-d083-4e39-a055-942320df153e admin admin] PATH_INFO: `/v3/users/bb404196d36340aea36efb36f71625e3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:19.095663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4d6eb-d083-4e39-a055-942320df153e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb404196d36340aea36efb36f71625e3)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:19.097571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4d6eb-d083-4e39-a055-942320df153e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:19.219074 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-40c4d6eb-d083-4e39-a055-942320df153e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb404196d36340aea36efb36f71625e3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:19.233418 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-40c4d6eb-d083-4e39-a055-942320df153e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb404196d36340aea36efb36f71625e3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:19.249213 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-40c4d6eb-d083-4e39-a055-942320df153e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb404196d36340aea36efb36f71625e3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:19.250270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-40c4d6eb-d083-4e39-a055-942320df153e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb404196d36340aea36efb36f71625e3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:19.253944 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-40c4d6eb-d083-4e39-a055-942320df153e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb404196d36340aea36efb36f71625e3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:19.257014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:19.319155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 995/1995] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:19 2022] DELETE /identity/v3/users/bb404196d36340aea36efb36f71625e3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:19.323869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6d7e8-0cb3-4053-aab4-67d3ef13daaa None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:19.324164 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6d7e8-0cb3-4053-aab4-67d3ef13daaa None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:19.324445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6d7e8-0cb3-4053-aab4-67d3ef13daaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:19.387144 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2bc6d7e8-0cb3-4053-aab4-67d3ef13daaa None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:19.388416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2bc6d7e8-0cb3-4053-aab4-67d3ef13daaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:19.500471 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4d6eb-d083-4e39-a055-942320df153e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:19.501885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-40c4d6eb-d083-4e39-a055-942320df153e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:19.540959 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1001/1996] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:19.586548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6d7e8-0cb3-4053-aab4-67d3ef13daaa None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:19.588199 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2bc6d7e8-0cb3-4053-aab4-67d3ef13daaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:19.655598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4d6eb-d083-4e39-a055-942320df153e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:19.661331 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4ffe0-29f8-42cc-b215-2382513c9f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:19.662718 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4ffe0-29f8-42cc-b215-2382513c9f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:19.663978 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4ffe0-29f8-42cc-b215-2382513c9f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:19.664351 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4ffe0-29f8-42cc-b215-2382513c9f65 admin admin] PATH_INFO: `/v3/projects/c08792d665ba4787afa67c57bc1e8d42` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:19.666302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4ffe0-29f8-42cc-b215-2382513c9f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c08792d665ba4787afa67c57bc1e8d42)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:19.669442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4ffe0-29f8-42cc-b215-2382513c9f65 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:19.703262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6d7e8-0cb3-4053-aab4-67d3ef13daaa None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:19.708844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b377b-1a33-473a-8819-c6022fd5748a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:19.709719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b377b-1a33-473a-8819-c6022fd5748a service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:19.710266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b377b-1a33-473a-8819-c6022fd5748a service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:19.710805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b377b-1a33-473a-8819-c6022fd5748a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:19.731910 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b377b-1a33-473a-8819-c6022fd5748a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:19.733772 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b377b-1a33-473a-8819-c6022fd5748a service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:19.741076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f0c4ffe0-29f8-42cc-b215-2382513c9f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c08792d665ba4787afa67c57bc1e8d42', 'request_id': 'req-f0c4ffe0-29f8-42cc-b215-2382513c9f65'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:19.750764 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f0c4ffe0-29f8-42cc-b215-2382513c9f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c08792d665ba4787afa67c57bc1e8d42', 'request_id': 'req-f0c4ffe0-29f8-42cc-b215-2382513c9f65'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:19.751030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1002/1997] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:02:19.764602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f0c4ffe0-29f8-42cc-b215-2382513c9f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c08792d665ba4787afa67c57bc1e8d42', 'request_id': 'req-f0c4ffe0-29f8-42cc-b215-2382513c9f65'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:19.786548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f0c4ffe0-29f8-42cc-b215-2382513c9f65 admin admin] The token cache is being invalidate because project c08792d665ba4787afa67c57bc1e8d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:19.786846 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f0c4ffe0-29f8-42cc-b215-2382513c9f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:19.787570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f0c4ffe0-29f8-42cc-b215-2382513c9f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:19.789827 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 996/1998] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:19 2022] DELETE /identity/v3/projects/c08792d665ba4787afa67c57bc1e8d42 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:19.801583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55600d-4c77-40c2-8c01-ffb61d885df6 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:19.802124 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55600d-4c77-40c2-8c01-ffb61d885df6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:19.802421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55600d-4c77-40c2-8c01-ffb61d885df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:19.824090 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0f55600d-4c77-40c2-8c01-ffb61d885df6 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:19.828374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0f55600d-4c77-40c2-8c01-ffb61d885df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:19.829481 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4ffe0-29f8-42cc-b215-2382513c9f65 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:19.832635 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f0c4ffe0-29f8-42cc-b215-2382513c9f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:19.947962 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1003/1999] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:19.963870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f513324-d0a4-41de-9155-0837b0a52426 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:19.964553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f513324-d0a4-41de-9155-0837b0a52426 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:19.964744 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f513324-d0a4-41de-9155-0837b0a52426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:19.977530 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:20.020805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8f513324-d0a4-41de-9155-0837b0a52426 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:20.021132 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4ffe0-29f8-42cc-b215-2382513c9f65 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:20.022772 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8f513324-d0a4-41de-9155-0837b0a52426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:20.027845 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf942ad9-474b-4c0c-a0f9-b1734c068731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:20.028842 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf942ad9-474b-4c0c-a0f9-b1734c068731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:20.029326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf942ad9-474b-4c0c-a0f9-b1734c068731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:20.030112 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf942ad9-474b-4c0c-a0f9-b1734c068731 admin admin] PATH_INFO: `/v3/projects/100ee40345c74deeb0a23a856929afbe` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:20.031858 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf942ad9-474b-4c0c-a0f9-b1734c068731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=100ee40345c74deeb0a23a856929afbe)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:20.033891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf942ad9-474b-4c0c-a0f9-b1734c068731 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:20.042108 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1004/2000] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:20.046406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f513324-d0a4-41de-9155-0837b0a52426 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:20.051783 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:20.073764 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f513324-d0a4-41de-9155-0837b0a52426 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:20.080074 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd411a8f-ac20-4972-a4a9-7208db07e5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:20.082154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd411a8f-ac20-4972-a4a9-7208db07e5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:20.082936 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd411a8f-ac20-4972-a4a9-7208db07e5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:20.083408 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd411a8f-ac20-4972-a4a9-7208db07e5c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:20.084666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd411a8f-ac20-4972-a4a9-7208db07e5c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:20.085507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd411a8f-ac20-4972-a4a9-7208db07e5c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:20.088794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd411a8f-ac20-4972-a4a9-7208db07e5c2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:20.101956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bf942ad9-474b-4c0c-a0f9-b1734c068731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100ee40345c74deeb0a23a856929afbe', 'request_id': 'req-bf942ad9-474b-4c0c-a0f9-b1734c068731'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.112950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1005/2001] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:02:20.114182 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bf942ad9-474b-4c0c-a0f9-b1734c068731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100ee40345c74deeb0a23a856929afbe', 'request_id': 'req-bf942ad9-474b-4c0c-a0f9-b1734c068731'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.114938 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd411a8f-ac20-4972-a4a9-7208db07e5c2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:20.126851 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bf942ad9-474b-4c0c-a0f9-b1734c068731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100ee40345c74deeb0a23a856929afbe', 'request_id': 'req-bf942ad9-474b-4c0c-a0f9-b1734c068731'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.132447 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd411a8f-ac20-4972-a4a9-7208db07e5c2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:20.151150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bf942ad9-474b-4c0c-a0f9-b1734c068731 admin admin] The token cache is being invalidate because project 100ee40345c74deeb0a23a856929afbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:20.151593 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bf942ad9-474b-4c0c-a0f9-b1734c068731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.154595 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bf942ad9-474b-4c0c-a0f9-b1734c068731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.157019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 997/2002] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:19 2022] DELETE /identity/v3/projects/100ee40345c74deeb0a23a856929afbe => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:20.161552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf942ad9-474b-4c0c-a0f9-b1734c068731 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:20.163194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bf942ad9-474b-4c0c-a0f9-b1734c068731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:20.235178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfa0e1-44e3-4f50-82e6-8cb4d2f4d1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:20.235976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfa0e1-44e3-4f50-82e6-8cb4d2f4d1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:20.236303 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfa0e1-44e3-4f50-82e6-8cb4d2f4d1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:20.236606 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfa0e1-44e3-4f50-82e6-8cb4d2f4d1f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:20.238270 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfa0e1-44e3-4f50-82e6-8cb4d2f4d1f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:20.249705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfa0e1-44e3-4f50-82e6-8cb4d2f4d1f8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:20.300630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1006/2003] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:20 2022] POST /identity/v3/projects => generated 371 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:20.304125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf942ad9-474b-4c0c-a0f9-b1734c068731 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:20.305627 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfa0e1-44e3-4f50-82e6-8cb4d2f4d1f8 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:20.316567 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-59dfa0e1-44e3-4f50-82e6-8cb4d2f4d1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:20.396016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24013-191c-427a-be68-b71fdde3935e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:20.397979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24013-191c-427a-be68-b71fdde3935e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:20.398275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24013-191c-427a-be68-b71fdde3935e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:20.398553 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24013-191c-427a-be68-b71fdde3935e admin admin] PATH_INFO: `/v3/users/20037243a6b84f46812e7298067fcb02` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:20.406281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f24013-191c-427a-be68-b71fdde3935e admin admin] RBAC: Authorizing `identity:delete_user(user_id=20037243a6b84f46812e7298067fcb02)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:20.413117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f24013-191c-427a-be68-b71fdde3935e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:20.455617 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfa0e1-44e3-4f50-82e6-8cb4d2f4d1f8 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:20.465987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b23ed4-df53-4356-a377-41395a2b11f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:20.466885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b23ed4-df53-4356-a377-41395a2b11f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:20.469374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b23ed4-df53-4356-a377-41395a2b11f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:20.469660 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b23ed4-df53-4356-a377-41395a2b11f5 admin admin] PATH_INFO: `/v3/projects/4ceae2f175f7434ebc45eab9564fdb45` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:20.474616 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b23ed4-df53-4356-a377-41395a2b11f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ceae2f175f7434ebc45eab9564fdb45)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:20.476593 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b23ed4-df53-4356-a377-41395a2b11f5 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:20.495725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-24f24013-191c-427a-be68-b71fdde3935e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20037243a6b84f46812e7298067fcb02'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.507507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:20.515076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-24f24013-191c-427a-be68-b71fdde3935e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20037243a6b84f46812e7298067fcb02'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.528714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-24f24013-191c-427a-be68-b71fdde3935e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20037243a6b84f46812e7298067fcb02'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.529522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-24f24013-191c-427a-be68-b71fdde3935e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20037243a6b84f46812e7298067fcb02'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.530335 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-24f24013-191c-427a-be68-b71fdde3935e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20037243a6b84f46812e7298067fcb02'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.574016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 998/2004] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:20 2022] DELETE /identity/v3/users/20037243a6b84f46812e7298067fcb02 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:20.574922 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24013-191c-427a-be68-b71fdde3935e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:20.582974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-24f24013-191c-427a-be68-b71fdde3935e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:20.585393 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f3b23ed4-df53-4356-a377-41395a2b11f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ceae2f175f7434ebc45eab9564fdb45', 'request_id': 'req-f3b23ed4-df53-4356-a377-41395a2b11f5'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.602389 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f3b23ed4-df53-4356-a377-41395a2b11f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ceae2f175f7434ebc45eab9564fdb45', 'request_id': 'req-f3b23ed4-df53-4356-a377-41395a2b11f5'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.618178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f3b23ed4-df53-4356-a377-41395a2b11f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ceae2f175f7434ebc45eab9564fdb45', 'request_id': 'req-f3b23ed4-df53-4356-a377-41395a2b11f5'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.631327 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:20.639653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f3b23ed4-df53-4356-a377-41395a2b11f5 admin admin] The token cache is being invalidate because project 4ceae2f175f7434ebc45eab9564fdb45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:20.641060 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f3b23ed4-df53-4356-a377-41395a2b11f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.641707 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f3b23ed4-df53-4356-a377-41395a2b11f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.643589 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1007/2005] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:20 2022] DELETE /identity/v3/projects/4ceae2f175f7434ebc45eab9564fdb45 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:20.647535 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b23ed4-df53-4356-a377-41395a2b11f5 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:20.656993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f3b23ed4-df53-4356-a377-41395a2b11f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:20.682736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24013-191c-427a-be68-b71fdde3935e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:20.687757 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04919f-28f2-41c9-84bc-536a95161733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:20.688581 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04919f-28f2-41c9-84bc-536a95161733 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:20.688867 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04919f-28f2-41c9-84bc-536a95161733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:20.689474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04919f-28f2-41c9-84bc-536a95161733 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:20.689830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04919f-28f2-41c9-84bc-536a95161733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:20.692007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04919f-28f2-41c9-84bc-536a95161733 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:20.745067 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 999/2006] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:20 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:20.746047 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04919f-28f2-41c9-84bc-536a95161733 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:20.750130 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9b04919f-28f2-41c9-84bc-536a95161733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:20.775597 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04919f-28f2-41c9-84bc-536a95161733 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:20.785044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987ded9-6bdc-4edd-922a-ac728293630e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:20.786005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987ded9-6bdc-4edd-922a-ac728293630e admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:20.786392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987ded9-6bdc-4edd-922a-ac728293630e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:20.786788 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987ded9-6bdc-4edd-922a-ac728293630e admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:20.787683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987ded9-6bdc-4edd-922a-ac728293630e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:20.790062 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987ded9-6bdc-4edd-922a-ac728293630e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:20.803762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b23ed4-df53-4356-a377-41395a2b11f5 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:20.815181 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753a75e-c0c5-440c-b35a-0a6fc3398e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:20.818390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753a75e-c0c5-440c-b35a-0a6fc3398e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:20.818721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753a75e-c0c5-440c-b35a-0a6fc3398e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:20.819848 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753a75e-c0c5-440c-b35a-0a6fc3398e93 admin admin] PATH_INFO: `/v3/users/c6e28414e4164981a519e2d057166ec2` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:20.823564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753a75e-c0c5-440c-b35a-0a6fc3398e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e28414e4164981a519e2d057166ec2)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:20.830009 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753a75e-c0c5-440c-b35a-0a6fc3398e93 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:20.830797 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1000/2007] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:20.832271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987ded9-6bdc-4edd-922a-ac728293630e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:20.863393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987ded9-6bdc-4edd-922a-ac728293630e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:20.879244 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25234f5-aff5-4308-a856-aade601ad653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:20.880875 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25234f5-aff5-4308-a856-aade601ad653 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:20.884227 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25234f5-aff5-4308-a856-aade601ad653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:20.887209 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25234f5-aff5-4308-a856-aade601ad653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:20.890466 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25234f5-aff5-4308-a856-aade601ad653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:20.895243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25234f5-aff5-4308-a856-aade601ad653 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:20.929235 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1001/2008] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:20.930904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25234f5-aff5-4308-a856-aade601ad653 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:20.938825 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e753a75e-c0c5-440c-b35a-0a6fc3398e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e28414e4164981a519e2d057166ec2'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.950497 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e753a75e-c0c5-440c-b35a-0a6fc3398e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e28414e4164981a519e2d057166ec2'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.951500 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e753a75e-c0c5-440c-b35a-0a6fc3398e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e28414e4164981a519e2d057166ec2'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.957913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25234f5-aff5-4308-a856-aade601ad653 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:20.963078 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724b10d-dc9d-4459-b099-b53b0bdc1319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:20.964228 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724b10d-dc9d-4459-b099-b53b0bdc1319 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:20.964928 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724b10d-dc9d-4459-b099-b53b0bdc1319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:20.965407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724b10d-dc9d-4459-b099-b53b0bdc1319 admin admin] PATH_INFO: `/v3/projects/41698fbb59bd4130a7760096c05990b4/users/90836d64c1e2419b85d9c91a3bfba7a1/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:20.971417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e753a75e-c0c5-440c-b35a-0a6fc3398e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e28414e4164981a519e2d057166ec2'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:20.972914 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e753a75e-c0c5-440c-b35a-0a6fc3398e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e28414e4164981a519e2d057166ec2'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:21.001436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1008/2009] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:20 2022] DELETE /identity/v3/users/c6e28414e4164981a519e2d057166ec2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:21.005665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724b10d-dc9d-4459-b099-b53b0bdc1319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41698fbb59bd4130a7760096c05990b4, user_id=90836d64c1e2419b85d9c91a3bfba7a1, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:21.009676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724b10d-dc9d-4459-b099-b53b0bdc1319 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:21.033197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1002/2010] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:20 2022] PUT /identity/v3/projects/41698fbb59bd4130a7760096c05990b4/users/90836d64c1e2419b85d9c91a3bfba7a1/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:21.034733 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d4331-6ace-4c0c-ac42-d42aeb503f88 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:21.035026 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d4331-6ace-4c0c-ac42-d42aeb503f88 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:21.035354 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d4331-6ace-4c0c-ac42-d42aeb503f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:21.068060 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-638d4331-6ace-4c0c-ac42-d42aeb503f88 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:21.069349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-638d4331-6ace-4c0c-ac42-d42aeb503f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:21.141232 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1009/2011] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:21.291564 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724b10d-dc9d-4459-b099-b53b0bdc1319 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:21.293752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a724b10d-dc9d-4459-b099-b53b0bdc1319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:21.446514 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724b10d-dc9d-4459-b099-b53b0bdc1319 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:21.450883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c070e0c-2781-4e0a-b412-519d80954c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:21.451792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c070e0c-2781-4e0a-b412-519d80954c9f service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:21.452096 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c070e0c-2781-4e0a-b412-519d80954c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:21.452411 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c070e0c-2781-4e0a-b412-519d80954c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:21.467937 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c070e0c-2781-4e0a-b412-519d80954c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:21.469542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c070e0c-2781-4e0a-b412-519d80954c9f service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:21.485118 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1003/2012] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:22.018367 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d4331-6ace-4c0c-ac42-d42aeb503f88 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:22.021350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-638d4331-6ace-4c0c-ac42-d42aeb503f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:22.056508 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d4331-6ace-4c0c-ac42-d42aeb503f88 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:22.064770 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed77586-b08b-47c4-8b50-25cf2edadf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:22.066162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed77586-b08b-47c4-8b50-25cf2edadf66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:22.066698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed77586-b08b-47c4-8b50-25cf2edadf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:22.067670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed77586-b08b-47c4-8b50-25cf2edadf66 admin admin] PATH_INFO: `/v3/projects/4d75d4443bdd4c8ead2bed6cafc8b850` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:22.070161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed77586-b08b-47c4-8b50-25cf2edadf66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d75d4443bdd4c8ead2bed6cafc8b850)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:22.073823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed77586-b08b-47c4-8b50-25cf2edadf66 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:22.108388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:22.151929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-8ed77586-b08b-47c4-8b50-25cf2edadf66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d75d4443bdd4c8ead2bed6cafc8b850', 'request_id': 'req-8ed77586-b08b-47c4-8b50-25cf2edadf66'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:22.158517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-8ed77586-b08b-47c4-8b50-25cf2edadf66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d75d4443bdd4c8ead2bed6cafc8b850', 'request_id': 'req-8ed77586-b08b-47c4-8b50-25cf2edadf66'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:22.168135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-8ed77586-b08b-47c4-8b50-25cf2edadf66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d75d4443bdd4c8ead2bed6cafc8b850', 'request_id': 'req-8ed77586-b08b-47c4-8b50-25cf2edadf66'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:22.186151 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-8ed77586-b08b-47c4-8b50-25cf2edadf66 admin admin] The token cache is being invalidate because project 4d75d4443bdd4c8ead2bed6cafc8b850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:22.186820 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-8ed77586-b08b-47c4-8b50-25cf2edadf66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:22.187860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-8ed77586-b08b-47c4-8b50-25cf2edadf66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:22.194415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1010/2013] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:22 2022] DELETE /identity/v3/projects/4d75d4443bdd4c8ead2bed6cafc8b850 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:22.196772 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c070e0c-2781-4e0a-b412-519d80954c9f service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:22.217455 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c070e0c-2781-4e0a-b412-519d80954c9f service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:22.238463 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:22.316506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758df8a-62a4-4545-ad97-1e05c561f09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:22.317866 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758df8a-62a4-4545-ad97-1e05c561f09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:22.318337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758df8a-62a4-4545-ad97-1e05c561f09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:22.318695 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758df8a-62a4-4545-ad97-1e05c561f09c admin admin] PATH_INFO: `/v3/users/4cac485c7c274fccbb96e94618613672` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:22.320069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758df8a-62a4-4545-ad97-1e05c561f09c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cac485c7c274fccbb96e94618613672)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:22.323266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758df8a-62a4-4545-ad97-1e05c561f09c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:22.376926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed77586-b08b-47c4-8b50-25cf2edadf66 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:22.383763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8ed77586-b08b-47c4-8b50-25cf2edadf66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:22.403859 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d758df8a-62a4-4545-ad97-1e05c561f09c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cac485c7c274fccbb96e94618613672'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:22.419311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d758df8a-62a4-4545-ad97-1e05c561f09c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cac485c7c274fccbb96e94618613672'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:22.422324 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed77586-b08b-47c4-8b50-25cf2edadf66 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:22.429882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d758df8a-62a4-4545-ad97-1e05c561f09c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cac485c7c274fccbb96e94618613672'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:22.430671 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d758df8a-62a4-4545-ad97-1e05c561f09c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cac485c7c274fccbb96e94618613672'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:22.432162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d758df8a-62a4-4545-ad97-1e05c561f09c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cac485c7c274fccbb96e94618613672'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:22.435115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f46819-418b-40b1-92df-e4ece8241ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:22.436343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f46819-418b-40b1-92df-e4ece8241ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:22.436806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f46819-418b-40b1-92df-e4ece8241ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:22.437207 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f46819-418b-40b1-92df-e4ece8241ad3 admin admin] PATH_INFO: `/v3/projects/74688b2e564d484e98518946deee146a` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:22.438640 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f46819-418b-40b1-92df-e4ece8241ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74688b2e564d484e98518946deee146a)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:22.441476 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f46819-418b-40b1-92df-e4ece8241ad3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:22.469137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1004/2014] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:22 2022] DELETE /identity/v3/users/4cac485c7c274fccbb96e94618613672 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:22.513218 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b0f46819-418b-40b1-92df-e4ece8241ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74688b2e564d484e98518946deee146a', 'request_id': 'req-b0f46819-418b-40b1-92df-e4ece8241ad3'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:22.520894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b0f46819-418b-40b1-92df-e4ece8241ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74688b2e564d484e98518946deee146a', 'request_id': 'req-b0f46819-418b-40b1-92df-e4ece8241ad3'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:22.527515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b0f46819-418b-40b1-92df-e4ece8241ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74688b2e564d484e98518946deee146a', 'request_id': 'req-b0f46819-418b-40b1-92df-e4ece8241ad3'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:22.540802 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b0f46819-418b-40b1-92df-e4ece8241ad3 admin admin] The token cache is being invalidate because project 74688b2e564d484e98518946deee146a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:22.541189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b0f46819-418b-40b1-92df-e4ece8241ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:22.541891 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b0f46819-418b-40b1-92df-e4ece8241ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:22.543689 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1011/2015] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:22 2022] DELETE /identity/v3/projects/74688b2e564d484e98518946deee146a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:22.549642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f43d5-0bfe-47b4-9df3-31d9f6db617b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:22.550952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f43d5-0bfe-47b4-9df3-31d9f6db617b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:22.551384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f43d5-0bfe-47b4-9df3-31d9f6db617b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:22.571702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-912f43d5-0bfe-47b4-9df3-31d9f6db617b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:22.572688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-912f43d5-0bfe-47b4-9df3-31d9f6db617b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:22.675254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1005/2016] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:22.677011 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037a38b-394b-4f9b-b7c8-4821743f72f2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:22.677306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037a38b-394b-4f9b-b7c8-4821743f72f2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:22.677588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037a38b-394b-4f9b-b7c8-4821743f72f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:22.700970 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4037a38b-394b-4f9b-b7c8-4821743f72f2 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:22.704894 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e540fb-00ad-4eb4-9f76-1b6b7ba81812 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:22.705187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e540fb-00ad-4eb4-9f76-1b6b7ba81812 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:22.705736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e540fb-00ad-4eb4-9f76-1b6b7ba81812 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:22.707264 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1006/2017] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 7 22:02:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 22:02:22.708216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4037a38b-394b-4f9b-b7c8-4821743f72f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:22.722629 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e528c-0364-4d83-aaf1-c85d04d28ae4 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:22.722936 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e528c-0364-4d83-aaf1-c85d04d28ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:22.723217 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e528c-0364-4d83-aaf1-c85d04d28ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:22.738956 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1012/2018] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:22.744781 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037a38b-394b-4f9b-b7c8-4821743f72f2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:22.766962 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037a38b-394b-4f9b-b7c8-4821743f72f2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:22.777280 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d10e528c-0364-4d83-aaf1-c85d04d28ae4 None None] MFA Rules not processed for user `90836d64c1e2419b85d9c91a3bfba7a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:22.778675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81146fbd-cb2e-42ba-ada5-f643ca41b4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:22.779356 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81146fbd-cb2e-42ba-ada5-f643ca41b4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:22.779639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81146fbd-cb2e-42ba-ada5-f643ca41b4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:22.781006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d10e528c-0364-4d83-aaf1-c85d04d28ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:22.782823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81146fbd-cb2e-42ba-ada5-f643ca41b4c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:22.783688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81146fbd-cb2e-42ba-ada5-f643ca41b4c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:22.784005 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81146fbd-cb2e-42ba-ada5-f643ca41b4c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:22.785664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81146fbd-cb2e-42ba-ada5-f643ca41b4c1 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:22.822885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1013/2019] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:02:22.823581 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c04c4-22f0-4709-a66b-b2957732521c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:22.823883 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c04c4-22f0-4709-a66b-b2957732521c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:22.827284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c04c4-22f0-4709-a66b-b2957732521c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:22.870661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:22.873493 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ef3c04c4-22f0-4709-a66b-b2957732521c None None] MFA Rules not processed for user `90facf92f97d435dbe8a001759a8fe0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:22.874962 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ef3c04c4-22f0-4709-a66b-b2957732521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:23.019366 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1007/2020] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:23.019366 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e528c-0364-4d83-aaf1-c85d04d28ae4 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:23.048754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e528c-0364-4d83-aaf1-c85d04d28ae4 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:23.060560 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4b7a3-e96c-4eea-82c6-87c2471e5689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:23.061320 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4b7a3-e96c-4eea-82c6-87c2471e5689 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:23.061661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4b7a3-e96c-4eea-82c6-87c2471e5689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:23.062057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4b7a3-e96c-4eea-82c6-87c2471e5689 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:23.063019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4b7a3-e96c-4eea-82c6-87c2471e5689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:23.065194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4b7a3-e96c-4eea-82c6-87c2471e5689 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:23.089316 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1014/2021] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 7 22:02:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:23.090064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c04c4-22f0-4709-a66b-b2957732521c None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:23.091577 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ef3c04c4-22f0-4709-a66b-b2957732521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:23.102508 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:23.116828 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c04c4-22f0-4709-a66b-b2957732521c None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:23.123269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1008/2022] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:23 2022] POST /identity/v3/projects => generated 409 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:23.127330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416047d0-bd09-4d5c-87c8-807382c142e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:23.128430 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416047d0-bd09-4d5c-87c8-807382c142e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:23.128722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416047d0-bd09-4d5c-87c8-807382c142e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:23.129005 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416047d0-bd09-4d5c-87c8-807382c142e0 admin admin] PATH_INFO: `/v3/users/6288fe29163c4c1598224f2588467102` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:23.130417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416047d0-bd09-4d5c-87c8-807382c142e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6288fe29163c4c1598224f2588467102)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:23.134096 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416047d0-bd09-4d5c-87c8-807382c142e0 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:23.138691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4b7a3-e96c-4eea-82c6-87c2471e5689 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:23.148158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9fe4b7a3-e96c-4eea-82c6-87c2471e5689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:23.205880 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-416047d0-bd09-4d5c-87c8-807382c142e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6288fe29163c4c1598224f2588467102'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:23.214657 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-416047d0-bd09-4d5c-87c8-807382c142e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6288fe29163c4c1598224f2588467102'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:23.215410 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-416047d0-bd09-4d5c-87c8-807382c142e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6288fe29163c4c1598224f2588467102'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:23.226558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-416047d0-bd09-4d5c-87c8-807382c142e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6288fe29163c4c1598224f2588467102'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:23.228098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-416047d0-bd09-4d5c-87c8-807382c142e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6288fe29163c4c1598224f2588467102'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:23.241864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4b7a3-e96c-4eea-82c6-87c2471e5689 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:23.247352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:23.248231 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:23.248517 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:23.248785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe admin admin] PATH_INFO: `/v3/projects/e09afcf72b8c4923a5b3b4efe98f8896` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:23.250620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e09afcf72b8c4923a5b3b4efe98f8896)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:23.252541 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:23.270868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1015/2023] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:23 2022] DELETE /identity/v3/users/6288fe29163c4c1598224f2588467102 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:23.272440 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416047d0-bd09-4d5c-87c8-807382c142e0 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:23.274790 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-416047d0-bd09-4d5c-87c8-807382c142e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:23.345883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e09afcf72b8c4923a5b3b4efe98f8896', 'request_id': 'req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:23.353569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e09afcf72b8c4923a5b3b4efe98f8896', 'request_id': 'req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:23.361815 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e09afcf72b8c4923a5b3b4efe98f8896', 'request_id': 'req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:23.386198 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe admin admin] The token cache is being invalidate because project e09afcf72b8c4923a5b3b4efe98f8896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:23.386489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:23.388768 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:23.391392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1009/2024] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:23 2022] DELETE /identity/v3/projects/e09afcf72b8c4923a5b3b4efe98f8896 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:23.394984 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:23.402469 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:23.402669 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416047d0-bd09-4d5c-87c8-807382c142e0 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:23.477810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:23.492507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf1e00-c29e-4a33-af72-2a7b50051bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:23.493200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf1e00-c29e-4a33-af72-2a7b50051bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:23.493566 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf1e00-c29e-4a33-af72-2a7b50051bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:23.493748 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf1e00-c29e-4a33-af72-2a7b50051bf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:23.494555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf1e00-c29e-4a33-af72-2a7b50051bf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:23.497775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf1e00-c29e-4a33-af72-2a7b50051bf2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:23.555415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1016/2025] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:23 2022] POST /identity/v3/projects => generated 371 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:23.556684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf1e00-c29e-4a33-af72-2a7b50051bf2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:23.559995 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-01cf1e00-c29e-4a33-af72-2a7b50051bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:23.565422 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fb9e2-6552-4f27-bc98-2e039af56ffe admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:23.591793 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:23.665523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120d406-f71a-4256-a817-e89388bfedf8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90facf92f97d435dbe8a001759a8fe0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:23.666085 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120d406-f71a-4256-a817-e89388bfedf8 service placement] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:23.666320 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120d406-f71a-4256-a817-e89388bfedf8 service placement] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:23.666602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120d406-f71a-4256-a817-e89388bfedf8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:23.668482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c120d406-f71a-4256-a817-e89388bfedf8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:23.669523 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf1e00-c29e-4a33-af72-2a7b50051bf2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:23.675784 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38d351-1fd7-4a41-a948-19c8bcce17a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:23.676665 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38d351-1fd7-4a41-a948-19c8bcce17a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:23.677148 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38d351-1fd7-4a41-a948-19c8bcce17a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:23.677566 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38d351-1fd7-4a41-a948-19c8bcce17a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:23.678597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38d351-1fd7-4a41-a948-19c8bcce17a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:23.681007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38d351-1fd7-4a41-a948-19c8bcce17a7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:23.681622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120d406-f71a-4256-a817-e89388bfedf8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:23.683269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120d406-f71a-4256-a817-e89388bfedf8 service placement] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:23.694119 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1010/2026] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:23.695379 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148c3e3-7a0c-426e-9226-eaf6983c73d7 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:23.695756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148c3e3-7a0c-426e-9226-eaf6983c73d7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:23.695940 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148c3e3-7a0c-426e-9226-eaf6983c73d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:23.707301 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1017/2027] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:23 2022] POST /identity/v3/users => generated 305 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:23.714403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38d351-1fd7-4a41-a948-19c8bcce17a7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:23.715546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4148c3e3-7a0c-426e-9226-eaf6983c73d7 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:23.716670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-af38d351-1fd7-4a41-a948-19c8bcce17a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:23.716826 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4148c3e3-7a0c-426e-9226-eaf6983c73d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:23.733977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1011/2028] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:23.733977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148c3e3-7a0c-426e-9226-eaf6983c73d7 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:23.736115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38d351-1fd7-4a41-a948-19c8bcce17a7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:23.738226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4148c3e3-7a0c-426e-9226-eaf6983c73d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:23.741453 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c773d-a1c5-42b6-b716-a1a204b602e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:23.742315 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c773d-a1c5-42b6-b716-a1a204b602e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:23.742604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c773d-a1c5-42b6-b716-a1a204b602e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:23.743019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c773d-a1c5-42b6-b716-a1a204b602e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:23.743720 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c773d-a1c5-42b6-b716-a1a204b602e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:23.745739 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c773d-a1c5-42b6-b716-a1a204b602e2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:23.755369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148c3e3-7a0c-426e-9226-eaf6983c73d7 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:23.765155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680600fa-a984-438a-9583-d93841db7ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:23.766620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680600fa-a984-438a-9583-d93841db7ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:23.766970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680600fa-a984-438a-9583-d93841db7ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:23.767255 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680600fa-a984-438a-9583-d93841db7ea5 admin admin] PATH_INFO: `/v3/projects/04adf8fbad2b4f14afcfd20c4f2e1de0` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:23.768561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680600fa-a984-438a-9583-d93841db7ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04adf8fbad2b4f14afcfd20c4f2e1de0)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:23.769659 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1018/2029] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:23 2022] POST /identity/v3/users => generated 292 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:23.770989 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680600fa-a984-438a-9583-d93841db7ea5 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:23.773355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c773d-a1c5-42b6-b716-a1a204b602e2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:23.785237 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c773d-a1c5-42b6-b716-a1a204b602e2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:23.790492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27fb22-7ec1-456d-bf06-a38557807f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:23.791161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27fb22-7ec1-456d-bf06-a38557807f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:23.791446 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27fb22-7ec1-456d-bf06-a38557807f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:23.791852 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27fb22-7ec1-456d-bf06-a38557807f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:23.792584 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27fb22-7ec1-456d-bf06-a38557807f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:23.795389 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27fb22-7ec1-456d-bf06-a38557807f34 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:23.807684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1019/2030] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:23.809044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7761d0-45d5-4202-8104-c478171e9f52 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:23.809332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7761d0-45d5-4202-8104-c478171e9f52 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:23.809654 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7761d0-45d5-4202-8104-c478171e9f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:23.836584 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8c7761d0-45d5-4202-8104-c478171e9f52 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:23.837797 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-680600fa-a984-438a-9583-d93841db7ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04adf8fbad2b4f14afcfd20c4f2e1de0', 'request_id': 'req-680600fa-a984-438a-9583-d93841db7ea5'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:23.837916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8c7761d0-45d5-4202-8104-c478171e9f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:23.848623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-680600fa-a984-438a-9583-d93841db7ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04adf8fbad2b4f14afcfd20c4f2e1de0', 'request_id': 'req-680600fa-a984-438a-9583-d93841db7ea5'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:23.856932 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-680600fa-a984-438a-9583-d93841db7ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04adf8fbad2b4f14afcfd20c4f2e1de0', 'request_id': 'req-680600fa-a984-438a-9583-d93841db7ea5'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:23.878058 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-680600fa-a984-438a-9583-d93841db7ea5 admin admin] The token cache is being invalidate because project 04adf8fbad2b4f14afcfd20c4f2e1de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:23.878058 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-680600fa-a984-438a-9583-d93841db7ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:23.878058 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-680600fa-a984-438a-9583-d93841db7ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:23.883382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1012/2031] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:23 2022] DELETE /identity/v3/projects/04adf8fbad2b4f14afcfd20c4f2e1de0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:23.884389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680600fa-a984-438a-9583-d93841db7ea5 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:23.885894 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-680600fa-a984-438a-9583-d93841db7ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:23.941806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1020/2032] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:23.943387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7761d0-45d5-4202-8104-c478171e9f52 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:23.946520 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8c7761d0-45d5-4202-8104-c478171e9f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:23.949056 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:23.969644 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7761d0-45d5-4202-8104-c478171e9f52 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:23.984431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680600fa-a984-438a-9583-d93841db7ea5 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:23.984574 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0ecee-d441-4a8e-b444-ecd9a20019a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:23.985510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0ecee-d441-4a8e-b444-ecd9a20019a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:23.986210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0ecee-d441-4a8e-b444-ecd9a20019a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:23.986726 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0ecee-d441-4a8e-b444-ecd9a20019a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:23.987920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0ecee-d441-4a8e-b444-ecd9a20019a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:23.989917 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0ecee-d441-4a8e-b444-ecd9a20019a9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:23.995101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875cafc-e4e4-463f-98cf-46e611a72df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:23.995916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875cafc-e4e4-463f-98cf-46e611a72df7 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:23.996204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875cafc-e4e4-463f-98cf-46e611a72df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:23.996480 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875cafc-e4e4-463f-98cf-46e611a72df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:23.997199 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875cafc-e4e4-463f-98cf-46e611a72df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:23.998880 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875cafc-e4e4-463f-98cf-46e611a72df7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:24.008597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1021/2033] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:24.009739 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1013/2034] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:24.010511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904597bf-21fd-46ce-b5cf-eddea32480ec None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:24.010767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875cafc-e4e4-463f-98cf-46e611a72df7 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:24.011192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904597bf-21fd-46ce-b5cf-eddea32480ec None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:24.011660 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904597bf-21fd-46ce-b5cf-eddea32480ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:24.024404 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875cafc-e4e4-463f-98cf-46e611a72df7 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:24.031356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688debb-c601-42e6-90c0-dc9d8c1d30d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:24.032265 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688debb-c601-42e6-90c0-dc9d8c1d30d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:24.032720 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688debb-c601-42e6-90c0-dc9d8c1d30d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:24.033523 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-904597bf-21fd-46ce-b5cf-eddea32480ec None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:24.033884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688debb-c601-42e6-90c0-dc9d8c1d30d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:24.035344 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-904597bf-21fd-46ce-b5cf-eddea32480ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:24.036012 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688debb-c601-42e6-90c0-dc9d8c1d30d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:24.036505 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688debb-c601-42e6-90c0-dc9d8c1d30d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:24.040470 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688debb-c601-42e6-90c0-dc9d8c1d30d5 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:24.044463 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1022/2035] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:24.051774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904597bf-21fd-46ce-b5cf-eddea32480ec None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:24.058109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1014/2036] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:02:24.059366 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688debb-c601-42e6-90c0-dc9d8c1d30d5 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:24.064509 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904597bf-21fd-46ce-b5cf-eddea32480ec None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:24.071853 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45802085-75a2-4bb1-8ec2-4489903daa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:24.073767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45802085-75a2-4bb1-8ec2-4489903daa1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:24.073767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45802085-75a2-4bb1-8ec2-4489903daa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:24.073767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45802085-75a2-4bb1-8ec2-4489903daa1d admin admin] PATH_INFO: `/v3/projects/e2f32c4d887c4011b57f675d27e4468d/users/81c657365e4242ad9bd2c3ac5c2e81af/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:24.088195 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688debb-c601-42e6-90c0-dc9d8c1d30d5 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:24.095779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45802085-75a2-4bb1-8ec2-4489903daa1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f32c4d887c4011b57f675d27e4468d, user_id=81c657365e4242ad9bd2c3ac5c2e81af, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:24.098831 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62be92-1102-4f36-83b7-7d708840f0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:24.099409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45802085-75a2-4bb1-8ec2-4489903daa1d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:24.100282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62be92-1102-4f36-83b7-7d708840f0a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:24.100709 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62be92-1102-4f36-83b7-7d708840f0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:24.101125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62be92-1102-4f36-83b7-7d708840f0a8 admin admin] PATH_INFO: `/v3/projects/c325a1b4f6264ce089f138074bebf2a6/users/2615d73ac8eb4ed587d88094590ee8be/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:24.123915 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1023/2037] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:24 2022] PUT /identity/v3/projects/e2f32c4d887c4011b57f675d27e4468d/users/81c657365e4242ad9bd2c3ac5c2e81af/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:24.125357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27d838-4c0c-4abd-84c7-85126db30f2e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:24.125724 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27d838-4c0c-4abd-84c7-85126db30f2e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:24.125833 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62be92-1102-4f36-83b7-7d708840f0a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c325a1b4f6264ce089f138074bebf2a6, user_id=2615d73ac8eb4ed587d88094590ee8be, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:24.126142 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27d838-4c0c-4abd-84c7-85126db30f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:24.129409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62be92-1102-4f36-83b7-7d708840f0a8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:24.151290 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1015/2038] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:24 2022] PUT /identity/v3/projects/c325a1b4f6264ce089f138074bebf2a6/users/2615d73ac8eb4ed587d88094590ee8be/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:24.151290 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62be92-1102-4f36-83b7-7d708840f0a8 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:24.151803 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6b27d838-4c0c-4abd-84c7-85126db30f2e None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:24.153055 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6b27d838-4c0c-4abd-84c7-85126db30f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:24.196032 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:24.247783 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62be92-1102-4f36-83b7-7d708840f0a8 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:24.258667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1024/2039] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:24.258667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27d838-4c0c-4abd-84c7-85126db30f2e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:24.259216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6b27d838-4c0c-4abd-84c7-85126db30f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:24.262969 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14d9b8-0215-4a56-b51b-c2a27588a0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:24.264734 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14d9b8-0215-4a56-b51b-c2a27588a0fc admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:24.265303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14d9b8-0215-4a56-b51b-c2a27588a0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:24.265796 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14d9b8-0215-4a56-b51b-c2a27588a0fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:24.266772 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14d9b8-0215-4a56-b51b-c2a27588a0fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:24.268850 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14d9b8-0215-4a56-b51b-c2a27588a0fc admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:24.272896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27d838-4c0c-4abd-84c7-85126db30f2e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:24.278230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8705d-be9e-4acf-a12d-a4b4c585cc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:24.278977 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8705d-be9e-4acf-a12d-a4b4c585cc5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:24.279258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8705d-be9e-4acf-a12d-a4b4c585cc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:24.279529 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8705d-be9e-4acf-a12d-a4b4c585cc5e admin admin] PATH_INFO: `/v3/users/ef231efddef942ccbeaeff5a4eb3af12` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:24.280981 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8705d-be9e-4acf-a12d-a4b4c585cc5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef231efddef942ccbeaeff5a4eb3af12)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:24.286558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8705d-be9e-4acf-a12d-a4b4c585cc5e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:24.301170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1016/2040] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:24 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:24.302641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77284a6c-8ef8-47ae-b87b-3405f62d5947 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:24.302937 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77284a6c-8ef8-47ae-b87b-3405f62d5947 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:24.303216 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77284a6c-8ef8-47ae-b87b-3405f62d5947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:24.336302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-77284a6c-8ef8-47ae-b87b-3405f62d5947 None None] MFA Rules not processed for user `81c657365e4242ad9bd2c3ac5c2e81af`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:24.337688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-77284a6c-8ef8-47ae-b87b-3405f62d5947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:24.354945 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-9ca8705d-be9e-4acf-a12d-a4b4c585cc5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef231efddef942ccbeaeff5a4eb3af12'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:24.363780 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-9ca8705d-be9e-4acf-a12d-a4b4c585cc5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef231efddef942ccbeaeff5a4eb3af12'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:24.365272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-9ca8705d-be9e-4acf-a12d-a4b4c585cc5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef231efddef942ccbeaeff5a4eb3af12'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:24.382135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-9ca8705d-be9e-4acf-a12d-a4b4c585cc5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef231efddef942ccbeaeff5a4eb3af12'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:24.383472 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-9ca8705d-be9e-4acf-a12d-a4b4c585cc5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef231efddef942ccbeaeff5a4eb3af12'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:24.411187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1025/2041] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:24 2022] DELETE /identity/v3/users/ef231efddef942ccbeaeff5a4eb3af12 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:24.411830 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8705d-be9e-4acf-a12d-a4b4c585cc5e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:24.414082 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9ca8705d-be9e-4acf-a12d-a4b4c585cc5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:24.425456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1017/2042] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:24.426606 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77284a6c-8ef8-47ae-b87b-3405f62d5947 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:24.429694 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-77284a6c-8ef8-47ae-b87b-3405f62d5947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:24.446969 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:24.515072 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77284a6c-8ef8-47ae-b87b-3405f62d5947 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:24.589772 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8705d-be9e-4acf-a12d-a4b4c585cc5e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:24.594946 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba652c0-9452-457f-9578-f50b3f8ee6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:24.595745 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba652c0-9452-457f-9578-f50b3f8ee6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:24.596234 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba652c0-9452-457f-9578-f50b3f8ee6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:24.596579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba652c0-9452-457f-9578-f50b3f8ee6a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:24.598255 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba652c0-9452-457f-9578-f50b3f8ee6a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:24.598638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba652c0-9452-457f-9578-f50b3f8ee6a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:24.600494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba652c0-9452-457f-9578-f50b3f8ee6a4 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:24.602615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0d79d-85f4-4407-931b-54e9b085e8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:24.603281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0d79d-85f4-4407-931b-54e9b085e8cb admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:24.604153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0d79d-85f4-4407-931b-54e9b085e8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:24.604153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0d79d-85f4-4407-931b-54e9b085e8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:24.604670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0d79d-85f4-4407-931b-54e9b085e8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:24.606290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0d79d-85f4-4407-931b-54e9b085e8cb admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:24.616845 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1018/2043] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:02:24.618519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba652c0-9452-457f-9578-f50b3f8ee6a4 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:24.620489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5ba652c0-9452-457f-9578-f50b3f8ee6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:24.633916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1026/2044] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:24.633916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade183e-bbd1-4ae9-9192-80a5b6d10826 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:24.633916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade183e-bbd1-4ae9-9192-80a5b6d10826 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:24.633916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade183e-bbd1-4ae9-9192-80a5b6d10826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:24.641101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba652c0-9452-457f-9578-f50b3f8ee6a4 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:24.647023 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8ef7b-0f83-4294-9c39-3f86c47277f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:24.648277 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8ef7b-0f83-4294-9c39-3f86c47277f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:24.649436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8ef7b-0f83-4294-9c39-3f86c47277f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:24.649890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8ef7b-0f83-4294-9c39-3f86c47277f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:24.650721 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8ef7b-0f83-4294-9c39-3f86c47277f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:24.652109 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-fade183e-bbd1-4ae9-9192-80a5b6d10826 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:24.653326 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fade183e-bbd1-4ae9-9192-80a5b6d10826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:24.653773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8ef7b-0f83-4294-9c39-3f86c47277f6 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:24.662224 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1027/2045] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:24.663565 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade183e-bbd1-4ae9-9192-80a5b6d10826 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:24.664984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fade183e-bbd1-4ae9-9192-80a5b6d10826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:24.684654 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade183e-bbd1-4ae9-9192-80a5b6d10826 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:24.686376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1019/2046] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:24 2022] POST /identity/v3/users => generated 287 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:24.687487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8ef7b-0f83-4294-9c39-3f86c47277f6 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:24.696730 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea8306-c7c2-4f85-b54f-f4738494088e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:24.697785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea8306-c7c2-4f85-b54f-f4738494088e admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:24.698083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea8306-c7c2-4f85-b54f-f4738494088e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:24.698404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea8306-c7c2-4f85-b54f-f4738494088e admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:24.699335 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea8306-c7c2-4f85-b54f-f4738494088e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:24.701752 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea8306-c7c2-4f85-b54f-f4738494088e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:24.704807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8ef7b-0f83-4294-9c39-3f86c47277f6 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:24.710985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddcd64-84f5-4bd8-bd98-dc87daf14e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:24.712198 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddcd64-84f5-4bd8-bd98-dc87daf14e36 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:24.712198 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddcd64-84f5-4bd8-bd98-dc87daf14e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:24.712392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddcd64-84f5-4bd8-bd98-dc87daf14e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:24.712978 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddcd64-84f5-4bd8-bd98-dc87daf14e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:24.714978 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddcd64-84f5-4bd8-bd98-dc87daf14e36 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:24.736709 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1028/2047] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:24 2022] POST /identity/v3/projects => generated 409 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:24.741109 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea8306-c7c2-4f85-b54f-f4738494088e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:24.748691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1020/2048] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:24 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:24.749877 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddcd64-84f5-4bd8-bd98-dc87daf14e36 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:24.753088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-72ddcd64-84f5-4bd8-bd98-dc87daf14e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:24.755317 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:24.825247 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea8306-c7c2-4f85-b54f-f4738494088e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:24.842025 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddcd64-84f5-4bd8-bd98-dc87daf14e36 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:24.845989 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ca0aa-db99-45c9-ab46-539a5b7cab48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:24.846682 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ca0aa-db99-45c9-ab46-539a5b7cab48 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:24.847552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ca0aa-db99-45c9-ab46-539a5b7cab48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:24.847831 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ca0aa-db99-45c9-ab46-539a5b7cab48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:24.877407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:24.885656 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b111e66-7e37-444f-a11e-e4552e97b039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:24.886584 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b111e66-7e37-444f-a11e-e4552e97b039 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:24.886858 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b111e66-7e37-444f-a11e-e4552e97b039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:24.887127 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b111e66-7e37-444f-a11e-e4552e97b039 admin admin] PATH_INFO: `/v3/projects/c325a1b4f6264ce089f138074bebf2a6/users/2615d73ac8eb4ed587d88094590ee8be/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:24.889118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b111e66-7e37-444f-a11e-e4552e97b039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c325a1b4f6264ce089f138074bebf2a6, user_id=2615d73ac8eb4ed587d88094590ee8be, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:24.891793 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b111e66-7e37-444f-a11e-e4552e97b039 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:24.903686 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1029/2049] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:24 2022] PUT /identity/v3/projects/c325a1b4f6264ce089f138074bebf2a6/users/2615d73ac8eb4ed587d88094590ee8be/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:24.904605 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b111e66-7e37-444f-a11e-e4552e97b039 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:24.912023 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ca0aa-db99-45c9-ab46-539a5b7cab48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:24.913989 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ca0aa-db99-45c9-ab46-539a5b7cab48 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:24.925838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1021/2050] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:24.926667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ca0aa-db99-45c9-ab46-539a5b7cab48 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:24.938628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ca0aa-db99-45c9-ab46-539a5b7cab48 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:24.981839 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b111e66-7e37-444f-a11e-e4552e97b039 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:24.991301 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a704dd-166c-471f-95a4-eb32798f9050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:24.992104 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a704dd-166c-471f-95a4-eb32798f9050 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:24.992439 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a704dd-166c-471f-95a4-eb32798f9050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:24.992854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a704dd-166c-471f-95a4-eb32798f9050 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:24.993738 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a704dd-166c-471f-95a4-eb32798f9050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:24.995449 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a704dd-166c-471f-95a4-eb32798f9050 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:25.011211 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1030/2051] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:25.012037 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a704dd-166c-471f-95a4-eb32798f9050 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:25.026926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a704dd-166c-471f-95a4-eb32798f9050 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:25.031381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ee0cd-dace-4f01-b99f-9d207b0a4109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:25.032730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ee0cd-dace-4f01-b99f-9d207b0a4109 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.032854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373afeaf-b703-473a-9f55-cf0279c5b8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:25.033309 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ee0cd-dace-4f01-b99f-9d207b0a4109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.033625 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373afeaf-b703-473a-9f55-cf0279c5b8ee admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.034057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373afeaf-b703-473a-9f55-cf0279c5b8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.034341 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ee0cd-dace-4f01-b99f-9d207b0a4109 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.034509 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373afeaf-b703-473a-9f55-cf0279c5b8ee admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.035353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373afeaf-b703-473a-9f55-cf0279c5b8ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:25.035868 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ee0cd-dace-4f01-b99f-9d207b0a4109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:25.037494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373afeaf-b703-473a-9f55-cf0279c5b8ee admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:25.038847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ee0cd-dace-4f01-b99f-9d207b0a4109 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:25.071538 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1031/2052] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:25 2022] POST /identity/v3/users => generated 288 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:25.071538 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373afeaf-b703-473a-9f55-cf0279c5b8ee admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:25.078678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1022/2053] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:24 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:25.080201 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ee0cd-dace-4f01-b99f-9d207b0a4109 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:25.085701 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373afeaf-b703-473a-9f55-cf0279c5b8ee admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:25.095678 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511e130-c16d-4f0e-ae3c-7706f5513011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:25.096407 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511e130-c16d-4f0e-ae3c-7706f5513011 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.097566 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511e130-c16d-4f0e-ae3c-7706f5513011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.097786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511e130-c16d-4f0e-ae3c-7706f5513011 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.098560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511e130-c16d-4f0e-ae3c-7706f5513011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:25.100342 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511e130-c16d-4f0e-ae3c-7706f5513011 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:25.101392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ee0cd-dace-4f01-b99f-9d207b0a4109 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:25.110487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cc324-f9d7-42ec-a4c6-bd8252264791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:25.111809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cc324-f9d7-42ec-a4c6-bd8252264791 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.112346 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cc324-f9d7-42ec-a4c6-bd8252264791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.113768 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cc324-f9d7-42ec-a4c6-bd8252264791 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.115744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9cc324-f9d7-42ec-a4c6-bd8252264791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:25.116778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1032/2054] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:25.117509 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511e130-c16d-4f0e-ae3c-7706f5513011 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:25.119169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9cc324-f9d7-42ec-a4c6-bd8252264791 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:25.133801 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511e130-c16d-4f0e-ae3c-7706f5513011 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:25.142018 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1023/2055] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:25.142208 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10924696-cc1f-409d-82d7-f6313c391553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:25.142208 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10924696-cc1f-409d-82d7-f6313c391553 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.142208 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10924696-cc1f-409d-82d7-f6313c391553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.142208 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10924696-cc1f-409d-82d7-f6313c391553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.142509 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10924696-cc1f-409d-82d7-f6313c391553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:25.144637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cc324-f9d7-42ec-a4c6-bd8252264791 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:25.145853 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10924696-cc1f-409d-82d7-f6313c391553 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:25.160524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1033/2056] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:25.161860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cc324-f9d7-42ec-a4c6-bd8252264791 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:25.162950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10924696-cc1f-409d-82d7-f6313c391553 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:25.170114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b52dfa-3365-4545-824a-3636a8099e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:25.171012 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:25.171766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b52dfa-3365-4545-824a-3636a8099e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.173281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b52dfa-3365-4545-824a-3636a8099e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.174513 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b52dfa-3365-4545-824a-3636a8099e4e admin admin] PATH_INFO: `/v3/projects/bf9a1acda619418fadaeffbc0e730816/users/c7a522aaa3bc445ea8c01830bd57c84d/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.191930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10924696-cc1f-409d-82d7-f6313c391553 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:25.214073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027eaa3-141a-41f6-bbc5-87aba0f483d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:25.216648 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027eaa3-141a-41f6-bbc5-87aba0f483d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.218585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027eaa3-141a-41f6-bbc5-87aba0f483d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.219227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027eaa3-141a-41f6-bbc5-87aba0f483d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.219439 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b52dfa-3365-4545-824a-3636a8099e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9a1acda619418fadaeffbc0e730816, user_id=c7a522aaa3bc445ea8c01830bd57c84d, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:25.222342 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027eaa3-141a-41f6-bbc5-87aba0f483d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:25.226175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b52dfa-3365-4545-824a-3636a8099e4e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:25.226410 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027eaa3-141a-41f6-bbc5-87aba0f483d9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:25.245501 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1034/2057] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:25.246343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027eaa3-141a-41f6-bbc5-87aba0f483d9 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:25.258157 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027eaa3-141a-41f6-bbc5-87aba0f483d9 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:25.272188 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1024/2058] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:25 2022] PUT /identity/v3/projects/bf9a1acda619418fadaeffbc0e730816/users/c7a522aaa3bc445ea8c01830bd57c84d/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:25.273798 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b52dfa-3365-4545-824a-3636a8099e4e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:25.337058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5f153-fd8c-4f53-8457-6946f54a876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:25.337974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5f153-fd8c-4f53-8457-6946f54a876c admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.338265 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5f153-fd8c-4f53-8457-6946f54a876c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.338539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5f153-fd8c-4f53-8457-6946f54a876c admin admin] PATH_INFO: `/v3/projects/edbf90d1cbe44598a4d1fa4dc2ec9196/users/941b13b5450d436284373f2325af20c7/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.359016 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5f153-fd8c-4f53-8457-6946f54a876c admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbf90d1cbe44598a4d1fa4dc2ec9196, user_id=941b13b5450d436284373f2325af20c7, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:25.373147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5f153-fd8c-4f53-8457-6946f54a876c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:25.381249 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b52dfa-3365-4545-824a-3636a8099e4e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:25.391356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b36ed-1c94-4a91-bd0a-07ced2dad0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:25.392833 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b36ed-1c94-4a91-bd0a-07ced2dad0f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.393125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b36ed-1c94-4a91-bd0a-07ced2dad0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.393409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b36ed-1c94-4a91-bd0a-07ced2dad0f4 admin admin] PATH_INFO: `/v3/projects/8d20f02ef24645b792d6c17db3e180dd/users/a704b53ec07e4fefb6c208b8291fe12f/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.395200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1035/2059] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:25 2022] PUT /identity/v3/projects/edbf90d1cbe44598a4d1fa4dc2ec9196/users/941b13b5450d436284373f2325af20c7/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:25.401187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6315364-46a8-4d67-9043-a7db2fa7aa29 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.401542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6315364-46a8-4d67-9043-a7db2fa7aa29 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.401824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6315364-46a8-4d67-9043-a7db2fa7aa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.424802 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b36ed-1c94-4a91-bd0a-07ced2dad0f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d20f02ef24645b792d6c17db3e180dd, user_id=a704b53ec07e4fefb6c208b8291fe12f, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:25.429374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b36ed-1c94-4a91-bd0a-07ced2dad0f4 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:25.449646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1025/2060] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:25 2022] PUT /identity/v3/projects/8d20f02ef24645b792d6c17db3e180dd/users/a704b53ec07e4fefb6c208b8291fe12f/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:25.450597 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b36ed-1c94-4a91-bd0a-07ced2dad0f4 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:25.452519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-cd4b36ed-1c94-4a91-bd0a-07ced2dad0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:25.462285 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:25.465143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f6315364-46a8-4d67-9043-a7db2fa7aa29 None None] MFA Rules not processed for user `c7a522aaa3bc445ea8c01830bd57c84d`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:25.467732 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f6315364-46a8-4d67-9043-a7db2fa7aa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:25.551629 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b36ed-1c94-4a91-bd0a-07ced2dad0f4 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:25.556919 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4957818-66a2-481e-a748-bf058fb397a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:25.557895 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4957818-66a2-481e-a748-bf058fb397a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.558223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4957818-66a2-481e-a748-bf058fb397a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.558798 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4957818-66a2-481e-a748-bf058fb397a2 admin admin] PATH_INFO: `/v3/projects/4d8022b2d4624c1a9997e3a640ad2523` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.559921 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4957818-66a2-481e-a748-bf058fb397a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8022b2d4624c1a9997e3a640ad2523)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:25.561718 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4957818-66a2-481e-a748-bf058fb397a2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:25.566328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1036/2061] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:25.566328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6315364-46a8-4d67-9043-a7db2fa7aa29 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:25.578558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6315364-46a8-4d67-9043-a7db2fa7aa29 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:25.584226 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b950d-b019-449c-95a5-de01ff940e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:25.584918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b950d-b019-449c-95a5-de01ff940e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.585258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b950d-b019-449c-95a5-de01ff940e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.585611 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b950d-b019-449c-95a5-de01ff940e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.586456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b950d-b019-449c-95a5-de01ff940e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:25.588292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b950d-b019-449c-95a5-de01ff940e49 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:25.599800 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1037/2062] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:25.601123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6e240-a15b-4e67-aa40-8327566f3187 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.601464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6e240-a15b-4e67-aa40-8327566f3187 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.602070 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6e240-a15b-4e67-aa40-8327566f3187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.625956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b4957818-66a2-481e-a748-bf058fb397a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8022b2d4624c1a9997e3a640ad2523', 'request_id': 'req-b4957818-66a2-481e-a748-bf058fb397a2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:25.634303 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d8a6e240-a15b-4e67-aa40-8327566f3187 None None] MFA Rules not processed for user `a704b53ec07e4fefb6c208b8291fe12f`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:25.634780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b4957818-66a2-481e-a748-bf058fb397a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8022b2d4624c1a9997e3a640ad2523', 'request_id': 'req-b4957818-66a2-481e-a748-bf058fb397a2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:25.635649 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d8a6e240-a15b-4e67-aa40-8327566f3187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:25.642679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b4957818-66a2-481e-a748-bf058fb397a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8022b2d4624c1a9997e3a640ad2523', 'request_id': 'req-b4957818-66a2-481e-a748-bf058fb397a2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:25.657995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b4957818-66a2-481e-a748-bf058fb397a2 admin admin] The token cache is being invalidate because project 4d8022b2d4624c1a9997e3a640ad2523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:25.658579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b4957818-66a2-481e-a748-bf058fb397a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:25.660098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b4957818-66a2-481e-a748-bf058fb397a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:25.665126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1026/2063] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:25 2022] DELETE /identity/v3/projects/4d8022b2d4624c1a9997e3a640ad2523 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:25.665868 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4957818-66a2-481e-a748-bf058fb397a2 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:25.667422 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b4957818-66a2-481e-a748-bf058fb397a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:25.685238 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:25.713399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1038/2064] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:25.714173 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6e240-a15b-4e67-aa40-8327566f3187 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:25.715721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d8a6e240-a15b-4e67-aa40-8327566f3187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:25.737216 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4957818-66a2-481e-a748-bf058fb397a2 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:25.745442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfb42a-649e-419f-b545-649703908116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:25.746223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfb42a-649e-419f-b545-649703908116 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.746886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfb42a-649e-419f-b545-649703908116 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.747157 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfb42a-649e-419f-b545-649703908116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.749031 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4ebfb42a-649e-419f-b545-649703908116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:25.792089 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6e240-a15b-4e67-aa40-8327566f3187 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:25.797593 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8aaf9d-6a17-4492-b395-448bb0b360d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:25.798617 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8aaf9d-6a17-4492-b395-448bb0b360d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.798811 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8aaf9d-6a17-4492-b395-448bb0b360d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.799066 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8aaf9d-6a17-4492-b395-448bb0b360d0 admin admin] PATH_INFO: `/v3/projects/edbf90d1cbe44598a4d1fa4dc2ec9196/users/941b13b5450d436284373f2325af20c7/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.801879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8aaf9d-6a17-4492-b395-448bb0b360d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbf90d1cbe44598a4d1fa4dc2ec9196, user_id=941b13b5450d436284373f2325af20c7, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:25.804485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8aaf9d-6a17-4492-b395-448bb0b360d0 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:25.804931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:25.815955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1039/2065] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:25 2022] PUT /identity/v3/projects/edbf90d1cbe44598a4d1fa4dc2ec9196/users/941b13b5450d436284373f2325af20c7/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:25.819307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ff91d-f88e-478f-a844-61064170b4b6 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.819698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ff91d-f88e-478f-a844-61064170b4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.820077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ff91d-f88e-478f-a844-61064170b4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.826821 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfb42a-649e-419f-b545-649703908116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:25.829475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfb42a-649e-419f-b545-649703908116 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:25.840104 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3d4ff91d-f88e-478f-a844-61064170b4b6 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:25.840746 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1027/2066] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:25.841565 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfb42a-649e-419f-b545-649703908116 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:25.843531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4ebfb42a-649e-419f-b545-649703908116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:25.851081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3d4ff91d-f88e-478f-a844-61064170b4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:25.865748 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfb42a-649e-419f-b545-649703908116 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:25.952765 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273aea4-6f5e-4b87-bb3d-067267c1e231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:25.953687 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273aea4-6f5e-4b87-bb3d-067267c1e231 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.954105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273aea4-6f5e-4b87-bb3d-067267c1e231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.954507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273aea4-6f5e-4b87-bb3d-067267c1e231 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.955310 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273aea4-6f5e-4b87-bb3d-067267c1e231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:25.957530 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273aea4-6f5e-4b87-bb3d-067267c1e231 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:25.958186 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1040/2067] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:25.959315 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d197b8-14bc-4590-859f-050495e433dd None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:25.959610 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d197b8-14bc-4590-859f-050495e433dd None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:25.959899 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d197b8-14bc-4590-859f-050495e433dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:25.991923 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-88d197b8-14bc-4590-859f-050495e433dd None None] MFA Rules not processed for user `2615d73ac8eb4ed587d88094590ee8be`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:25.993312 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-88d197b8-14bc-4590-859f-050495e433dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:26.005468 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1028/2068] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:25 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:26.005468 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc538f-6cbe-45e4-9c85-79e0583b1a49 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.005468 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc538f-6cbe-45e4-9c85-79e0583b1a49 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.006028 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc538f-6cbe-45e4-9c85-79e0583b1a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:26.042295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-24cc538f-6cbe-45e4-9c85-79e0583b1a49 None None] MFA Rules not processed for user `941b13b5450d436284373f2325af20c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:26.043509 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-24cc538f-6cbe-45e4-9c85-79e0583b1a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:26.079359 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1041/2069] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:26.085205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d197b8-14bc-4590-859f-050495e433dd None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:26.087008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-88d197b8-14bc-4590-859f-050495e433dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:26.100156 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:26.105107 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d197b8-14bc-4590-859f-050495e433dd None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:26.117303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1029/2070] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:26 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:26.118668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e492f-9ac3-4808-b612-a4536fa9f51a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.118937 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e492f-9ac3-4808-b612-a4536fa9f51a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.119209 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e492f-9ac3-4808-b612-a4536fa9f51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:26.137135 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1b5e492f-9ac3-4808-b612-a4536fa9f51a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:26.138349 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1b5e492f-9ac3-4808-b612-a4536fa9f51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:26.168236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464283dd-0f14-44d6-bb44-84e3fd1795be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:26.169136 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464283dd-0f14-44d6-bb44-84e3fd1795be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.169416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464283dd-0f14-44d6-bb44-84e3fd1795be admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.169690 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464283dd-0f14-44d6-bb44-84e3fd1795be admin admin] PATH_INFO: `/v3/users/c7a522aaa3bc445ea8c01830bd57c84d` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:26.171371 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464283dd-0f14-44d6-bb44-84e3fd1795be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7a522aaa3bc445ea8c01830bd57c84d)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:26.173665 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464283dd-0f14-44d6-bb44-84e3fd1795be admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:26.193999 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:26.205436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1030/2071] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:26.207018 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e492f-9ac3-4808-b612-a4536fa9f51a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:26.216653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e492f-9ac3-4808-b612-a4536fa9f51a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:26.221768 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a43a6-ecbb-4060-b9af-9a5ecbe0545f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:26.222575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a43a6-ecbb-4060-b9af-9a5ecbe0545f admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.222706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-464283dd-0f14-44d6-bb44-84e3fd1795be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7a522aaa3bc445ea8c01830bd57c84d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:26.222854 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a43a6-ecbb-4060-b9af-9a5ecbe0545f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.223126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a43a6-ecbb-4060-b9af-9a5ecbe0545f admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:26.223806 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a43a6-ecbb-4060-b9af-9a5ecbe0545f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:26.225877 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a43a6-ecbb-4060-b9af-9a5ecbe0545f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:26.230301 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-464283dd-0f14-44d6-bb44-84e3fd1795be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7a522aaa3bc445ea8c01830bd57c84d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:26.230995 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-464283dd-0f14-44d6-bb44-84e3fd1795be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7a522aaa3bc445ea8c01830bd57c84d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:26.241615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-464283dd-0f14-44d6-bb44-84e3fd1795be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7a522aaa3bc445ea8c01830bd57c84d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:26.242335 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-464283dd-0f14-44d6-bb44-84e3fd1795be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7a522aaa3bc445ea8c01830bd57c84d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:26.248480 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1031/2072] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:26 2022] POST /identity/v3/users => generated 294 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:26.250043 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a2895-ccfe-484c-bcbe-bd19d5a30f21 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.250335 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a2895-ccfe-484c-bcbe-bd19d5a30f21 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.250611 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a2895-ccfe-484c-bcbe-bd19d5a30f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:26.266423 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1042/2073] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:26 2022] DELETE /identity/v3/users/c7a522aaa3bc445ea8c01830bd57c84d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:26.267507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464283dd-0f14-44d6-bb44-84e3fd1795be admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:26.269138 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-464283dd-0f14-44d6-bb44-84e3fd1795be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:26.270239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7d7a2895-ccfe-484c-bcbe-bd19d5a30f21 None None] MFA Rules not processed for user `90836d64c1e2419b85d9c91a3bfba7a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:26.271397 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7d7a2895-ccfe-484c-bcbe-bd19d5a30f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:26.330441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1032/2074] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:26.331308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a2895-ccfe-484c-bcbe-bd19d5a30f21 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:26.332540 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7d7a2895-ccfe-484c-bcbe-bd19d5a30f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:26.341407 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464283dd-0f14-44d6-bb44-84e3fd1795be admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:26.345574 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8ce24-febe-4e37-85dc-52db79577438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:26.346422 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8ce24-febe-4e37-85dc-52db79577438 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.346756 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8ce24-febe-4e37-85dc-52db79577438 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.347231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8ce24-febe-4e37-85dc-52db79577438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:26.353867 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-69f8ce24-febe-4e37-85dc-52db79577438 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:26.400524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:26.413684 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a2895-ccfe-484c-bcbe-bd19d5a30f21 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:26.419796 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a220923-f09c-44af-a97a-bf2059088e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:26.420497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a220923-f09c-44af-a97a-bf2059088e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.420821 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a220923-f09c-44af-a97a-bf2059088e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.421230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a220923-f09c-44af-a97a-bf2059088e7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:26.421878 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a220923-f09c-44af-a97a-bf2059088e7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:26.422222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a220923-f09c-44af-a97a-bf2059088e7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:26.423815 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a220923-f09c-44af-a97a-bf2059088e7c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:26.433681 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8ce24-febe-4e37-85dc-52db79577438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:26.435246 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8ce24-febe-4e37-85dc-52db79577438 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:26.439612 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1033/2075] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:02:26.439612 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a220923-f09c-44af-a97a-bf2059088e7c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:26.439612 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3a220923-f09c-44af-a97a-bf2059088e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:26.445499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1043/2076] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:26 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:26.447309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d2512-8cb8-44e1-84e0-c6696632d069 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.447610 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d2512-8cb8-44e1-84e0-c6696632d069 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.447898 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d2512-8cb8-44e1-84e0-c6696632d069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:26.451402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a220923-f09c-44af-a97a-bf2059088e7c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:26.456261 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fff16-efe1-416c-b664-c0222fd6b5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:26.456915 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fff16-efe1-416c-b664-c0222fd6b5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.457194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fff16-efe1-416c-b664-c0222fd6b5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.457461 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fff16-efe1-416c-b664-c0222fd6b5e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:26.458246 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fff16-efe1-416c-b664-c0222fd6b5e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:26.459832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fff16-efe1-416c-b664-c0222fd6b5e4 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:26.465388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c38d2512-8cb8-44e1-84e0-c6696632d069 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:26.466818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c38d2512-8cb8-44e1-84e0-c6696632d069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:26.472487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1034/2077] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:26.473306 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fff16-efe1-416c-b664-c0222fd6b5e4 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:26.475046 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-380fff16-efe1-416c-b664-c0222fd6b5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:26.479070 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1044/2078] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:26.479070 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d2512-8cb8-44e1-84e0-c6696632d069 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:26.490447 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d2512-8cb8-44e1-84e0-c6696632d069 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:26.495364 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5473b-6e97-4ec1-b80b-fa35c6a2958c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:26.496018 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5473b-6e97-4ec1-b80b-fa35c6a2958c admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.496303 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5473b-6e97-4ec1-b80b-fa35c6a2958c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.496581 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5473b-6e97-4ec1-b80b-fa35c6a2958c admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:26.497312 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5473b-6e97-4ec1-b80b-fa35c6a2958c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:26.499437 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5473b-6e97-4ec1-b80b-fa35c6a2958c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:26.531569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1045/2079] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:26 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:26.532630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5473b-6e97-4ec1-b80b-fa35c6a2958c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:26.571004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fff16-efe1-416c-b664-c0222fd6b5e4 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:26.575311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:26.602342 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5473b-6e97-4ec1-b80b-fa35c6a2958c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:26.607481 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b720897-7968-4b59-9ae9-c67311d4a2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:26.608448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b720897-7968-4b59-9ae9-c67311d4a2c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.608736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b720897-7968-4b59-9ae9-c67311d4a2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.609015 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b720897-7968-4b59-9ae9-c67311d4a2c2 admin admin] PATH_INFO: `/v3/projects/c41eb570de4f400da983de0593658575/users/aaaab1d1edb04d9886c75fa0db223495/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:26.626786 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b720897-7968-4b59-9ae9-c67311d4a2c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41eb570de4f400da983de0593658575, user_id=aaaab1d1edb04d9886c75fa0db223495, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:26.630328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b720897-7968-4b59-9ae9-c67311d4a2c2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:26.643484 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1046/2080] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:26 2022] PUT /identity/v3/projects/c41eb570de4f400da983de0593658575/users/aaaab1d1edb04d9886c75fa0db223495/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:26.644359 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b720897-7968-4b59-9ae9-c67311d4a2c2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:26.645975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5b720897-7968-4b59-9ae9-c67311d4a2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:26.654178 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb12b89-7cef-479a-90dd-e2d86dc04ea8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:26.654853 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb12b89-7cef-479a-90dd-e2d86dc04ea8 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.655131 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb12b89-7cef-479a-90dd-e2d86dc04ea8 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.655401 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb12b89-7cef-479a-90dd-e2d86dc04ea8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:26.657479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8eb12b89-7cef-479a-90dd-e2d86dc04ea8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:26.702685 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b720897-7968-4b59-9ae9-c67311d4a2c2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:26.706789 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec6ce8-e9a8-4287-84cf-c9c410f1480e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:26.707424 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec6ce8-e9a8-4287-84cf-c9c410f1480e service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.707707 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec6ce8-e9a8-4287-84cf-c9c410f1480e service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.707979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec6ce8-e9a8-4287-84cf-c9c410f1480e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:26.717302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb12b89-7cef-479a-90dd-e2d86dc04ea8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:26.718942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb12b89-7cef-479a-90dd-e2d86dc04ea8 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:26.728451 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1035/2081] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:26.729222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb12b89-7cef-479a-90dd-e2d86dc04ea8 service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:26.740000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb12b89-7cef-479a-90dd-e2d86dc04ea8 service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:26.750265 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:26.771730 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec6ce8-e9a8-4287-84cf-c9c410f1480e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:26.773177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec6ce8-e9a8-4287-84cf-c9c410f1480e service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:26.783667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1047/2082] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:26.784789 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec6ce8-e9a8-4287-84cf-c9c410f1480e service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:26.819706 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b47ae0-54ab-4773-9a7e-15ad361d6576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:26.821232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47ae0-54ab-4773-9a7e-15ad361d6576 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.821745 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47ae0-54ab-4773-9a7e-15ad361d6576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.822287 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47ae0-54ab-4773-9a7e-15ad361d6576 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:26.823489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b47ae0-54ab-4773-9a7e-15ad361d6576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:26.826577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b47ae0-54ab-4773-9a7e-15ad361d6576 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:26.859885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec6ce8-e9a8-4287-84cf-c9c410f1480e service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:26.860422 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1036/2083] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:26 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:26.864942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b47ae0-54ab-4773-9a7e-15ad361d6576 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:26.869247 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907d69f-7752-4803-ab1c-12dce78a5b84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:26.869983 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907d69f-7752-4803-ab1c-12dce78a5b84 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.870272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907d69f-7752-4803-ab1c-12dce78a5b84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.871325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907d69f-7752-4803-ab1c-12dce78a5b84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:26.876625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b47ae0-54ab-4773-9a7e-15ad361d6576 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:26.879100 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a907d69f-7752-4803-ab1c-12dce78a5b84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:26.889024 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670c7af-5c11-47ed-83eb-767d440ab8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:26.889632 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670c7af-5c11-47ed-83eb-767d440ab8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.889917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670c7af-5c11-47ed-83eb-767d440ab8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.890237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670c7af-5c11-47ed-83eb-767d440ab8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:26.891022 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670c7af-5c11-47ed-83eb-767d440ab8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:26.892769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670c7af-5c11-47ed-83eb-767d440ab8f4 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:26.904138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1037/2084] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:26.904991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670c7af-5c11-47ed-83eb-767d440ab8f4 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:26.921201 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670c7af-5c11-47ed-83eb-767d440ab8f4 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:26.932922 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d0d27-7e2d-4cca-b9ec-b55f68d599c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:26.933612 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d0d27-7e2d-4cca-b9ec-b55f68d599c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.934568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d0d27-7e2d-4cca-b9ec-b55f68d599c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.934854 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d0d27-7e2d-4cca-b9ec-b55f68d599c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:26.935590 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d0d27-7e2d-4cca-b9ec-b55f68d599c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:26.937211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d0d27-7e2d-4cca-b9ec-b55f68d599c6 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:26.960239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1038/2085] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:26.973501 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d0d27-7e2d-4cca-b9ec-b55f68d599c6 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:26.977273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907d69f-7752-4803-ab1c-12dce78a5b84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:26.979281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907d69f-7752-4803-ab1c-12dce78a5b84 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:26.991173 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1048/2086] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:26 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:26.991818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907d69f-7752-4803-ab1c-12dce78a5b84 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:26.992598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d0d27-7e2d-4cca-b9ec-b55f68d599c6 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:26.997486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92195ba6-690e-4bfc-b105-cb34485a4882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:26.998482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92195ba6-690e-4bfc-b105-cb34485a4882 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:26.998708 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92195ba6-690e-4bfc-b105-cb34485a4882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:26.998984 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92195ba6-690e-4bfc-b105-cb34485a4882 admin admin] PATH_INFO: `/v3/projects/c41eb570de4f400da983de0593658575/users/aaaab1d1edb04d9886c75fa0db223495/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:27.001116 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92195ba6-690e-4bfc-b105-cb34485a4882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41eb570de4f400da983de0593658575, user_id=aaaab1d1edb04d9886c75fa0db223495, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:27.002682 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907d69f-7752-4803-ab1c-12dce78a5b84 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:27.004871 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92195ba6-690e-4bfc-b105-cb34485a4882 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:27.007669 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914615e-7a56-464c-afd5-8ed859fe2971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:27.008652 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914615e-7a56-464c-afd5-8ed859fe2971 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:27.009118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914615e-7a56-464c-afd5-8ed859fe2971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:27.009395 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914615e-7a56-464c-afd5-8ed859fe2971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:27.010621 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914615e-7a56-464c-afd5-8ed859fe2971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:27.012662 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914615e-7a56-464c-afd5-8ed859fe2971 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:27.013658 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:27.023078 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1039/2087] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:26 2022] PUT /identity/v3/projects/c41eb570de4f400da983de0593658575/users/aaaab1d1edb04d9886c75fa0db223495/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:27.030851 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1049/2088] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:27.034395 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914615e-7a56-464c-afd5-8ed859fe2971 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:27.035480 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4d59b-4e3f-4864-80ab-6f037c99b55d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:27.035771 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4d59b-4e3f-4864-80ab-6f037c99b55d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:27.036047 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4d59b-4e3f-4864-80ab-6f037c99b55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:27.048619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914615e-7a56-464c-afd5-8ed859fe2971 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:27.068373 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b0c4d59b-4e3f-4864-80ab-6f037c99b55d None None] MFA Rules not processed for user `aaaab1d1edb04d9886c75fa0db223495`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:27.069653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b0c4d59b-4e3f-4864-80ab-6f037c99b55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:27.135838 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539c03a-d605-4eed-aab9-6e1d836fc5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:27.138601 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539c03a-d605-4eed-aab9-6e1d836fc5c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:27.138601 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539c03a-d605-4eed-aab9-6e1d836fc5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:27.138601 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539c03a-d605-4eed-aab9-6e1d836fc5c7 admin admin] PATH_INFO: `/v3/projects/910e4ef9b9874f90908a0ece5f38bdde/users/59482fd2b20c4e4cb4d5efa4f14e561b/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:27.165223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539c03a-d605-4eed-aab9-6e1d836fc5c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=910e4ef9b9874f90908a0ece5f38bdde, user_id=59482fd2b20c4e4cb4d5efa4f14e561b, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:27.168713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539c03a-d605-4eed-aab9-6e1d836fc5c7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:27.205084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1050/2089] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:27 2022] PUT /identity/v3/projects/910e4ef9b9874f90908a0ece5f38bdde/users/59482fd2b20c4e4cb4d5efa4f14e561b/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:27.206969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539c03a-d605-4eed-aab9-6e1d836fc5c7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:27.208796 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c539c03a-d605-4eed-aab9-6e1d836fc5c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:27.220905 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:27.226599 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1040/2090] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:27.228144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a12581-2769-4850-88e3-2ab51fdea836 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:27.228443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a12581-2769-4850-88e3-2ab51fdea836 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:27.228726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a12581-2769-4850-88e3-2ab51fdea836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:27.264971 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f7a12581-2769-4850-88e3-2ab51fdea836 None None] MFA Rules not processed for user `59482fd2b20c4e4cb4d5efa4f14e561b`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:27.267450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f7a12581-2769-4850-88e3-2ab51fdea836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:27.304206 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539c03a-d605-4eed-aab9-6e1d836fc5c7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:27.310712 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c426e2b-a232-4d05-ba3b-f225e1e95b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:27.311743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c426e2b-a232-4d05-ba3b-f225e1e95b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:27.312187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c426e2b-a232-4d05-ba3b-f225e1e95b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:27.312971 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c426e2b-a232-4d05-ba3b-f225e1e95b32 admin admin] PATH_INFO: `/v3/projects/bf9a1acda619418fadaeffbc0e730816` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:27.316433 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c426e2b-a232-4d05-ba3b-f225e1e95b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf9a1acda619418fadaeffbc0e730816)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:27.319243 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c426e2b-a232-4d05-ba3b-f225e1e95b32 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:27.349942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1041/2091] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:27.350876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a12581-2769-4850-88e3-2ab51fdea836 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:27.353469 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f7a12581-2769-4850-88e3-2ab51fdea836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:27.433859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3c426e2b-a232-4d05-ba3b-f225e1e95b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf9a1acda619418fadaeffbc0e730816', 'request_id': 'req-3c426e2b-a232-4d05-ba3b-f225e1e95b32'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:27.443521 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3c426e2b-a232-4d05-ba3b-f225e1e95b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf9a1acda619418fadaeffbc0e730816', 'request_id': 'req-3c426e2b-a232-4d05-ba3b-f225e1e95b32'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:27.451108 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3c426e2b-a232-4d05-ba3b-f225e1e95b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf9a1acda619418fadaeffbc0e730816', 'request_id': 'req-3c426e2b-a232-4d05-ba3b-f225e1e95b32'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:27.470320 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3c426e2b-a232-4d05-ba3b-f225e1e95b32 admin admin] The token cache is being invalidate because project bf9a1acda619418fadaeffbc0e730816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:27.471080 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3c426e2b-a232-4d05-ba3b-f225e1e95b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:27.473332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3c426e2b-a232-4d05-ba3b-f225e1e95b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:27.477889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1051/2092] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:27 2022] DELETE /identity/v3/projects/bf9a1acda619418fadaeffbc0e730816 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:27.479393 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c426e2b-a232-4d05-ba3b-f225e1e95b32 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:27.481790 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3c426e2b-a232-4d05-ba3b-f225e1e95b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:27.495541 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a12581-2769-4850-88e3-2ab51fdea836 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:27.526881 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:27.557235 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d45d1f-be84-4e6d-8823-938c10e9c1b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:27.558009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d45d1f-be84-4e6d-8823-938c10e9c1b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:27.558322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d45d1f-be84-4e6d-8823-938c10e9c1b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:27.558613 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d45d1f-be84-4e6d-8823-938c10e9c1b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:27.561758 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-85d45d1f-be84-4e6d-8823-938c10e9c1b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:27.593181 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c426e2b-a232-4d05-ba3b-f225e1e95b32 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:27.600479 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a26fe-1a2f-4a98-a6ef-7b9fbe85daa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:27.602151 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a26fe-1a2f-4a98-a6ef-7b9fbe85daa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:27.602485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a26fe-1a2f-4a98-a6ef-7b9fbe85daa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:27.602764 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a26fe-1a2f-4a98-a6ef-7b9fbe85daa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:27.603808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a26fe-1a2f-4a98-a6ef-7b9fbe85daa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:27.605972 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a26fe-1a2f-4a98-a6ef-7b9fbe85daa5 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:27.635122 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d45d1f-be84-4e6d-8823-938c10e9c1b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:27.636593 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d45d1f-be84-4e6d-8823-938c10e9c1b6 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:27.645208 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1052/2093] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:27 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:27.647859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd573688-8b27-4e4e-aa5b-f304d46efbd7 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:27.648261 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd573688-8b27-4e4e-aa5b-f304d46efbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:27.648809 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd573688-8b27-4e4e-aa5b-f304d46efbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:27.650604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1042/2094] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:27.651546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d45d1f-be84-4e6d-8823-938c10e9c1b6 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:27.664732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d45d1f-be84-4e6d-8823-938c10e9c1b6 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:27.702988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-dd573688-8b27-4e4e-aa5b-f304d46efbd7 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:27.705000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-dd573688-8b27-4e4e-aa5b-f304d46efbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:27.729992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:27.755830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407b239-0b56-4aeb-a439-2121e1a2f862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:27.756505 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407b239-0b56-4aeb-a439-2121e1a2f862 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:27.756783 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407b239-0b56-4aeb-a439-2121e1a2f862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:27.757056 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407b239-0b56-4aeb-a439-2121e1a2f862 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:27.757758 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407b239-0b56-4aeb-a439-2121e1a2f862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:27.759679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407b239-0b56-4aeb-a439-2121e1a2f862 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:27.783020 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1043/2095] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:27 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:27.787700 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407b239-0b56-4aeb-a439-2121e1a2f862 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:27.807812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407b239-0b56-4aeb-a439-2121e1a2f862 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:27.811070 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1053/2096] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:27.818997 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f058f2-e1b9-43a4-8496-5489c470fc7d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:27.819367 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f058f2-e1b9-43a4-8496-5489c470fc7d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:27.819472 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8d669-8fd3-44b5-8313-897a86cb4b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:27.819590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f058f2-e1b9-43a4-8496-5489c470fc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:27.820143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8d669-8fd3-44b5-8313-897a86cb4b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:27.820598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8d669-8fd3-44b5-8313-897a86cb4b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:27.820964 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8d669-8fd3-44b5-8313-897a86cb4b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:27.822022 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8d669-8fd3-44b5-8313-897a86cb4b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:27.823923 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8d669-8fd3-44b5-8313-897a86cb4b2b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:27.842574 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1044/2097] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:27.846586 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b7f058f2-e1b9-43a4-8496-5489c470fc7d None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:27.847616 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8d669-8fd3-44b5-8313-897a86cb4b2b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:27.848510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b7f058f2-e1b9-43a4-8496-5489c470fc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:27.859950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1054/2098] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:27.862204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8d669-8fd3-44b5-8313-897a86cb4b2b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:27.864029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f058f2-e1b9-43a4-8496-5489c470fc7d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:27.871163 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f398813-be02-411b-acc3-212c0ee89b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:27.872973 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f398813-be02-411b-acc3-212c0ee89b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:27.873513 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f398813-be02-411b-acc3-212c0ee89b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:27.874731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f398813-be02-411b-acc3-212c0ee89b28 admin admin] PATH_INFO: `/v3/projects/cfd981af158d466f90f5bcedab343133/users/cfcdbd7cc72e4343a7065b6b6302bbb4/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:27.877022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f058f2-e1b9-43a4-8496-5489c470fc7d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:27.886548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01092c-ffbb-4e21-96e9-ec6b9da573ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:27.887208 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01092c-ffbb-4e21-96e9-ec6b9da573ee admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:27.887533 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01092c-ffbb-4e21-96e9-ec6b9da573ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:27.887829 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01092c-ffbb-4e21-96e9-ec6b9da573ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:27.889198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01092c-ffbb-4e21-96e9-ec6b9da573ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:27.889198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01092c-ffbb-4e21-96e9-ec6b9da573ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:27.892000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01092c-ffbb-4e21-96e9-ec6b9da573ee admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:27.896281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f398813-be02-411b-acc3-212c0ee89b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd981af158d466f90f5bcedab343133, user_id=cfcdbd7cc72e4343a7065b6b6302bbb4, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:27.900984 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f398813-be02-411b-acc3-212c0ee89b28 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:27.908330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1055/2099] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:02:27.913293 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01092c-ffbb-4e21-96e9-ec6b9da573ee admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:27.926285 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1045/2100] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:27 2022] PUT /identity/v3/projects/cfd981af158d466f90f5bcedab343133/users/cfcdbd7cc72e4343a7065b6b6302bbb4/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:27.931073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01092c-ffbb-4e21-96e9-ec6b9da573ee admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:27.932224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f398813-be02-411b-acc3-212c0ee89b28 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:27.993986 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:28.020496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221641f-f692-4736-b8db-48cc016df27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:28.021489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221641f-f692-4736-b8db-48cc016df27e admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:28.022275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221641f-f692-4736-b8db-48cc016df27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:28.022735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221641f-f692-4736-b8db-48cc016df27e admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:28.023638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221641f-f692-4736-b8db-48cc016df27e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:28.024888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f398813-be02-411b-acc3-212c0ee89b28 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:28.026464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221641f-f692-4736-b8db-48cc016df27e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:28.032024 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c22c2-40e9-44dd-b8dd-f02ce2d4e625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:28.033151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c22c2-40e9-44dd-b8dd-f02ce2d4e625 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:28.033514 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c22c2-40e9-44dd-b8dd-f02ce2d4e625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:28.034032 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c22c2-40e9-44dd-b8dd-f02ce2d4e625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:28.034897 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c22c2-40e9-44dd-b8dd-f02ce2d4e625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:28.036851 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c22c2-40e9-44dd-b8dd-f02ce2d4e625 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:28.048644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1046/2101] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:28.053320 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c22c2-40e9-44dd-b8dd-f02ce2d4e625 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:28.064576 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1056/2102] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:27 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:28.064672 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c22c2-40e9-44dd-b8dd-f02ce2d4e625 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:28.065460 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221641f-f692-4736-b8db-48cc016df27e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:28.143106 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793301a1-c07b-492c-9dc0-7d1e8a0b7a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:28.144627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793301a1-c07b-492c-9dc0-7d1e8a0b7a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:28.144981 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793301a1-c07b-492c-9dc0-7d1e8a0b7a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:28.146123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793301a1-c07b-492c-9dc0-7d1e8a0b7a80 admin admin] PATH_INFO: `/v3/projects/cfd981af158d466f90f5bcedab343133/users/cfcdbd7cc72e4343a7065b6b6302bbb4/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:28.149334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793301a1-c07b-492c-9dc0-7d1e8a0b7a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd981af158d466f90f5bcedab343133, user_id=cfcdbd7cc72e4343a7065b6b6302bbb4, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:28.153734 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793301a1-c07b-492c-9dc0-7d1e8a0b7a80 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:28.171389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1047/2103] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:28 2022] PUT /identity/v3/projects/cfd981af158d466f90f5bcedab343133/users/cfcdbd7cc72e4343a7065b6b6302bbb4/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:28.186497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb526a87-66a2-4b77-a56c-943bd20f7f23 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:28.186888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb526a87-66a2-4b77-a56c-943bd20f7f23 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:28.187085 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb526a87-66a2-4b77-a56c-943bd20f7f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:28.201119 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221641f-f692-4736-b8db-48cc016df27e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:28.229404 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-eb526a87-66a2-4b77-a56c-943bd20f7f23 None None] MFA Rules not processed for user `cfcdbd7cc72e4343a7065b6b6302bbb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:28.230351 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-eb526a87-66a2-4b77-a56c-943bd20f7f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:28.236344 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:28.269086 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088c95f-7da8-4ab6-b047-5bc656b6c166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:28.269947 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088c95f-7da8-4ab6-b047-5bc656b6c166 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:28.270254 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088c95f-7da8-4ab6-b047-5bc656b6c166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:28.271374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088c95f-7da8-4ab6-b047-5bc656b6c166 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:28.272508 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088c95f-7da8-4ab6-b047-5bc656b6c166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:28.275037 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088c95f-7da8-4ab6-b047-5bc656b6c166 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:28.297113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1057/2104] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:28 2022] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:28.301699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088c95f-7da8-4ab6-b047-5bc656b6c166 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:28.311691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088c95f-7da8-4ab6-b047-5bc656b6c166 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:28.314146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1048/2105] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:28.316595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534230f-eaa6-4151-8a54-49290fba53ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:28.317255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534230f-eaa6-4151-8a54-49290fba53ac admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:28.317665 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534230f-eaa6-4151-8a54-49290fba53ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:28.317966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534230f-eaa6-4151-8a54-49290fba53ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:28.318908 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534230f-eaa6-4151-8a54-49290fba53ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:28.321300 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534230f-eaa6-4151-8a54-49290fba53ac admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:28.329359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb526a87-66a2-4b77-a56c-943bd20f7f23 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:28.332117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-eb526a87-66a2-4b77-a56c-943bd20f7f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:28.334427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1058/2106] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:28.338470 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534230f-eaa6-4151-8a54-49290fba53ac admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:28.349622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534230f-eaa6-4151-8a54-49290fba53ac admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:28.354898 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939eaea-31cc-4bfe-a47d-90027f1b3a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:28.355563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939eaea-31cc-4bfe-a47d-90027f1b3a3a admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:28.355843 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939eaea-31cc-4bfe-a47d-90027f1b3a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:28.356114 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939eaea-31cc-4bfe-a47d-90027f1b3a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:28.357610 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939eaea-31cc-4bfe-a47d-90027f1b3a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:28.361028 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939eaea-31cc-4bfe-a47d-90027f1b3a3a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:28.381275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1059/2107] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:28.389280 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939eaea-31cc-4bfe-a47d-90027f1b3a3a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:28.402332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939eaea-31cc-4bfe-a47d-90027f1b3a3a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:28.407806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f9e0a-06f5-4503-a099-2c809863329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:28.408903 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f9e0a-06f5-4503-a099-2c809863329b admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:28.409372 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f9e0a-06f5-4503-a099-2c809863329b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:28.411551 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f9e0a-06f5-4503-a099-2c809863329b admin admin] PATH_INFO: `/v3/projects/7c734caf89974de2a5b633a52fc63989/users/1459bd20badd483183e4cc0764302e59/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:28.421174 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb526a87-66a2-4b77-a56c-943bd20f7f23 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:28.425562 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3f79c-5765-45bc-9465-ff26090789ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:28.426270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3f79c-5765-45bc-9465-ff26090789ed service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:28.426608 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3f79c-5765-45bc-9465-ff26090789ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:28.426893 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3f79c-5765-45bc-9465-ff26090789ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:28.429223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-01e3f79c-5765-45bc-9465-ff26090789ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:28.435293 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f9e0a-06f5-4503-a099-2c809863329b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c734caf89974de2a5b633a52fc63989, user_id=1459bd20badd483183e4cc0764302e59, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:28.439461 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f9e0a-06f5-4503-a099-2c809863329b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:28.439953 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:28.458518 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1060/2108] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:28 2022] PUT /identity/v3/projects/7c734caf89974de2a5b633a52fc63989/users/1459bd20badd483183e4cc0764302e59/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:28.469389 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d47082-fe6e-4d94-a988-e96aef6e502f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:28.469657 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d47082-fe6e-4d94-a988-e96aef6e502f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:28.469956 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d47082-fe6e-4d94-a988-e96aef6e502f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:28.503558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e1d47082-fe6e-4d94-a988-e96aef6e502f None None] MFA Rules not processed for user `1459bd20badd483183e4cc0764302e59`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:28.505458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e1d47082-fe6e-4d94-a988-e96aef6e502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:28.506300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3f79c-5765-45bc-9465-ff26090789ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:28.507826 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3f79c-5765-45bc-9465-ff26090789ed service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:28.519520 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1049/2109] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:02:28.599796 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1061/2110] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:28.754978 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3f79c-5765-45bc-9465-ff26090789ed service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:28.756506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-01e3f79c-5765-45bc-9465-ff26090789ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:28.770270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3f79c-5765-45bc-9465-ff26090789ed service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:28.852938 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b126cf9-2671-469a-ba58-98d169b6b217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:28.853730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b126cf9-2671-469a-ba58-98d169b6b217 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:28.853895 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b126cf9-2671-469a-ba58-98d169b6b217 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:28.854208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b126cf9-2671-469a-ba58-98d169b6b217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:28.865423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b126cf9-2671-469a-ba58-98d169b6b217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:28.866966 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b126cf9-2671-469a-ba58-98d169b6b217 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:28.883326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1050/2111] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:30.481086 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d47082-fe6e-4d94-a988-e96aef6e502f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:30.495015 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d47082-fe6e-4d94-a988-e96aef6e502f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:30.499647 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9917bd-aa2f-4b11-ab14-47d227ef5313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:30.500306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9917bd-aa2f-4b11-ab14-47d227ef5313 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:30.500590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9917bd-aa2f-4b11-ab14-47d227ef5313 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:30.500868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9917bd-aa2f-4b11-ab14-47d227ef5313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:30.503843 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2b9917bd-aa2f-4b11-ab14-47d227ef5313 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:30.591662 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9917bd-aa2f-4b11-ab14-47d227ef5313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:30.593102 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9917bd-aa2f-4b11-ab14-47d227ef5313 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:30.598352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:30.610240 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1062/2112] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:31.194723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b126cf9-2671-469a-ba58-98d169b6b217 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:31.276380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b126cf9-2671-469a-ba58-98d169b6b217 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:31.280807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc980c16-c7df-4740-bd47-56bc74b3bea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:31.281676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc980c16-c7df-4740-bd47-56bc74b3bea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:31.281999 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc980c16-c7df-4740-bd47-56bc74b3bea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:31.282264 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc980c16-c7df-4740-bd47-56bc74b3bea8 admin admin] PATH_INFO: `/v3/users/59482fd2b20c4e4cb4d5efa4f14e561b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:31.283446 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc980c16-c7df-4740-bd47-56bc74b3bea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59482fd2b20c4e4cb4d5efa4f14e561b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:31.285943 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc980c16-c7df-4740-bd47-56bc74b3bea8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:31.335631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cc980c16-c7df-4740-bd47-56bc74b3bea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59482fd2b20c4e4cb4d5efa4f14e561b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:31.342411 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:31.345266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cc980c16-c7df-4740-bd47-56bc74b3bea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59482fd2b20c4e4cb4d5efa4f14e561b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:31.356812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cc980c16-c7df-4740-bd47-56bc74b3bea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59482fd2b20c4e4cb4d5efa4f14e561b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:31.357493 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cc980c16-c7df-4740-bd47-56bc74b3bea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59482fd2b20c4e4cb4d5efa4f14e561b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:31.358214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cc980c16-c7df-4740-bd47-56bc74b3bea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59482fd2b20c4e4cb4d5efa4f14e561b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:31.392870 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1051/2113] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:31 2022] DELETE /identity/v3/users/59482fd2b20c4e4cb4d5efa4f14e561b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:31.397845 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebde34-4409-42a9-8638-4d4c5826d975 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:31.398171 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebde34-4409-42a9-8638-4d4c5826d975 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:31.398449 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebde34-4409-42a9-8638-4d4c5826d975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:31.417005 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-50ebde34-4409-42a9-8638-4d4c5826d975 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:31.418220 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-50ebde34-4409-42a9-8638-4d4c5826d975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:31.480477 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1063/2114] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:31.491383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc980c16-c7df-4740-bd47-56bc74b3bea8 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:31.492785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-cc980c16-c7df-4740-bd47-56bc74b3bea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:31.557066 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc980c16-c7df-4740-bd47-56bc74b3bea8 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:31.561302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430b14c-faef-49b4-84a1-ec17d82bc0f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:31.561977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430b14c-faef-49b4-84a1-ec17d82bc0f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:31.562263 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430b14c-faef-49b4-84a1-ec17d82bc0f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:31.562699 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430b14c-faef-49b4-84a1-ec17d82bc0f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:31.572325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430b14c-faef-49b4-84a1-ec17d82bc0f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:31.573757 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430b14c-faef-49b4-84a1-ec17d82bc0f8 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:31.584029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1052/2115] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:31.863044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebde34-4409-42a9-8638-4d4c5826d975 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:31.864490 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-50ebde34-4409-42a9-8638-4d4c5826d975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:31.880093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebde34-4409-42a9-8638-4d4c5826d975 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:31.884741 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e615c-5922-44cb-90d4-cb58e144b071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:31.885609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e615c-5922-44cb-90d4-cb58e144b071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:31.885896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e615c-5922-44cb-90d4-cb58e144b071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:31.886369 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e615c-5922-44cb-90d4-cb58e144b071 admin admin] PATH_INFO: `/v3/projects/910e4ef9b9874f90908a0ece5f38bdde` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:31.887566 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e615c-5922-44cb-90d4-cb58e144b071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=910e4ef9b9874f90908a0ece5f38bdde)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:31.889469 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e615c-5922-44cb-90d4-cb58e144b071 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:31.939906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-685e615c-5922-44cb-90d4-cb58e144b071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '910e4ef9b9874f90908a0ece5f38bdde', 'request_id': 'req-685e615c-5922-44cb-90d4-cb58e144b071'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:31.946891 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-685e615c-5922-44cb-90d4-cb58e144b071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '910e4ef9b9874f90908a0ece5f38bdde', 'request_id': 'req-685e615c-5922-44cb-90d4-cb58e144b071'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:31.953006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-685e615c-5922-44cb-90d4-cb58e144b071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '910e4ef9b9874f90908a0ece5f38bdde', 'request_id': 'req-685e615c-5922-44cb-90d4-cb58e144b071'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:31.968064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-685e615c-5922-44cb-90d4-cb58e144b071 admin admin] The token cache is being invalidate because project 910e4ef9b9874f90908a0ece5f38bdde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:31.968353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-685e615c-5922-44cb-90d4-cb58e144b071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:31.968974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-685e615c-5922-44cb-90d4-cb58e144b071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:31.970542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1064/2116] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:31 2022] DELETE /identity/v3/projects/910e4ef9b9874f90908a0ece5f38bdde => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:31.974447 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430b14c-faef-49b4-84a1-ec17d82bc0f8 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:31.984772 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430b14c-faef-49b4-84a1-ec17d82bc0f8 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:32.050960 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28438b-d46b-4fb2-a861-a386b28e14e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:32.052481 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28438b-d46b-4fb2-a861-a386b28e14e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:32.052944 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28438b-d46b-4fb2-a861-a386b28e14e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:32.053399 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28438b-d46b-4fb2-a861-a386b28e14e7 admin admin] PATH_INFO: `/v3/users/cfcdbd7cc72e4343a7065b6b6302bbb4` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:32.055345 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28438b-d46b-4fb2-a861-a386b28e14e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfcdbd7cc72e4343a7065b6b6302bbb4)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:32.058819 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28438b-d46b-4fb2-a861-a386b28e14e7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:32.108466 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5c28438b-d46b-4fb2-a861-a386b28e14e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfcdbd7cc72e4343a7065b6b6302bbb4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:32.115291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5c28438b-d46b-4fb2-a861-a386b28e14e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfcdbd7cc72e4343a7065b6b6302bbb4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:32.122944 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5c28438b-d46b-4fb2-a861-a386b28e14e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfcdbd7cc72e4343a7065b6b6302bbb4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:32.123492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5c28438b-d46b-4fb2-a861-a386b28e14e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfcdbd7cc72e4343a7065b6b6302bbb4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:32.124035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5c28438b-d46b-4fb2-a861-a386b28e14e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfcdbd7cc72e4343a7065b6b6302bbb4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:32.133020 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:32.150097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1053/2117] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:31 2022] DELETE /identity/v3/users/cfcdbd7cc72e4343a7065b6b6302bbb4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:32.492607 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e615c-5922-44cb-90d4-cb58e144b071 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:32.494180 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-685e615c-5922-44cb-90d4-cb58e144b071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:32.517511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e615c-5922-44cb-90d4-cb58e144b071 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:32.583859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebc6ff-4051-4bb3-a629-8e36a35a974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:32.584729 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebc6ff-4051-4bb3-a629-8e36a35a974f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:32.585153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebc6ff-4051-4bb3-a629-8e36a35a974f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:32.585432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebc6ff-4051-4bb3-a629-8e36a35a974f admin admin] PATH_INFO: `/v3/projects/cfd981af158d466f90f5bcedab343133` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:32.586733 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebc6ff-4051-4bb3-a629-8e36a35a974f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfd981af158d466f90f5bcedab343133)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:32.588809 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebc6ff-4051-4bb3-a629-8e36a35a974f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:32.626344 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:32.656325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-01ebc6ff-4051-4bb3-a629-8e36a35a974f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd981af158d466f90f5bcedab343133', 'request_id': 'req-01ebc6ff-4051-4bb3-a629-8e36a35a974f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:32.669382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-01ebc6ff-4051-4bb3-a629-8e36a35a974f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd981af158d466f90f5bcedab343133', 'request_id': 'req-01ebc6ff-4051-4bb3-a629-8e36a35a974f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:32.677170 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-01ebc6ff-4051-4bb3-a629-8e36a35a974f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd981af158d466f90f5bcedab343133', 'request_id': 'req-01ebc6ff-4051-4bb3-a629-8e36a35a974f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:32.692311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-01ebc6ff-4051-4bb3-a629-8e36a35a974f admin admin] The token cache is being invalidate because project cfd981af158d466f90f5bcedab343133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:32.692600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-01ebc6ff-4051-4bb3-a629-8e36a35a974f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:32.693290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-01ebc6ff-4051-4bb3-a629-8e36a35a974f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:32.695144 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1065/2118] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:32 2022] DELETE /identity/v3/projects/cfd981af158d466f90f5bcedab343133 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:32.699741 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc7e4a-2712-472c-a317-69284185f98e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:32.700294 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc7e4a-2712-472c-a317-69284185f98e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:32.700294 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc7e4a-2712-472c-a317-69284185f98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:32.720105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8bbc7e4a-2712-472c-a317-69284185f98e None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:32.721301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8bbc7e4a-2712-472c-a317-69284185f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:32.746855 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebc6ff-4051-4bb3-a629-8e36a35a974f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:32.749233 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-01ebc6ff-4051-4bb3-a629-8e36a35a974f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:32.793400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1054/2119] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:32.801983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67002d-9f1c-42d8-a1cb-ad68b6583297 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:32.802372 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67002d-9f1c-42d8-a1cb-ad68b6583297 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:32.802829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67002d-9f1c-42d8-a1cb-ad68b6583297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:32.825086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-fa67002d-9f1c-42d8-a1cb-ad68b6583297 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:32.826784 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fa67002d-9f1c-42d8-a1cb-ad68b6583297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:32.830947 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebc6ff-4051-4bb3-a629-8e36a35a974f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:32.836432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1055/2120] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:32.839596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd64bc5-fdbb-470e-aed2-5c98e4b2e194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:32.839596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd64bc5-fdbb-470e-aed2-5c98e4b2e194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:32.839596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd64bc5-fdbb-470e-aed2-5c98e4b2e194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:32.839596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd64bc5-fdbb-470e-aed2-5c98e4b2e194 admin admin] PATH_INFO: `/v3/users/81c657365e4242ad9bd2c3ac5c2e81af` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:32.840160 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd64bc5-fdbb-470e-aed2-5c98e4b2e194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c657365e4242ad9bd2c3ac5c2e81af)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:32.841309 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67002d-9f1c-42d8-a1cb-ad68b6583297 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:32.841879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd64bc5-fdbb-470e-aed2-5c98e4b2e194 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:32.852349 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67002d-9f1c-42d8-a1cb-ad68b6583297 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:32.858385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53aa459-63a6-4b7f-b7fc-1ac986cfcb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:32.859330 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53aa459-63a6-4b7f-b7fc-1ac986cfcb16 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:32.859752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53aa459-63a6-4b7f-b7fc-1ac986cfcb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:32.860243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53aa459-63a6-4b7f-b7fc-1ac986cfcb16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:32.861253 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53aa459-63a6-4b7f-b7fc-1ac986cfcb16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:32.861725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53aa459-63a6-4b7f-b7fc-1ac986cfcb16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:32.863851 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53aa459-63a6-4b7f-b7fc-1ac986cfcb16 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:32.878336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1056/2121] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:02:32.883383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53aa459-63a6-4b7f-b7fc-1ac986cfcb16 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:32.895717 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53aa459-63a6-4b7f-b7fc-1ac986cfcb16 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:32.902279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82dfbb-ed1a-4050-b969-be6bcc77ceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:32.902833 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82dfbb-ed1a-4050-b969-be6bcc77ceb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:32.903960 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82dfbb-ed1a-4050-b969-be6bcc77ceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:32.904364 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82dfbb-ed1a-4050-b969-be6bcc77ceb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:32.905302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82dfbb-ed1a-4050-b969-be6bcc77ceb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:32.907400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82dfbb-ed1a-4050-b969-be6bcc77ceb6 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:32.920422 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-8fd64bc5-fdbb-470e-aed2-5c98e4b2e194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c657365e4242ad9bd2c3ac5c2e81af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:32.938917 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-8fd64bc5-fdbb-470e-aed2-5c98e4b2e194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c657365e4242ad9bd2c3ac5c2e81af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:32.941584 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-8fd64bc5-fdbb-470e-aed2-5c98e4b2e194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c657365e4242ad9bd2c3ac5c2e81af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:32.946117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1057/2122] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:32 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:32.950399 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82dfbb-ed1a-4050-b969-be6bcc77ceb6 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:32.954896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-8fd64bc5-fdbb-470e-aed2-5c98e4b2e194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c657365e4242ad9bd2c3ac5c2e81af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:32.961163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-8fd64bc5-fdbb-470e-aed2-5c98e4b2e194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c657365e4242ad9bd2c3ac5c2e81af'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:32.991154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1066/2123] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:32 2022] DELETE /identity/v3/users/81c657365e4242ad9bd2c3ac5c2e81af => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:32.995697 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88d29f-6390-4459-ad8a-748f87a9ef53 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:32.996025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88d29f-6390-4459-ad8a-748f87a9ef53 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:32.996371 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88d29f-6390-4459-ad8a-748f87a9ef53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:33.021677 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-9f88d29f-6390-4459-ad8a-748f87a9ef53 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:33.023181 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9f88d29f-6390-4459-ad8a-748f87a9ef53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:33.031070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82dfbb-ed1a-4050-b969-be6bcc77ceb6 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:33.055471 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:33.089462 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:33.096477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118e5c5-3c2a-468d-8ec1-5b52f70cbe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:33.097890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118e5c5-3c2a-468d-8ec1-5b52f70cbe36 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:33.098275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118e5c5-3c2a-468d-8ec1-5b52f70cbe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:33.098780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118e5c5-3c2a-468d-8ec1-5b52f70cbe36 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:33.099556 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118e5c5-3c2a-468d-8ec1-5b52f70cbe36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:33.099763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1067/2124] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:33.101758 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118e5c5-3c2a-468d-8ec1-5b52f70cbe36 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:33.109586 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88d29f-6390-4459-ad8a-748f87a9ef53 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:33.111332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9f88d29f-6390-4459-ad8a-748f87a9ef53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:33.124242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1058/2125] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:32 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:02:33.128980 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118e5c5-3c2a-468d-8ec1-5b52f70cbe36 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:33.130551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5118e5c5-3c2a-468d-8ec1-5b52f70cbe36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:33.142645 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118e5c5-3c2a-468d-8ec1-5b52f70cbe36 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:33.147411 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b933a-dbd0-47f8-b9fe-fc6402bc5125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:33.148712 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b933a-dbd0-47f8-b9fe-fc6402bc5125 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:33.149001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b933a-dbd0-47f8-b9fe-fc6402bc5125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:33.149280 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b933a-dbd0-47f8-b9fe-fc6402bc5125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:33.150035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b933a-dbd0-47f8-b9fe-fc6402bc5125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:33.151644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b933a-dbd0-47f8-b9fe-fc6402bc5125 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:33.166036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1059/2126] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:02:33.167618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b933a-dbd0-47f8-b9fe-fc6402bc5125 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:33.176185 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88d29f-6390-4459-ad8a-748f87a9ef53 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:33.179576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b933a-dbd0-47f8-b9fe-fc6402bc5125 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:33.180796 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabac1a-5fb2-482c-9d9c-b9849e0323de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:33.181406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabac1a-5fb2-482c-9d9c-b9849e0323de service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:33.181689 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabac1a-5fb2-482c-9d9c-b9849e0323de service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:33.182098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabac1a-5fb2-482c-9d9c-b9849e0323de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:33.186388 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cda29-cf57-48e9-991e-5c11f447745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:33.187152 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cda29-cf57-48e9-991e-5c11f447745d admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:33.187683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cda29-cf57-48e9-991e-5c11f447745d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:33.187964 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cda29-cf57-48e9-991e-5c11f447745d admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:33.188794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cda29-cf57-48e9-991e-5c11f447745d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:33.190975 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cda29-cf57-48e9-991e-5c11f447745d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:33.195159 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabac1a-5fb2-482c-9d9c-b9849e0323de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:33.197681 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabac1a-5fb2-482c-9d9c-b9849e0323de service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:33.202007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1060/2127] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:02:33.207225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cda29-cf57-48e9-991e-5c11f447745d admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:33.216436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1068/2128] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:02:33.219677 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cda29-cf57-48e9-991e-5c11f447745d admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:33.225365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaf0a7-bb51-407c-be2e-29cc60bc862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:33.226351 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaf0a7-bb51-407c-be2e-29cc60bc862a admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:33.226689 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaf0a7-bb51-407c-be2e-29cc60bc862a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:33.226993 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaf0a7-bb51-407c-be2e-29cc60bc862a admin admin] PATH_INFO: `/v3/projects/beb35681b4a8402d9e96f50ec5085c29/users/e8388b428eb44e89bce987a41aac8ce1/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:33.249064 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aaf0a7-bb51-407c-be2e-29cc60bc862a admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb35681b4a8402d9e96f50ec5085c29, user_id=e8388b428eb44e89bce987a41aac8ce1, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:33.252220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aaf0a7-bb51-407c-be2e-29cc60bc862a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:33.269488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1061/2129] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:33 2022] PUT /identity/v3/projects/beb35681b4a8402d9e96f50ec5085c29/users/e8388b428eb44e89bce987a41aac8ce1/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:33.284804 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f035b02-de27-4e9b-8a3f-2d81ff595a06 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:33.285127 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f035b02-de27-4e9b-8a3f-2d81ff595a06 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:33.285407 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f035b02-de27-4e9b-8a3f-2d81ff595a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:33.315970 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4f035b02-de27-4e9b-8a3f-2d81ff595a06 None None] MFA Rules not processed for user `e8388b428eb44e89bce987a41aac8ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:33.317486 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4f035b02-de27-4e9b-8a3f-2d81ff595a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:33.401088 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1069/2130] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:33.405623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaf0a7-bb51-407c-be2e-29cc60bc862a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:33.521229 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaf0a7-bb51-407c-be2e-29cc60bc862a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:33.526976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339098c-12cc-4373-8d82-7831cb38e45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:33.527654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339098c-12cc-4373-8d82-7831cb38e45e admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:33.527941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339098c-12cc-4373-8d82-7831cb38e45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:33.528247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339098c-12cc-4373-8d82-7831cb38e45e admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:33.528970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339098c-12cc-4373-8d82-7831cb38e45e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:33.531034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339098c-12cc-4373-8d82-7831cb38e45e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:33.564541 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1062/2131] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:33 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:33.566766 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f035b02-de27-4e9b-8a3f-2d81ff595a06 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:33.580252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f035b02-de27-4e9b-8a3f-2d81ff595a06 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:33.647995 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac8072-460f-463a-96f7-d925a9817a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:33.648676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac8072-460f-463a-96f7-d925a9817a5d admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:33.649036 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac8072-460f-463a-96f7-d925a9817a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:33.649415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac8072-460f-463a-96f7-d925a9817a5d admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:33.650433 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac8072-460f-463a-96f7-d925a9817a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:33.654428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac8072-460f-463a-96f7-d925a9817a5d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:33.656063 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339098c-12cc-4373-8d82-7831cb38e45e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:33.658147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5339098c-12cc-4373-8d82-7831cb38e45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:33.671926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:33.673793 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339098c-12cc-4373-8d82-7831cb38e45e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:33.683225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd8594-94e1-4325-81a5-a69da4573f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:33.684295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd8594-94e1-4325-81a5-a69da4573f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:33.684583 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd8594-94e1-4325-81a5-a69da4573f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:33.684970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd8594-94e1-4325-81a5-a69da4573f37 admin admin] PATH_INFO: `/v3/projects/e2f32c4d887c4011b57f675d27e4468d` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:33.686358 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd8594-94e1-4325-81a5-a69da4573f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2f32c4d887c4011b57f675d27e4468d)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:33.691879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1070/2132] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:33 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:33.692030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd8594-94e1-4325-81a5-a69da4573f37 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:33.701207 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac8072-460f-463a-96f7-d925a9817a5d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:33.713355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac8072-460f-463a-96f7-d925a9817a5d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:33.719491 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b17ab2-c444-40f2-b35e-06c312340e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:33.720170 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b17ab2-c444-40f2-b35e-06c312340e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:33.720644 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b17ab2-c444-40f2-b35e-06c312340e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:33.720933 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b17ab2-c444-40f2-b35e-06c312340e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:33.721707 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b17ab2-c444-40f2-b35e-06c312340e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:33.723614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b17ab2-c444-40f2-b35e-06c312340e90 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:33.738302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1071/2133] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:33.742806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b17ab2-c444-40f2-b35e-06c312340e90 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:33.756337 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b17ab2-c444-40f2-b35e-06c312340e90 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:33.764726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-88cd8594-94e1-4325-81a5-a69da4573f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2f32c4d887c4011b57f675d27e4468d', 'request_id': 'req-88cd8594-94e1-4325-81a5-a69da4573f37'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:33.778575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-88cd8594-94e1-4325-81a5-a69da4573f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2f32c4d887c4011b57f675d27e4468d', 'request_id': 'req-88cd8594-94e1-4325-81a5-a69da4573f37'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:33.786467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-88cd8594-94e1-4325-81a5-a69da4573f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2f32c4d887c4011b57f675d27e4468d', 'request_id': 'req-88cd8594-94e1-4325-81a5-a69da4573f37'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:33.805132 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-88cd8594-94e1-4325-81a5-a69da4573f37 admin admin] The token cache is being invalidate because project e2f32c4d887c4011b57f675d27e4468d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:33.805447 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-88cd8594-94e1-4325-81a5-a69da4573f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:33.806155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-88cd8594-94e1-4325-81a5-a69da4573f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:33.807971 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1063/2134] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:33 2022] DELETE /identity/v3/projects/e2f32c4d887c4011b57f675d27e4468d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:33.811734 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd8594-94e1-4325-81a5-a69da4573f37 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:33.813214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-88cd8594-94e1-4325-81a5-a69da4573f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:33.826496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e406bf-67c7-4348-8559-7e0f1a91de7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:33.827334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:33.827814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e406bf-67c7-4348-8559-7e0f1a91de7a admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:33.828284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e406bf-67c7-4348-8559-7e0f1a91de7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:33.828920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e406bf-67c7-4348-8559-7e0f1a91de7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:33.829802 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e406bf-67c7-4348-8559-7e0f1a91de7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:33.831568 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e406bf-67c7-4348-8559-7e0f1a91de7a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:33.843141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1072/2135] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:02:33.847359 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e406bf-67c7-4348-8559-7e0f1a91de7a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:33.849093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-17e406bf-67c7-4348-8559-7e0f1a91de7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:33.861740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e406bf-67c7-4348-8559-7e0f1a91de7a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:33.866902 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91444d9b-2aea-4a55-ac12-2d5427a7c7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:33.867779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91444d9b-2aea-4a55-ac12-2d5427a7c7c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:33.868065 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91444d9b-2aea-4a55-ac12-2d5427a7c7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:33.868342 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91444d9b-2aea-4a55-ac12-2d5427a7c7c0 admin admin] PATH_INFO: `/v3/projects/8431b8cdb5c34ed7bb46dcd760f9233d/users/fbf03a1c72e0457f88aa77038edd8c2f/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:33.883603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91444d9b-2aea-4a55-ac12-2d5427a7c7c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8431b8cdb5c34ed7bb46dcd760f9233d, user_id=fbf03a1c72e0457f88aa77038edd8c2f, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:33.886421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91444d9b-2aea-4a55-ac12-2d5427a7c7c0 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:33.895189 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd8594-94e1-4325-81a5-a69da4573f37 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:33.899525 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1073/2136] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:33 2022] PUT /identity/v3/projects/8431b8cdb5c34ed7bb46dcd760f9233d/users/fbf03a1c72e0457f88aa77038edd8c2f/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:33.957781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ac945-717b-42b7-b2f9-46c5190b953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:33.958707 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ac945-717b-42b7-b2f9-46c5190b953f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:33.958982 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ac945-717b-42b7-b2f9-46c5190b953f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:33.959252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ac945-717b-42b7-b2f9-46c5190b953f admin admin] PATH_INFO: `/v3/users/941b13b5450d436284373f2325af20c7` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:33.960464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ac945-717b-42b7-b2f9-46c5190b953f admin admin] RBAC: Authorizing `identity:delete_user(user_id=941b13b5450d436284373f2325af20c7)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:33.962439 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ac945-717b-42b7-b2f9-46c5190b953f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:33.968357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070da42-eb4a-432c-a3b0-11a605c51fc3 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:33.968901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070da42-eb4a-432c-a3b0-11a605c51fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:33.969031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070da42-eb4a-432c-a3b0-11a605c51fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:33.999665 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c070da42-eb4a-432c-a3b0-11a605c51fc3 None None] MFA Rules not processed for user `fbf03a1c72e0457f88aa77038edd8c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:34.001880 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c070da42-eb4a-432c-a3b0-11a605c51fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:34.020982 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ee8ac945-717b-42b7-b2f9-46c5190b953f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '941b13b5450d436284373f2325af20c7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:34.030184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ee8ac945-717b-42b7-b2f9-46c5190b953f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '941b13b5450d436284373f2325af20c7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:34.039979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ee8ac945-717b-42b7-b2f9-46c5190b953f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '941b13b5450d436284373f2325af20c7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:34.040919 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ee8ac945-717b-42b7-b2f9-46c5190b953f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '941b13b5450d436284373f2325af20c7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:34.041692 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ee8ac945-717b-42b7-b2f9-46c5190b953f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '941b13b5450d436284373f2325af20c7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:34.062131 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1064/2137] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:33 2022] DELETE /identity/v3/users/941b13b5450d436284373f2325af20c7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:34.081270 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1074/2138] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:34.085992 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ac945-717b-42b7-b2f9-46c5190b953f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:34.091121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ee8ac945-717b-42b7-b2f9-46c5190b953f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:34.155253 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:34.187864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ac945-717b-42b7-b2f9-46c5190b953f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:34.193863 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2e278-e686-4cdc-9d85-20195337b328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:34.194519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2e278-e686-4cdc-9d85-20195337b328 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:34.195299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2e278-e686-4cdc-9d85-20195337b328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:34.195590 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2e278-e686-4cdc-9d85-20195337b328 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:34.196309 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2e278-e686-4cdc-9d85-20195337b328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:34.198453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2e278-e686-4cdc-9d85-20195337b328 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:34.243069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1065/2139] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:34 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:34.247038 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070da42-eb4a-432c-a3b0-11a605c51fc3 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:34.262014 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070da42-eb4a-432c-a3b0-11a605c51fc3 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:34.321440 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:34.359275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd1aa4-bb71-42f0-ae05-1f6ccd2e31b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:34.359973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd1aa4-bb71-42f0-ae05-1f6ccd2e31b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:34.360255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd1aa4-bb71-42f0-ae05-1f6ccd2e31b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:34.360675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd1aa4-bb71-42f0-ae05-1f6ccd2e31b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:34.361542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd1aa4-bb71-42f0-ae05-1f6ccd2e31b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:34.363782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd1aa4-bb71-42f0-ae05-1f6ccd2e31b3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:34.402583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1075/2140] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:34 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:34.406248 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2e278-e686-4cdc-9d85-20195337b328 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:34.411083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd1aa4-bb71-42f0-ae05-1f6ccd2e31b3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:34.413075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b3fd1aa4-bb71-42f0-ae05-1f6ccd2e31b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:34.418604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2e278-e686-4cdc-9d85-20195337b328 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:34.432718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd1aa4-bb71-42f0-ae05-1f6ccd2e31b3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:34.435211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ad8ad-1af5-49af-a3a9-ed7785349905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:34.435980 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ad8ad-1af5-49af-a3a9-ed7785349905 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:34.436400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ad8ad-1af5-49af-a3a9-ed7785349905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:34.436676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ad8ad-1af5-49af-a3a9-ed7785349905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:34.437617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ad8ad-1af5-49af-a3a9-ed7785349905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:34.441344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ad8ad-1af5-49af-a3a9-ed7785349905 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:34.444226 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0ebe3-ed2b-468a-baa6-5e974a8c3e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:34.445100 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0ebe3-ed2b-468a-baa6-5e974a8c3e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:34.445388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0ebe3-ed2b-468a-baa6-5e974a8c3e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:34.445653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0ebe3-ed2b-468a-baa6-5e974a8c3e3b admin admin] PATH_INFO: `/v3/projects/edbf90d1cbe44598a4d1fa4dc2ec9196` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:34.446899 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0ebe3-ed2b-468a-baa6-5e974a8c3e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=edbf90d1cbe44598a4d1fa4dc2ec9196)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:34.448841 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0ebe3-ed2b-468a-baa6-5e974a8c3e3b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:34.453888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1066/2141] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:34.458783 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ad8ad-1af5-49af-a3a9-ed7785349905 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:34.468951 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ad8ad-1af5-49af-a3a9-ed7785349905 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:34.474413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7f381-c775-4994-8678-94ab7d0d8422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:34.475284 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7f381-c775-4994-8678-94ab7d0d8422 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:34.475563 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7f381-c775-4994-8678-94ab7d0d8422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:34.475831 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7f381-c775-4994-8678-94ab7d0d8422 admin admin] PATH_INFO: `/v3/projects/5de7fa97604c4ba1be4244b012ac3bba/users/0c03d0f79513466190e76e9cef810772/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:34.492429 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7f381-c775-4994-8678-94ab7d0d8422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de7fa97604c4ba1be4244b012ac3bba, user_id=0c03d0f79513466190e76e9cef810772, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:34.495112 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7f381-c775-4994-8678-94ab7d0d8422 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:34.498102 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-22b0ebe3-ed2b-468a-baa6-5e974a8c3e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edbf90d1cbe44598a4d1fa4dc2ec9196', 'request_id': 'req-22b0ebe3-ed2b-468a-baa6-5e974a8c3e3b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:34.504755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-22b0ebe3-ed2b-468a-baa6-5e974a8c3e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edbf90d1cbe44598a4d1fa4dc2ec9196', 'request_id': 'req-22b0ebe3-ed2b-468a-baa6-5e974a8c3e3b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:34.509499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1067/2142] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:34 2022] PUT /identity/v3/projects/5de7fa97604c4ba1be4244b012ac3bba/users/0c03d0f79513466190e76e9cef810772/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:34.513142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7f381-c775-4994-8678-94ab7d0d8422 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:34.513395 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-22b0ebe3-ed2b-468a-baa6-5e974a8c3e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edbf90d1cbe44598a4d1fa4dc2ec9196', 'request_id': 'req-22b0ebe3-ed2b-468a-baa6-5e974a8c3e3b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:34.528157 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-22b0ebe3-ed2b-468a-baa6-5e974a8c3e3b admin admin] The token cache is being invalidate because project edbf90d1cbe44598a4d1fa4dc2ec9196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:34.528511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-22b0ebe3-ed2b-468a-baa6-5e974a8c3e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:34.529388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-22b0ebe3-ed2b-468a-baa6-5e974a8c3e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:34.531417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1076/2143] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:34 2022] DELETE /identity/v3/projects/edbf90d1cbe44598a4d1fa4dc2ec9196 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:34.535968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7a08c-03a1-4647-8cea-9092e20b858b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:34.536314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7a08c-03a1-4647-8cea-9092e20b858b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:34.536650 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7a08c-03a1-4647-8cea-9092e20b858b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:34.563366 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-70b7a08c-03a1-4647-8cea-9092e20b858b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:34.564687 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-70b7a08c-03a1-4647-8cea-9092e20b858b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:34.590330 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7f381-c775-4994-8678-94ab7d0d8422 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:34.597803 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1ee2c-6011-402a-84f3-dc7a8e937565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:34.598519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1ee2c-6011-402a-84f3-dc7a8e937565 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:34.598806 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1ee2c-6011-402a-84f3-dc7a8e937565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:34.599193 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1ee2c-6011-402a-84f3-dc7a8e937565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:34.599972 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1ee2c-6011-402a-84f3-dc7a8e937565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:34.601664 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1ee2c-6011-402a-84f3-dc7a8e937565 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:34.618016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1068/2144] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:02:34.618997 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1ee2c-6011-402a-84f3-dc7a8e937565 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:34.620701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a5b1ee2c-6011-402a-84f3-dc7a8e937565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:34.636597 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1ee2c-6011-402a-84f3-dc7a8e937565 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:34.641770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021f150-a0b9-4c53-ba38-01fd53d61b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:34.642687 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021f150-a0b9-4c53-ba38-01fd53d61b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:34.642966 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021f150-a0b9-4c53-ba38-01fd53d61b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:34.643230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021f150-a0b9-4c53-ba38-01fd53d61b16 admin admin] PATH_INFO: `/v3/projects/5de7fa97604c4ba1be4244b012ac3bba/users/0c03d0f79513466190e76e9cef810772/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:34.645319 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021f150-a0b9-4c53-ba38-01fd53d61b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de7fa97604c4ba1be4244b012ac3bba, user_id=0c03d0f79513466190e76e9cef810772, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:34.647966 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021f150-a0b9-4c53-ba38-01fd53d61b16 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:34.655269 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1077/2145] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:34.663579 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62cae4-807a-4ec5-b6c6-15541ff34aa3 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:34.664760 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62cae4-807a-4ec5-b6c6-15541ff34aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:34.665338 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62cae4-807a-4ec5-b6c6-15541ff34aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:34.667019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1069/2146] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:34 2022] PUT /identity/v3/projects/5de7fa97604c4ba1be4244b012ac3bba/users/0c03d0f79513466190e76e9cef810772/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:34.679148 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a6015-d246-4748-b612-a2c96f1a13ef None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:34.680241 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a6015-d246-4748-b612-a2c96f1a13ef None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:34.680530 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a6015-d246-4748-b612-a2c96f1a13ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:34.694012 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ad62cae4-807a-4ec5-b6c6-15541ff34aa3 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:34.695759 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ad62cae4-807a-4ec5-b6c6-15541ff34aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:34.713822 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-549a6015-d246-4748-b612-a2c96f1a13ef None None] MFA Rules not processed for user `0c03d0f79513466190e76e9cef810772`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:34.715049 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-549a6015-d246-4748-b612-a2c96f1a13ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:34.758651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:34.769325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1078/2147] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:34.773154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62cae4-807a-4ec5-b6c6-15541ff34aa3 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:34.783111 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62cae4-807a-4ec5-b6c6-15541ff34aa3 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:34.790050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:34.790526 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe42b2-8e1e-4fdc-8cab-c2430f2bd8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:34.790758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe42b2-8e1e-4fdc-8cab-c2430f2bd8cb admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:34.791409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe42b2-8e1e-4fdc-8cab-c2430f2bd8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:34.791409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe42b2-8e1e-4fdc-8cab-c2430f2bd8cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:34.792025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe42b2-8e1e-4fdc-8cab-c2430f2bd8cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:34.792331 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe42b2-8e1e-4fdc-8cab-c2430f2bd8cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:34.794161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe42b2-8e1e-4fdc-8cab-c2430f2bd8cb admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:34.807229 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1070/2148] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:34.808791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1079/2149] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 22:02:34.812957 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a6015-d246-4748-b612-a2c96f1a13ef None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:34.819133 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe42b2-8e1e-4fdc-8cab-c2430f2bd8cb admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:34.821732 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8cbe42b2-8e1e-4fdc-8cab-c2430f2bd8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:34.830262 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a6015-d246-4748-b612-a2c96f1a13ef None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:34.836194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0276a-c145-4ff2-b7a1-6f2aa4ac0d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:34.837434 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0276a-c145-4ff2-b7a1-6f2aa4ac0d89 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:34.837434 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0276a-c145-4ff2-b7a1-6f2aa4ac0d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:34.837434 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0276a-c145-4ff2-b7a1-6f2aa4ac0d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:34.838124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0276a-c145-4ff2-b7a1-6f2aa4ac0d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:34.840233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0276a-c145-4ff2-b7a1-6f2aa4ac0d89 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:34.868437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1071/2150] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:34 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:02:34.872453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0276a-c145-4ff2-b7a1-6f2aa4ac0d89 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:34.887638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe42b2-8e1e-4fdc-8cab-c2430f2bd8cb admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:34.943173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0276a-c145-4ff2-b7a1-6f2aa4ac0d89 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:34.947465 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5e769-a07c-4673-8164-7d39d52b6c71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:34.947755 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a03d65-ba09-4117-8633-ac1dc20570eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:34.948129 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5e769-a07c-4673-8164-7d39d52b6c71 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:34.948409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5e769-a07c-4673-8164-7d39d52b6c71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:34.948510 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a03d65-ba09-4117-8633-ac1dc20570eb admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:34.948683 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5e769-a07c-4673-8164-7d39d52b6c71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:34.948791 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a03d65-ba09-4117-8633-ac1dc20570eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:34.948948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a03d65-ba09-4117-8633-ac1dc20570eb admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:34.949638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a03d65-ba09-4117-8633-ac1dc20570eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:34.951161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-57d5e769-a07c-4673-8164-7d39d52b6c71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:34.951634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a03d65-ba09-4117-8633-ac1dc20570eb admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:34.979765 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1072/2151] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:34 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:02:34.984034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a03d65-ba09-4117-8633-ac1dc20570eb admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:34.994369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a03d65-ba09-4117-8633-ac1dc20570eb admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:34.999033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6e22d-d2a1-49d2-ad61-0d3c5c4e5c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:34.999692 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6e22d-d2a1-49d2-ad61-0d3c5c4e5c9d admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:34.999972 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6e22d-d2a1-49d2-ad61-0d3c5c4e5c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:35.000245 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6e22d-d2a1-49d2-ad61-0d3c5c4e5c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:35.000994 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6e22d-d2a1-49d2-ad61-0d3c5c4e5c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:35.002652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6e22d-d2a1-49d2-ad61-0d3c5c4e5c9d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:35.013588 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1073/2152] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:35.017198 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6e22d-d2a1-49d2-ad61-0d3c5c4e5c9d admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:35.026077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5e769-a07c-4673-8164-7d39d52b6c71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:35.027530 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5e769-a07c-4673-8164-7d39d52b6c71 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:35.027736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6e22d-d2a1-49d2-ad61-0d3c5c4e5c9d admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:35.032554 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7a082-ce17-4d40-be95-179c001b371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:35.033283 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7a082-ce17-4d40-be95-179c001b371c admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:35.033565 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7a082-ce17-4d40-be95-179c001b371c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:35.033836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7a082-ce17-4d40-be95-179c001b371c admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:35.034664 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7a082-ce17-4d40-be95-179c001b371c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:35.036195 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7a082-ce17-4d40-be95-179c001b371c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:35.038339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1080/2153] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:35.048326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1074/2154] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:02:35.052757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5e769-a07c-4673-8164-7d39d52b6c71 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:35.063227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5e769-a07c-4673-8164-7d39d52b6c71 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:35.067893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359382ac-9966-4c00-8be7-25dc364e305d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:35.068851 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359382ac-9966-4c00-8be7-25dc364e305d admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:35.069219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359382ac-9966-4c00-8be7-25dc364e305d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:35.069487 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359382ac-9966-4c00-8be7-25dc364e305d admin admin] PATH_INFO: `/v3/projects/96eff2206af1414281a4d8f00e612b01/users/8860e638db954fdf85a69294fb9c7606/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:35.085134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359382ac-9966-4c00-8be7-25dc364e305d admin admin] RBAC: Authorizing `identity:create_grant(project_id=96eff2206af1414281a4d8f00e612b01, user_id=8860e638db954fdf85a69294fb9c7606, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:35.088089 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359382ac-9966-4c00-8be7-25dc364e305d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:35.101651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1081/2155] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:35 2022] PUT /identity/v3/projects/96eff2206af1414281a4d8f00e612b01/users/8860e638db954fdf85a69294fb9c7606/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:35.113206 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751df6a2-b4d3-416d-b957-fcfa8858c9ec None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:35.113496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751df6a2-b4d3-416d-b957-fcfa8858c9ec None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:35.113774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751df6a2-b4d3-416d-b957-fcfa8858c9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:35.139740 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-751df6a2-b4d3-416d-b957-fcfa8858c9ec None None] MFA Rules not processed for user `8860e638db954fdf85a69294fb9c7606`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:35.140943 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-751df6a2-b4d3-416d-b957-fcfa8858c9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:35.210261 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1075/2156] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:35.221380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359382ac-9966-4c00-8be7-25dc364e305d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:35.223669 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-359382ac-9966-4c00-8be7-25dc364e305d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:35.266815 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:35.297361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359382ac-9966-4c00-8be7-25dc364e305d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:35.300386 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02893f82-4c17-4771-847a-f9425cd9b186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:35.301133 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02893f82-4c17-4771-847a-f9425cd9b186 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:35.301581 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02893f82-4c17-4771-847a-f9425cd9b186 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:35.301945 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02893f82-4c17-4771-847a-f9425cd9b186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:35.312600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02893f82-4c17-4771-847a-f9425cd9b186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:35.314481 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02893f82-4c17-4771-847a-f9425cd9b186 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:35.326340 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1082/2157] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:35.346701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751df6a2-b4d3-416d-b957-fcfa8858c9ec None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:35.392642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:35.437638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751df6a2-b4d3-416d-b957-fcfa8858c9ec None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:35.443367 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92219c20-e993-437e-8ceb-863ee5f2e1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:35.444546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92219c20-e993-437e-8ceb-863ee5f2e1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:35.444675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92219c20-e993-437e-8ceb-863ee5f2e1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:35.444939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92219c20-e993-437e-8ceb-863ee5f2e1fe admin admin] PATH_INFO: `/v3/users/8860e638db954fdf85a69294fb9c7606` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:35.446692 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92219c20-e993-437e-8ceb-863ee5f2e1fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=8860e638db954fdf85a69294fb9c7606)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:35.449405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92219c20-e993-437e-8ceb-863ee5f2e1fe admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:35.500555 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-92219c20-e993-437e-8ceb-863ee5f2e1fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8860e638db954fdf85a69294fb9c7606'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:35.510062 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-92219c20-e993-437e-8ceb-863ee5f2e1fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8860e638db954fdf85a69294fb9c7606'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:35.520051 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-92219c20-e993-437e-8ceb-863ee5f2e1fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8860e638db954fdf85a69294fb9c7606'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:35.520910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-92219c20-e993-437e-8ceb-863ee5f2e1fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8860e638db954fdf85a69294fb9c7606'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:35.521746 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-92219c20-e993-437e-8ceb-863ee5f2e1fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8860e638db954fdf85a69294fb9c7606'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:35.541739 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1076/2158] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:35 2022] DELETE /identity/v3/users/8860e638db954fdf85a69294fb9c7606 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:35.546508 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12401ab4-210d-44e4-970c-39c9bffbe677 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:35.546910 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12401ab4-210d-44e4-970c-39c9bffbe677 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:35.547253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12401ab4-210d-44e4-970c-39c9bffbe677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:35.566424 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-12401ab4-210d-44e4-970c-39c9bffbe677 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:35.568010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-12401ab4-210d-44e4-970c-39c9bffbe677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:35.650130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1083/2159] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:35.656875 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92219c20-e993-437e-8ceb-863ee5f2e1fe admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:35.658321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-92219c20-e993-437e-8ceb-863ee5f2e1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:35.715713 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92219c20-e993-437e-8ceb-863ee5f2e1fe admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:35.719300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7b05d-3913-4a5c-906b-c6c201b6e0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:35.719945 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7b05d-3913-4a5c-906b-c6c201b6e0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:35.720222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7b05d-3913-4a5c-906b-c6c201b6e0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:35.720501 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7b05d-3913-4a5c-906b-c6c201b6e0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:35.730577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7b05d-3913-4a5c-906b-c6c201b6e0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:35.732269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7b05d-3913-4a5c-906b-c6c201b6e0c6 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:35.742987 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1077/2160] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:36.082848 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12401ab4-210d-44e4-970c-39c9bffbe677 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:36.084838 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-12401ab4-210d-44e4-970c-39c9bffbe677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:36.098583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12401ab4-210d-44e4-970c-39c9bffbe677 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:36.105452 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd463e3c-9ad7-4449-8ca5-7c41d645dc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:36.106445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd463e3c-9ad7-4449-8ca5-7c41d645dc1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:36.106987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd463e3c-9ad7-4449-8ca5-7c41d645dc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:36.107257 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd463e3c-9ad7-4449-8ca5-7c41d645dc1e admin admin] PATH_INFO: `/v3/projects/96eff2206af1414281a4d8f00e612b01` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:36.108427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd463e3c-9ad7-4449-8ca5-7c41d645dc1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=96eff2206af1414281a4d8f00e612b01)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:36.110371 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd463e3c-9ad7-4449-8ca5-7c41d645dc1e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:36.165783 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-cd463e3c-9ad7-4449-8ca5-7c41d645dc1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96eff2206af1414281a4d8f00e612b01', 'request_id': 'req-cd463e3c-9ad7-4449-8ca5-7c41d645dc1e'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:36.172163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-cd463e3c-9ad7-4449-8ca5-7c41d645dc1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96eff2206af1414281a4d8f00e612b01', 'request_id': 'req-cd463e3c-9ad7-4449-8ca5-7c41d645dc1e'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:36.182224 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-cd463e3c-9ad7-4449-8ca5-7c41d645dc1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96eff2206af1414281a4d8f00e612b01', 'request_id': 'req-cd463e3c-9ad7-4449-8ca5-7c41d645dc1e'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:36.196544 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-cd463e3c-9ad7-4449-8ca5-7c41d645dc1e admin admin] The token cache is being invalidate because project 96eff2206af1414281a4d8f00e612b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:36.196837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-cd463e3c-9ad7-4449-8ca5-7c41d645dc1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:36.197477 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-cd463e3c-9ad7-4449-8ca5-7c41d645dc1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:36.199123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1084/2161] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:36 2022] DELETE /identity/v3/projects/96eff2206af1414281a4d8f00e612b01 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:36.204416 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624a94b-953d-4538-92f7-0afdf1acc34a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:36.204950 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624a94b-953d-4538-92f7-0afdf1acc34a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:36.205033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624a94b-953d-4538-92f7-0afdf1acc34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:36.223189 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c624a94b-953d-4538-92f7-0afdf1acc34a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:36.224310 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c624a94b-953d-4538-92f7-0afdf1acc34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:36.270358 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:36.285544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1078/2162] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:36.293274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ccdf-5492-4f1f-a289-c1433dccb561 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:36.293569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ccdf-5492-4f1f-a289-c1433dccb561 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:36.293853 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ccdf-5492-4f1f-a289-c1433dccb561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:36.311889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-fd90ccdf-5492-4f1f-a289-c1433dccb561 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:36.313086 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fd90ccdf-5492-4f1f-a289-c1433dccb561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:36.321406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1085/2163] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:36.325439 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624a94b-953d-4538-92f7-0afdf1acc34a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:36.335625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624a94b-953d-4538-92f7-0afdf1acc34a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:36.340187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfca532-ee25-4a47-93ff-3290ac2fac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:36.340827 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfca532-ee25-4a47-93ff-3290ac2fac4f admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:36.341113 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfca532-ee25-4a47-93ff-3290ac2fac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:36.341386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfca532-ee25-4a47-93ff-3290ac2fac4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:36.342137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfca532-ee25-4a47-93ff-3290ac2fac4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:36.342447 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfca532-ee25-4a47-93ff-3290ac2fac4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:36.344043 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfca532-ee25-4a47-93ff-3290ac2fac4f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:36.355781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1079/2164] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 22:02:36.360371 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90ccdf-5492-4f1f-a289-c1433dccb561 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:36.370496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90ccdf-5492-4f1f-a289-c1433dccb561 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:36.375270 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e180f-4e26-4d4b-9b75-05ef3add58fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:36.375919 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e180f-4e26-4d4b-9b75-05ef3add58fd admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:36.376207 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e180f-4e26-4d4b-9b75-05ef3add58fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:36.376488 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e180f-4e26-4d4b-9b75-05ef3add58fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:36.377196 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e180f-4e26-4d4b-9b75-05ef3add58fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:36.379654 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e180f-4e26-4d4b-9b75-05ef3add58fd admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:36.412814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1086/2165] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:36 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:02:36.416886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfca532-ee25-4a47-93ff-3290ac2fac4f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:36.427173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfca532-ee25-4a47-93ff-3290ac2fac4f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:36.487451 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a3ee0-ee65-47a1-b0b8-dbce12d1b990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:36.488119 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a3ee0-ee65-47a1-b0b8-dbce12d1b990 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:36.488399 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a3ee0-ee65-47a1-b0b8-dbce12d1b990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:36.488676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a3ee0-ee65-47a1-b0b8-dbce12d1b990 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:36.489367 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a3ee0-ee65-47a1-b0b8-dbce12d1b990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:36.491312 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a3ee0-ee65-47a1-b0b8-dbce12d1b990 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:36.517968 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1080/2166] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:36 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:36.521257 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e180f-4e26-4d4b-9b75-05ef3add58fd admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:36.532242 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e180f-4e26-4d4b-9b75-05ef3add58fd admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:36.537895 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed98b9b-2765-4d7e-936b-da02715512dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:36.538609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed98b9b-2765-4d7e-936b-da02715512dc admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:36.538900 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed98b9b-2765-4d7e-936b-da02715512dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:36.539177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed98b9b-2765-4d7e-936b-da02715512dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:36.539909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed98b9b-2765-4d7e-936b-da02715512dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:36.541509 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed98b9b-2765-4d7e-936b-da02715512dc admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:36.553362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1087/2167] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:36.557201 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a3ee0-ee65-47a1-b0b8-dbce12d1b990 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:36.564578 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed98b9b-2765-4d7e-936b-da02715512dc admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:36.566350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9ed98b9b-2765-4d7e-936b-da02715512dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:36.567886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a3ee0-ee65-47a1-b0b8-dbce12d1b990 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:36.572714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c4c31-ba97-443f-9a91-f6915117c2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:36.573374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c4c31-ba97-443f-9a91-f6915117c2fa admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:36.573683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c4c31-ba97-443f-9a91-f6915117c2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:36.573994 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c4c31-ba97-443f-9a91-f6915117c2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:36.574718 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c4c31-ba97-443f-9a91-f6915117c2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:36.576306 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c4c31-ba97-443f-9a91-f6915117c2fa admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:36.587241 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1081/2168] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:36.591000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:36.591701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c4c31-ba97-443f-9a91-f6915117c2fa admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:36.602453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c4c31-ba97-443f-9a91-f6915117c2fa admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:36.607770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f8d7f-dc4d-4d1d-b78a-87641a36a9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:36.608638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f8d7f-dc4d-4d1d-b78a-87641a36a9be admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:36.608916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f8d7f-dc4d-4d1d-b78a-87641a36a9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:36.609201 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f8d7f-dc4d-4d1d-b78a-87641a36a9be admin admin] PATH_INFO: `/v3/projects/d4ad87642fb14460a027c6a187af1bd9/users/f20eaed1ee4c4c5ab3c43c326221759c/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:36.624671 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f8d7f-dc4d-4d1d-b78a-87641a36a9be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ad87642fb14460a027c6a187af1bd9, user_id=f20eaed1ee4c4c5ab3c43c326221759c, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:36.627512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f8d7f-dc4d-4d1d-b78a-87641a36a9be admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:36.631826 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed98b9b-2765-4d7e-936b-da02715512dc admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:36.637956 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96235aca-6c95-4bac-85ac-02514db23d99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:36.638694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96235aca-6c95-4bac-85ac-02514db23d99 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:36.639015 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96235aca-6c95-4bac-85ac-02514db23d99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:36.639285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96235aca-6c95-4bac-85ac-02514db23d99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:36.641133 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-96235aca-6c95-4bac-85ac-02514db23d99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:36.642432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1082/2169] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:36 2022] PUT /identity/v3/projects/d4ad87642fb14460a027c6a187af1bd9/users/f20eaed1ee4c4c5ab3c43c326221759c/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:36.654340 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ee480-8344-4a67-b67a-159f4947b4e5 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:36.655044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ee480-8344-4a67-b67a-159f4947b4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:36.655338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ee480-8344-4a67-b67a-159f4947b4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:36.687865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8d7ee480-8344-4a67-b67a-159f4947b4e5 None None] MFA Rules not processed for user `f20eaed1ee4c4c5ab3c43c326221759c`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:36.689159 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8d7ee480-8344-4a67-b67a-159f4947b4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:36.714740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96235aca-6c95-4bac-85ac-02514db23d99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:36.716340 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96235aca-6c95-4bac-85ac-02514db23d99 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:36.727125 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1088/2170] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:02:36.759595 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1083/2171] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:36.930320 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96235aca-6c95-4bac-85ac-02514db23d99 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:36.932310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-96235aca-6c95-4bac-85ac-02514db23d99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:36.946729 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96235aca-6c95-4bac-85ac-02514db23d99 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:37.007029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915e8a0-3fd9-4455-a980-0b6c6603a4f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:37.007760 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915e8a0-3fd9-4455-a980-0b6c6603a4f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:37.008141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915e8a0-3fd9-4455-a980-0b6c6603a4f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:37.008631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915e8a0-3fd9-4455-a980-0b6c6603a4f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:37.018290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915e8a0-3fd9-4455-a980-0b6c6603a4f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:37.020294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915e8a0-3fd9-4455-a980-0b6c6603a4f2 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:37.030092 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1089/2172] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:02:37.473279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ee480-8344-4a67-b67a-159f4947b4e5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:37.505639 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ee480-8344-4a67-b67a-159f4947b4e5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:37.510899 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc71be7-d247-4b2a-96df-00380a6b0d09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:37.511662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc71be7-d247-4b2a-96df-00380a6b0d09 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:37.511838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc71be7-d247-4b2a-96df-00380a6b0d09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:37.512114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc71be7-d247-4b2a-96df-00380a6b0d09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:37.515156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6dc71be7-d247-4b2a-96df-00380a6b0d09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:37.542108 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:37.617188 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc71be7-d247-4b2a-96df-00380a6b0d09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:37.618665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc71be7-d247-4b2a-96df-00380a6b0d09 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:37.629186 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1084/2173] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:40.821254 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915e8a0-3fd9-4455-a980-0b6c6603a4f2 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:40.822753 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b915e8a0-3fd9-4455-a980-0b6c6603a4f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:40.891582 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915e8a0-3fd9-4455-a980-0b6c6603a4f2 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:40.896936 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e219b6-d085-494a-903c-3955c44f7e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:40.897794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e219b6-d085-494a-903c-3955c44f7e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:40.898106 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e219b6-d085-494a-903c-3955c44f7e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:40.898425 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e219b6-d085-494a-903c-3955c44f7e67 admin admin] PATH_INFO: `/v3/users/1459bd20badd483183e4cc0764302e59` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:40.899601 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e219b6-d085-494a-903c-3955c44f7e67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1459bd20badd483183e4cc0764302e59)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:40.901503 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e219b6-d085-494a-903c-3955c44f7e67 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:40.922039 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:40.947269 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-97e219b6-d085-494a-903c-3955c44f7e67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1459bd20badd483183e4cc0764302e59'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:40.953883 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-97e219b6-d085-494a-903c-3955c44f7e67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1459bd20badd483183e4cc0764302e59'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:40.954564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-97e219b6-d085-494a-903c-3955c44f7e67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1459bd20badd483183e4cc0764302e59'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:40.961636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-97e219b6-d085-494a-903c-3955c44f7e67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1459bd20badd483183e4cc0764302e59'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:40.962342 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-97e219b6-d085-494a-903c-3955c44f7e67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1459bd20badd483183e4cc0764302e59'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:40.979966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1090/2174] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:40 2022] DELETE /identity/v3/users/1459bd20badd483183e4cc0764302e59 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:40.984810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571acf9f-5a48-439d-99bd-e403af13b42a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:40.985291 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571acf9f-5a48-439d-99bd-e403af13b42a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:40.985399 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571acf9f-5a48-439d-99bd-e403af13b42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:41.002735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-571acf9f-5a48-439d-99bd-e403af13b42a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:41.003917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-571acf9f-5a48-439d-99bd-e403af13b42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:41.061576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1085/2175] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:41.070994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e219b6-d085-494a-903c-3955c44f7e67 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:41.072369 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-97e219b6-d085-494a-903c-3955c44f7e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:41.128602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e219b6-d085-494a-903c-3955c44f7e67 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:41.132167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b2ab3-9098-4aea-80a7-7398ce437d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:41.132795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b2ab3-9098-4aea-80a7-7398ce437d14 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:41.133073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b2ab3-9098-4aea-80a7-7398ce437d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:41.133344 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b2ab3-9098-4aea-80a7-7398ce437d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:41.142261 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b2ab3-9098-4aea-80a7-7398ce437d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:41.144185 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b2ab3-9098-4aea-80a7-7398ce437d14 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:41.153395 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1091/2176] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:41.483038 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571acf9f-5a48-439d-99bd-e403af13b42a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:41.484536 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-571acf9f-5a48-439d-99bd-e403af13b42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:41.497567 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571acf9f-5a48-439d-99bd-e403af13b42a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:41.514121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0475b-cece-4a1b-8f01-00b48c41a1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:41.515409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0475b-cece-4a1b-8f01-00b48c41a1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:41.516127 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0475b-cece-4a1b-8f01-00b48c41a1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:41.516478 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0475b-cece-4a1b-8f01-00b48c41a1c9 admin admin] PATH_INFO: `/v3/projects/7c734caf89974de2a5b633a52fc63989` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:41.517520 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0475b-cece-4a1b-8f01-00b48c41a1c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c734caf89974de2a5b633a52fc63989)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:41.520240 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0475b-cece-4a1b-8f01-00b48c41a1c9 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:41.593967 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-50e0475b-cece-4a1b-8f01-00b48c41a1c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c734caf89974de2a5b633a52fc63989', 'request_id': 'req-50e0475b-cece-4a1b-8f01-00b48c41a1c9'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:41.603897 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-50e0475b-cece-4a1b-8f01-00b48c41a1c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c734caf89974de2a5b633a52fc63989', 'request_id': 'req-50e0475b-cece-4a1b-8f01-00b48c41a1c9'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:41.613681 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-50e0475b-cece-4a1b-8f01-00b48c41a1c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c734caf89974de2a5b633a52fc63989', 'request_id': 'req-50e0475b-cece-4a1b-8f01-00b48c41a1c9'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:41.634974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-50e0475b-cece-4a1b-8f01-00b48c41a1c9 admin admin] The token cache is being invalidate because project 7c734caf89974de2a5b633a52fc63989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:41.635569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-50e0475b-cece-4a1b-8f01-00b48c41a1c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:41.637061 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-50e0475b-cece-4a1b-8f01-00b48c41a1c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:41.655061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb5062-0a17-421f-b516-d3b8ce8bfd4a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:41.655061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb5062-0a17-421f-b516-d3b8ce8bfd4a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:41.655061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb5062-0a17-421f-b516-d3b8ce8bfd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:41.655413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1086/2177] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:41 2022] DELETE /identity/v3/projects/7c734caf89974de2a5b633a52fc63989 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:41.659034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0475b-cece-4a1b-8f01-00b48c41a1c9 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:41.661027 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-50e0475b-cece-4a1b-8f01-00b48c41a1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:41.678226 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-55bb5062-0a17-421f-b516-d3b8ce8bfd4a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:41.681213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-55bb5062-0a17-421f-b516-d3b8ce8bfd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:41.730444 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:41.758194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0475b-cece-4a1b-8f01-00b48c41a1c9 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:41.764068 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1092/2178] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:41.764861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ce7b8-9121-481c-890d-13b32e154b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:41.765623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ce7b8-9121-481c-890d-13b32e154b8c service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:41.766124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ce7b8-9121-481c-890d-13b32e154b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:41.766594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ce7b8-9121-481c-890d-13b32e154b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:41.769434 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c57ce7b8-9121-481c-890d-13b32e154b8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:41.771633 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4afd7-ef24-47b5-b1ba-9c9ebe6b0892 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:41.771924 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4afd7-ef24-47b5-b1ba-9c9ebe6b0892 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:41.772203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4afd7-ef24-47b5-b1ba-9c9ebe6b0892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:41.790705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-65f4afd7-ef24-47b5-b1ba-9c9ebe6b0892 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:41.791907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-65f4afd7-ef24-47b5-b1ba-9c9ebe6b0892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:41.801125 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1093/2179] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:41.802860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4afd7-ef24-47b5-b1ba-9c9ebe6b0892 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:41.804377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-65f4afd7-ef24-47b5-b1ba-9c9ebe6b0892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:41.819426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4afd7-ef24-47b5-b1ba-9c9ebe6b0892 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:41.825885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76341dd9-18dc-48bc-ac6d-a369f733dbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:41.826896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76341dd9-18dc-48bc-ac6d-a369f733dbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:41.827275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76341dd9-18dc-48bc-ac6d-a369f733dbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:41.827990 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76341dd9-18dc-48bc-ac6d-a369f733dbba admin admin] PATH_INFO: `/v3/users/e8388b428eb44e89bce987a41aac8ce1` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:41.829427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76341dd9-18dc-48bc-ac6d-a369f733dbba admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8388b428eb44e89bce987a41aac8ce1)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:41.831913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76341dd9-18dc-48bc-ac6d-a369f733dbba admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:41.866105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:41.874101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ce7b8-9121-481c-890d-13b32e154b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:41.876966 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ce7b8-9121-481c-890d-13b32e154b8c service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:41.888562 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-76341dd9-18dc-48bc-ac6d-a369f733dbba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8388b428eb44e89bce987a41aac8ce1'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:41.892591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1087/2180] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:41 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:41.893601 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ce7b8-9121-481c-890d-13b32e154b8c service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:41.895973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-76341dd9-18dc-48bc-ac6d-a369f733dbba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8388b428eb44e89bce987a41aac8ce1'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:41.896660 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-76341dd9-18dc-48bc-ac6d-a369f733dbba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8388b428eb44e89bce987a41aac8ce1'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:41.905690 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ce7b8-9121-481c-890d-13b32e154b8c service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:41.906398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-76341dd9-18dc-48bc-ac6d-a369f733dbba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8388b428eb44e89bce987a41aac8ce1'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:41.907099 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-76341dd9-18dc-48bc-ac6d-a369f733dbba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8388b428eb44e89bce987a41aac8ce1'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:41.918173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4c540-b46c-4ffe-adcd-886d01ccb53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:41.919067 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c540-b46c-4ffe-adcd-886d01ccb53e admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:41.919503 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c540-b46c-4ffe-adcd-886d01ccb53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:41.919951 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4c540-b46c-4ffe-adcd-886d01ccb53e admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:41.920847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4c540-b46c-4ffe-adcd-886d01ccb53e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:41.921306 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4c540-b46c-4ffe-adcd-886d01ccb53e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:41.923610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4c540-b46c-4ffe-adcd-886d01ccb53e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:41.927010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1094/2181] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:41 2022] DELETE /identity/v3/users/e8388b428eb44e89bce987a41aac8ce1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:41.934834 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07da6b-3e91-4f25-a016-141b9d09b606 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:41.935938 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07da6b-3e91-4f25-a016-141b9d09b606 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:41.936734 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07da6b-3e91-4f25-a016-141b9d09b606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:41.941740 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1088/2182] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:02:41.946100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4c540-b46c-4ffe-adcd-886d01ccb53e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:41.948415 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-18f4c540-b46c-4ffe-adcd-886d01ccb53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:41.964988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4c540-b46c-4ffe-adcd-886d01ccb53e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:41.965517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-df07da6b-3e91-4f25-a016-141b9d09b606 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:41.970613 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-df07da6b-3e91-4f25-a016-141b9d09b606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:42.036656 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d901985-59af-49c5-99c2-95016519ed39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:42.037470 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d901985-59af-49c5-99c2-95016519ed39 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:42.037790 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d901985-59af-49c5-99c2-95016519ed39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:42.038160 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d901985-59af-49c5-99c2-95016519ed39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:42.039055 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d901985-59af-49c5-99c2-95016519ed39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:42.041107 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d901985-59af-49c5-99c2-95016519ed39 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:42.071929 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1089/2183] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:41 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:02:42.073705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1095/2184] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:42.076166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d901985-59af-49c5-99c2-95016519ed39 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:42.084733 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07da6b-3e91-4f25-a016-141b9d09b606 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:42.086484 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-df07da6b-3e91-4f25-a016-141b9d09b606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:42.150817 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d901985-59af-49c5-99c2-95016519ed39 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:42.155810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92748ce-5d2a-4ca1-88fb-b18e9451aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:42.156648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92748ce-5d2a-4ca1-88fb-b18e9451aafc admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:42.156956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92748ce-5d2a-4ca1-88fb-b18e9451aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:42.157223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92748ce-5d2a-4ca1-88fb-b18e9451aafc admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:42.157915 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92748ce-5d2a-4ca1-88fb-b18e9451aafc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:42.160419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92748ce-5d2a-4ca1-88fb-b18e9451aafc admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:42.162998 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07da6b-3e91-4f25-a016-141b9d09b606 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:42.171467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:42.189537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1090/2185] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:42 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:42.190649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92748ce-5d2a-4ca1-88fb-b18e9451aafc admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:42.200280 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92748ce-5d2a-4ca1-88fb-b18e9451aafc admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:42.204936 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f9653-5bc2-48b5-978a-82f711703265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:42.205582 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f9653-5bc2-48b5-978a-82f711703265 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:42.205894 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f9653-5bc2-48b5-978a-82f711703265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:42.206200 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f9653-5bc2-48b5-978a-82f711703265 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:42.206923 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f9653-5bc2-48b5-978a-82f711703265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:42.208523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f9653-5bc2-48b5-978a-82f711703265 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:42.219056 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1091/2186] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:42.219206 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e56423-2fec-4f1d-9b14-de9c66447b0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:42.219939 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e56423-2fec-4f1d-9b14-de9c66447b0d service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:42.220228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e56423-2fec-4f1d-9b14-de9c66447b0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:42.220512 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e56423-2fec-4f1d-9b14-de9c66447b0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:42.223516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f9653-5bc2-48b5-978a-82f711703265 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:42.232752 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e56423-2fec-4f1d-9b14-de9c66447b0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:42.233492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f9653-5bc2-48b5-978a-82f711703265 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:42.234220 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e56423-2fec-4f1d-9b14-de9c66447b0d service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:42.239069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118f209-60ea-4726-8b84-67db1929f218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:42.239738 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118f209-60ea-4726-8b84-67db1929f218 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:42.240026 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118f209-60ea-4726-8b84-67db1929f218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:42.240333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118f209-60ea-4726-8b84-67db1929f218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:42.241146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118f209-60ea-4726-8b84-67db1929f218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:42.242948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118f209-60ea-4726-8b84-67db1929f218 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:42.247997 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1096/2187] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:02:42.263549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1092/2188] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:02:42.264928 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e56423-2fec-4f1d-9b14-de9c66447b0d service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:42.271192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:42.276467 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e56423-2fec-4f1d-9b14-de9c66447b0d service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:42.286730 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06dd600-dfd7-46f3-9ea0-01581719801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:42.287780 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dd600-dfd7-46f3-9ea0-01581719801d admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:42.288216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dd600-dfd7-46f3-9ea0-01581719801d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:42.288717 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dd600-dfd7-46f3-9ea0-01581719801d admin admin] PATH_INFO: `/v3/projects/c70769e93a6b4deeacf0afd2d78e7d5e/users/92264b8539e34728a007cce0ca302522/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:42.310831 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06dd600-dfd7-46f3-9ea0-01581719801d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70769e93a6b4deeacf0afd2d78e7d5e, user_id=92264b8539e34728a007cce0ca302522, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:42.313720 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06dd600-dfd7-46f3-9ea0-01581719801d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:42.328698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1097/2189] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:42 2022] PUT /identity/v3/projects/c70769e93a6b4deeacf0afd2d78e7d5e/users/92264b8539e34728a007cce0ca302522/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:42.340661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3154910-a6dd-4233-aaf9-8911ee67e4e6 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:42.341506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3154910-a6dd-4233-aaf9-8911ee67e4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:42.341798 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3154910-a6dd-4233-aaf9-8911ee67e4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:42.374449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b3154910-a6dd-4233-aaf9-8911ee67e4e6 None None] MFA Rules not processed for user `92264b8539e34728a007cce0ca302522`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:42.375670 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b3154910-a6dd-4233-aaf9-8911ee67e4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:42.471010 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1093/2190] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:42.488681 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06dd600-dfd7-46f3-9ea0-01581719801d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:42.490480 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a06dd600-dfd7-46f3-9ea0-01581719801d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:42.556788 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06dd600-dfd7-46f3-9ea0-01581719801d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:42.560732 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b49a4-87e3-4f9b-a8b5-db6e09e8947d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:42.561388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b49a4-87e3-4f9b-a8b5-db6e09e8947d service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:42.561675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b49a4-87e3-4f9b-a8b5-db6e09e8947d service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:42.561984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b49a4-87e3-4f9b-a8b5-db6e09e8947d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:42.581307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b49a4-87e3-4f9b-a8b5-db6e09e8947d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:42.586512 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b49a4-87e3-4f9b-a8b5-db6e09e8947d service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:42.595037 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3154910-a6dd-4233-aaf9-8911ee67e4e6 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:42.597355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b3154910-a6dd-4233-aaf9-8911ee67e4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:42.610509 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1098/2191] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:42.643964 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b49a4-87e3-4f9b-a8b5-db6e09e8947d service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:42.725589 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b49a4-87e3-4f9b-a8b5-db6e09e8947d service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:42.733147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac1c08-1690-4a3f-8a8d-4d3293c30d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:42.734071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac1c08-1690-4a3f-8a8d-4d3293c30d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:42.734459 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac1c08-1690-4a3f-8a8d-4d3293c30d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:42.734751 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac1c08-1690-4a3f-8a8d-4d3293c30d10 admin admin] PATH_INFO: `/v3/users/92264b8539e34728a007cce0ca302522` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:42.736016 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac1c08-1690-4a3f-8a8d-4d3293c30d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92264b8539e34728a007cce0ca302522)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:42.738527 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac1c08-1690-4a3f-8a8d-4d3293c30d10 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:42.746263 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3154910-a6dd-4233-aaf9-8911ee67e4e6 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:42.787411 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f76c0e-507e-4c32-9119-a028d64efc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:42.791899 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f76c0e-507e-4c32-9119-a028d64efc58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:42.792478 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f76c0e-507e-4c32-9119-a028d64efc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:42.792858 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f76c0e-507e-4c32-9119-a028d64efc58 admin admin] PATH_INFO: `/v3/projects/beb35681b4a8402d9e96f50ec5085c29` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:42.795395 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d8ac1c08-1690-4a3f-8a8d-4d3293c30d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92264b8539e34728a007cce0ca302522'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:42.795537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f76c0e-507e-4c32-9119-a028d64efc58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb35681b4a8402d9e96f50ec5085c29)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:42.803858 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d8ac1c08-1690-4a3f-8a8d-4d3293c30d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92264b8539e34728a007cce0ca302522'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:42.804590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d8ac1c08-1690-4a3f-8a8d-4d3293c30d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92264b8539e34728a007cce0ca302522'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:42.807893 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f76c0e-507e-4c32-9119-a028d64efc58 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:42.817317 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d8ac1c08-1690-4a3f-8a8d-4d3293c30d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92264b8539e34728a007cce0ca302522'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:42.819306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d8ac1c08-1690-4a3f-8a8d-4d3293c30d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92264b8539e34728a007cce0ca302522'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:42.849479 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1099/2192] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:42 2022] DELETE /identity/v3/users/92264b8539e34728a007cce0ca302522 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:42.855209 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab991f-a38e-499b-8ed5-906c9b44add2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:42.855413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab991f-a38e-499b-8ed5-906c9b44add2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:42.855738 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab991f-a38e-499b-8ed5-906c9b44add2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:42.862420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:42.875651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-09f76c0e-507e-4c32-9119-a028d64efc58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb35681b4a8402d9e96f50ec5085c29', 'request_id': 'req-09f76c0e-507e-4c32-9119-a028d64efc58'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:42.877709 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-7dab991f-a38e-499b-8ed5-906c9b44add2 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:42.880994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7dab991f-a38e-499b-8ed5-906c9b44add2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:42.883733 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-09f76c0e-507e-4c32-9119-a028d64efc58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb35681b4a8402d9e96f50ec5085c29', 'request_id': 'req-09f76c0e-507e-4c32-9119-a028d64efc58'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:42.889847 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:42.891601 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-09f76c0e-507e-4c32-9119-a028d64efc58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb35681b4a8402d9e96f50ec5085c29', 'request_id': 'req-09f76c0e-507e-4c32-9119-a028d64efc58'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:42.910877 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-09f76c0e-507e-4c32-9119-a028d64efc58 admin admin] The token cache is being invalidate because project beb35681b4a8402d9e96f50ec5085c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:42.911265 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-09f76c0e-507e-4c32-9119-a028d64efc58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:42.912472 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-09f76c0e-507e-4c32-9119-a028d64efc58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:42.914510 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1094/2193] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:42 2022] DELETE /identity/v3/projects/beb35681b4a8402d9e96f50ec5085c29 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:42.918115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f76c0e-507e-4c32-9119-a028d64efc58 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:42.920069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-09f76c0e-507e-4c32-9119-a028d64efc58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:42.988465 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1100/2194] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:42.998228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab991f-a38e-499b-8ed5-906c9b44add2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:42.999825 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7dab991f-a38e-499b-8ed5-906c9b44add2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:43.001450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f76c0e-507e-4c32-9119-a028d64efc58 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:43.007088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f626a-350d-4ee2-b898-5ac67075d75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:43.008340 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f626a-350d-4ee2-b898-5ac67075d75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:43.008639 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f626a-350d-4ee2-b898-5ac67075d75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:43.009283 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f626a-350d-4ee2-b898-5ac67075d75f admin admin] PATH_INFO: `/v3/users/fbf03a1c72e0457f88aa77038edd8c2f` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:43.010532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f626a-350d-4ee2-b898-5ac67075d75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf03a1c72e0457f88aa77038edd8c2f)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:43.013129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f626a-350d-4ee2-b898-5ac67075d75f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:43.067788 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab991f-a38e-499b-8ed5-906c9b44add2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:43.071610 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95b4d4-8c67-4369-a558-3a4ae4a54959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:43.072330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95b4d4-8c67-4369-a558-3a4ae4a54959 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:43.072676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95b4d4-8c67-4369-a558-3a4ae4a54959 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:43.073152 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95b4d4-8c67-4369-a558-3a4ae4a54959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:43.078510 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bd5f626a-350d-4ee2-b898-5ac67075d75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf03a1c72e0457f88aa77038edd8c2f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.083670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95b4d4-8c67-4369-a558-3a4ae4a54959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:43.085174 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95b4d4-8c67-4369-a558-3a4ae4a54959 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:43.085848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bd5f626a-350d-4ee2-b898-5ac67075d75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf03a1c72e0457f88aa77038edd8c2f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.094107 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bd5f626a-350d-4ee2-b898-5ac67075d75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf03a1c72e0457f88aa77038edd8c2f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.095128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bd5f626a-350d-4ee2-b898-5ac67075d75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf03a1c72e0457f88aa77038edd8c2f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.095839 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bd5f626a-350d-4ee2-b898-5ac67075d75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf03a1c72e0457f88aa77038edd8c2f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.096514 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1101/2195] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:43.118801 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1095/2196] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:42 2022] DELETE /identity/v3/users/fbf03a1c72e0457f88aa77038edd8c2f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:43.467569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95b4d4-8c67-4369-a558-3a4ae4a54959 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:43.485066 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95b4d4-8c67-4369-a558-3a4ae4a54959 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:43.506913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f626a-350d-4ee2-b898-5ac67075d75f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:43.508428 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bd5f626a-350d-4ee2-b898-5ac67075d75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:43.554609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:43.555469 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:43.555751 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:43.556213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe admin admin] PATH_INFO: `/v3/projects/8431b8cdb5c34ed7bb46dcd760f9233d` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:43.557490 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8431b8cdb5c34ed7bb46dcd760f9233d)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:43.559413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:43.577248 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f626a-350d-4ee2-b898-5ac67075d75f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:43.582435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b2dc7-e879-4acf-aa2c-9d1b7b184fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:43.583286 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b2dc7-e879-4acf-aa2c-9d1b7b184fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:43.583560 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b2dc7-e879-4acf-aa2c-9d1b7b184fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:43.583831 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b2dc7-e879-4acf-aa2c-9d1b7b184fcb admin admin] PATH_INFO: `/v3/projects/c70769e93a6b4deeacf0afd2d78e7d5e` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:43.585261 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b2dc7-e879-4acf-aa2c-9d1b7b184fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c70769e93a6b4deeacf0afd2d78e7d5e)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:43.588454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b2dc7-e879-4acf-aa2c-9d1b7b184fcb admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:43.600199 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:43.608032 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:43.609315 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8431b8cdb5c34ed7bb46dcd760f9233d', 'request_id': 'req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.615937 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8431b8cdb5c34ed7bb46dcd760f9233d', 'request_id': 'req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.622789 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8431b8cdb5c34ed7bb46dcd760f9233d', 'request_id': 'req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.635635 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe admin admin] The token cache is being invalidate because project 8431b8cdb5c34ed7bb46dcd760f9233d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:43.635918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.636532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.638189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1102/2197] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:43 2022] DELETE /identity/v3/projects/8431b8cdb5c34ed7bb46dcd760f9233d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:43.639941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-511b2dc7-e879-4acf-aa2c-9d1b7b184fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c70769e93a6b4deeacf0afd2d78e7d5e', 'request_id': 'req-511b2dc7-e879-4acf-aa2c-9d1b7b184fcb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.642620 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:43.644531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:43.648063 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-511b2dc7-e879-4acf-aa2c-9d1b7b184fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c70769e93a6b4deeacf0afd2d78e7d5e', 'request_id': 'req-511b2dc7-e879-4acf-aa2c-9d1b7b184fcb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.653805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-511b2dc7-e879-4acf-aa2c-9d1b7b184fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c70769e93a6b4deeacf0afd2d78e7d5e', 'request_id': 'req-511b2dc7-e879-4acf-aa2c-9d1b7b184fcb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.667150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-511b2dc7-e879-4acf-aa2c-9d1b7b184fcb admin admin] The token cache is being invalidate because project c70769e93a6b4deeacf0afd2d78e7d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:43.667434 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-511b2dc7-e879-4acf-aa2c-9d1b7b184fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.668049 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-511b2dc7-e879-4acf-aa2c-9d1b7b184fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.669682 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1096/2198] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:43 2022] DELETE /identity/v3/projects/c70769e93a6b4deeacf0afd2d78e7d5e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:43.674542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc1f5e-45f1-4cbd-85c1-1ce74377d52d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:43.674883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc1f5e-45f1-4cbd-85c1-1ce74377d52d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:43.675166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc1f5e-45f1-4cbd-85c1-1ce74377d52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:43.694491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e6bc1f5e-45f1-4cbd-85c1-1ce74377d52d None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:43.695673 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e6bc1f5e-45f1-4cbd-85c1-1ce74377d52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:43.709407 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1797b7-ed2e-4fcd-ab63-51b4e98e9bbe admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:43.755625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1097/2199] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:43.763131 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a69c3d-4f3b-4aa7-9a36-e4ba34445aa0 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:43.763545 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a69c3d-4f3b-4aa7-9a36-e4ba34445aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:43.763833 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a69c3d-4f3b-4aa7-9a36-e4ba34445aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:43.764901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba69fc-3842-4341-95ec-5ae78b9b7d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:43.765772 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba69fc-3842-4341-95ec-5ae78b9b7d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:43.766101 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba69fc-3842-4341-95ec-5ae78b9b7d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:43.766380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba69fc-3842-4341-95ec-5ae78b9b7d23 admin admin] PATH_INFO: `/v3/users/0c03d0f79513466190e76e9cef810772` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:43.767578 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba69fc-3842-4341-95ec-5ae78b9b7d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c03d0f79513466190e76e9cef810772)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:43.770096 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba69fc-3842-4341-95ec-5ae78b9b7d23 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:43.782089 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-53a69c3d-4f3b-4aa7-9a36-e4ba34445aa0 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:43.783283 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-53a69c3d-4f3b-4aa7-9a36-e4ba34445aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:43.791451 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1098/2200] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:43.795391 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a69c3d-4f3b-4aa7-9a36-e4ba34445aa0 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:43.804952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a69c3d-4f3b-4aa7-9a36-e4ba34445aa0 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:43.809962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e98e2-99dc-4b17-814e-3658ca2aabf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:43.810613 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e98e2-99dc-4b17-814e-3658ca2aabf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:43.810867 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e98e2-99dc-4b17-814e-3658ca2aabf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:43.811143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e98e2-99dc-4b17-814e-3658ca2aabf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:43.811866 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e98e2-99dc-4b17-814e-3658ca2aabf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:43.812176 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e98e2-99dc-4b17-814e-3658ca2aabf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:43.813749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e98e2-99dc-4b17-814e-3658ca2aabf6 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:43.820529 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-42ba69fc-3842-4341-95ec-5ae78b9b7d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c03d0f79513466190e76e9cef810772'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.826442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1099/2201] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 22:02:43.831419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e98e2-99dc-4b17-814e-3658ca2aabf6 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:43.831776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-42ba69fc-3842-4341-95ec-5ae78b9b7d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c03d0f79513466190e76e9cef810772'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.832503 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-42ba69fc-3842-4341-95ec-5ae78b9b7d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c03d0f79513466190e76e9cef810772'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.840416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-42ba69fc-3842-4341-95ec-5ae78b9b7d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c03d0f79513466190e76e9cef810772'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.841212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-42ba69fc-3842-4341-95ec-5ae78b9b7d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c03d0f79513466190e76e9cef810772'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:43.843058 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e98e2-99dc-4b17-814e-3658ca2aabf6 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:43.849150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad501eb8-6526-481f-bae1-f471be4a6233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:43.849803 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad501eb8-6526-481f-bae1-f471be4a6233 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:43.850259 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad501eb8-6526-481f-bae1-f471be4a6233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:43.850552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad501eb8-6526-481f-bae1-f471be4a6233 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:43.861233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad501eb8-6526-481f-bae1-f471be4a6233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:43.861233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad501eb8-6526-481f-bae1-f471be4a6233 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:43.861444 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1103/2202] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:43 2022] DELETE /identity/v3/users/0c03d0f79513466190e76e9cef810772 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:43.889555 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1100/2203] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:43 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:02:43.894088 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba69fc-3842-4341-95ec-5ae78b9b7d23 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:43.895472 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-42ba69fc-3842-4341-95ec-5ae78b9b7d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:43.900746 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:43.990770 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba69fc-3842-4341-95ec-5ae78b9b7d23 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:44.064664 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad501eb8-6526-481f-bae1-f471be4a6233 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:44.067255 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ad501eb8-6526-481f-bae1-f471be4a6233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:44.071546 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b823a9a-2adf-47b0-a6e3-815504d1f7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:44.073173 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b823a9a-2adf-47b0-a6e3-815504d1f7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:44.073619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b823a9a-2adf-47b0-a6e3-815504d1f7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:44.074338 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b823a9a-2adf-47b0-a6e3-815504d1f7c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:44.075819 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b823a9a-2adf-47b0-a6e3-815504d1f7c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:44.078215 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b823a9a-2adf-47b0-a6e3-815504d1f7c3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:44.087256 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad501eb8-6526-481f-bae1-f471be4a6233 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:44.093778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470440b6-3117-4cfc-8b8b-0f3d8da6e930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:44.094899 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470440b6-3117-4cfc-8b8b-0f3d8da6e930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:44.095180 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470440b6-3117-4cfc-8b8b-0f3d8da6e930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:44.095455 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470440b6-3117-4cfc-8b8b-0f3d8da6e930 admin admin] PATH_INFO: `/v3/users/a704b53ec07e4fefb6c208b8291fe12f` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:44.098299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470440b6-3117-4cfc-8b8b-0f3d8da6e930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a704b53ec07e4fefb6c208b8291fe12f)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:44.100710 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470440b6-3117-4cfc-8b8b-0f3d8da6e930 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:44.107955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1104/2204] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:43 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:44.112281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b823a9a-2adf-47b0-a6e3-815504d1f7c3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:44.138733 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b823a9a-2adf-47b0-a6e3-815504d1f7c3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:44.150975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ca915-521b-4991-bf34-8188c474022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:44.152152 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca915-521b-4991-bf34-8188c474022e admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:44.153036 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca915-521b-4991-bf34-8188c474022e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:44.153476 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca915-521b-4991-bf34-8188c474022e admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:44.154900 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ca915-521b-4991-bf34-8188c474022e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:44.157245 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ca915-521b-4991-bf34-8188c474022e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:44.174156 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1105/2205] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:44.178350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ca915-521b-4991-bf34-8188c474022e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:44.180072 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-470440b6-3117-4cfc-8b8b-0f3d8da6e930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a704b53ec07e4fefb6c208b8291fe12f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:44.188115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:44.193073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ca915-521b-4991-bf34-8188c474022e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:44.194031 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-470440b6-3117-4cfc-8b8b-0f3d8da6e930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a704b53ec07e4fefb6c208b8291fe12f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:44.200721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41426a62-7d9a-46ab-a831-beb5871c3fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:44.201518 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41426a62-7d9a-46ab-a831-beb5871c3fbe admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:44.201874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41426a62-7d9a-46ab-a831-beb5871c3fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:44.202254 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41426a62-7d9a-46ab-a831-beb5871c3fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:44.203063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41426a62-7d9a-46ab-a831-beb5871c3fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:44.204762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41426a62-7d9a-46ab-a831-beb5871c3fbe admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:44.205109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-470440b6-3117-4cfc-8b8b-0f3d8da6e930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a704b53ec07e4fefb6c208b8291fe12f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:44.207111 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-470440b6-3117-4cfc-8b8b-0f3d8da6e930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a704b53ec07e4fefb6c208b8291fe12f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:44.208253 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-470440b6-3117-4cfc-8b8b-0f3d8da6e930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a704b53ec07e4fefb6c208b8291fe12f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:44.222889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1106/2206] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:44.227489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41426a62-7d9a-46ab-a831-beb5871c3fbe admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:44.229696 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-41426a62-7d9a-46ab-a831-beb5871c3fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:44.248257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1101/2207] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:44 2022] DELETE /identity/v3/users/a704b53ec07e4fefb6c208b8291fe12f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:44.251533 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79e0ff-07b2-4c50-afa7-98859c6ea9e8 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:44.251825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79e0ff-07b2-4c50-afa7-98859c6ea9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:44.252122 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79e0ff-07b2-4c50-afa7-98859c6ea9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:44.255461 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41426a62-7d9a-46ab-a831-beb5871c3fbe admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:44.301267 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-de79e0ff-07b2-4c50-afa7-98859c6ea9e8 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:44.302525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-de79e0ff-07b2-4c50-afa7-98859c6ea9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:44.380646 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb538a19-ee79-48e9-a8b5-fb47aa5a3b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:44.381970 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb538a19-ee79-48e9-a8b5-fb47aa5a3b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:44.382635 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb538a19-ee79-48e9-a8b5-fb47aa5a3b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:44.382920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb538a19-ee79-48e9-a8b5-fb47aa5a3b34 admin admin] PATH_INFO: `/v3/projects/e21763482c564c5d865102b74d6c8025/users/6324975b68f44a06a964bd96aa0664f0/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:44.401765 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb538a19-ee79-48e9-a8b5-fb47aa5a3b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21763482c564c5d865102b74d6c8025, user_id=6324975b68f44a06a964bd96aa0664f0, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:44.404664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb538a19-ee79-48e9-a8b5-fb47aa5a3b34 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:44.406741 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1102/2208] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:44.407906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79e0ff-07b2-4c50-afa7-98859c6ea9e8 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:44.410265 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-de79e0ff-07b2-4c50-afa7-98859c6ea9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:44.420805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:44.426748 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1107/2209] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:44 2022] PUT /identity/v3/projects/e21763482c564c5d865102b74d6c8025/users/6324975b68f44a06a964bd96aa0664f0/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:44.428219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb538a19-ee79-48e9-a8b5-fb47aa5a3b34 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:44.429371 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79e0ff-07b2-4c50-afa7-98859c6ea9e8 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:44.430249 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-eb538a19-ee79-48e9-a8b5-fb47aa5a3b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:44.496149 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb538a19-ee79-48e9-a8b5-fb47aa5a3b34 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:44.497959 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c15fc5-a6f4-4a8d-92da-889e99a96e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:44.498852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c15fc5-a6f4-4a8d-92da-889e99a96e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:44.499182 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c15fc5-a6f4-4a8d-92da-889e99a96e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:44.499461 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c15fc5-a6f4-4a8d-92da-889e99a96e33 admin admin] PATH_INFO: `/v3/projects/5de7fa97604c4ba1be4244b012ac3bba` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:44.500013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231c599-6afb-4677-8fc0-8516041ea486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:44.500640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c15fc5-a6f4-4a8d-92da-889e99a96e33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de7fa97604c4ba1be4244b012ac3bba)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:44.500760 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231c599-6afb-4677-8fc0-8516041ea486 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:44.501275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231c599-6afb-4677-8fc0-8516041ea486 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:44.501669 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231c599-6afb-4677-8fc0-8516041ea486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:44.503130 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c15fc5-a6f4-4a8d-92da-889e99a96e33 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:44.513286 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231c599-6afb-4677-8fc0-8516041ea486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:44.513846 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231c599-6afb-4677-8fc0-8516041ea486 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:44.525382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1108/2210] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:44.526676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b18ede-64ed-455d-a820-af9426f968df None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:44.526968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b18ede-64ed-455d-a820-af9426f968df None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:44.527243 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b18ede-64ed-455d-a820-af9426f968df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:44.547018 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-50b18ede-64ed-455d-a820-af9426f968df None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:44.548722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-50b18ede-64ed-455d-a820-af9426f968df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:44.558665 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1109/2211] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:44.570715 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b18ede-64ed-455d-a820-af9426f968df None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:44.572564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-50b18ede-64ed-455d-a820-af9426f968df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:44.583346 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-18c15fc5-a6f4-4a8d-92da-889e99a96e33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de7fa97604c4ba1be4244b012ac3bba', 'request_id': 'req-18c15fc5-a6f4-4a8d-92da-889e99a96e33'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:44.588429 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b18ede-64ed-455d-a820-af9426f968df None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:44.591976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-18c15fc5-a6f4-4a8d-92da-889e99a96e33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de7fa97604c4ba1be4244b012ac3bba', 'request_id': 'req-18c15fc5-a6f4-4a8d-92da-889e99a96e33'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:44.599420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-18c15fc5-a6f4-4a8d-92da-889e99a96e33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de7fa97604c4ba1be4244b012ac3bba', 'request_id': 'req-18c15fc5-a6f4-4a8d-92da-889e99a96e33'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:44.617714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:44.624678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-18c15fc5-a6f4-4a8d-92da-889e99a96e33 admin admin] The token cache is being invalidate because project 5de7fa97604c4ba1be4244b012ac3bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:44.624678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-18c15fc5-a6f4-4a8d-92da-889e99a96e33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:44.628652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-18c15fc5-a6f4-4a8d-92da-889e99a96e33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:44.632335 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1103/2212] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:44 2022] DELETE /identity/v3/projects/5de7fa97604c4ba1be4244b012ac3bba => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:44.639074 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04002f3e-a62a-41f6-b47b-9f26b2c3ea1f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:44.639475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04002f3e-a62a-41f6-b47b-9f26b2c3ea1f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:44.639676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04002f3e-a62a-41f6-b47b-9f26b2c3ea1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:44.658572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f3adc-b8b0-4114-890d-982f2b936d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:44.659968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f3adc-b8b0-4114-890d-982f2b936d20 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:44.659968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f3adc-b8b0-4114-890d-982f2b936d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:44.660427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f3adc-b8b0-4114-890d-982f2b936d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:44.663597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-408f3adc-b8b0-4114-890d-982f2b936d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:44.675371 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-04002f3e-a62a-41f6-b47b-9f26b2c3ea1f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:44.676691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-04002f3e-a62a-41f6-b47b-9f26b2c3ea1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:44.769299 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f3adc-b8b0-4114-890d-982f2b936d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:44.776482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1104/2213] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:44.776690 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f3adc-b8b0-4114-890d-982f2b936d20 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:44.778357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cde678-085d-4457-a38e-f30b228a3646 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:44.778757 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cde678-085d-4457-a38e-f30b228a3646 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:44.779188 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cde678-085d-4457-a38e-f30b228a3646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:44.784243 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1110/2214] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:02:44.798495 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c3cde678-085d-4457-a38e-f30b228a3646 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:44.800298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c3cde678-085d-4457-a38e-f30b228a3646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:44.808179 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1105/2215] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:44.812574 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f3adc-b8b0-4114-890d-982f2b936d20 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:44.822931 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f3adc-b8b0-4114-890d-982f2b936d20 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:44.827684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698f2aa-a10b-4bc6-92fe-b7c384066a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:44.828344 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f2aa-a10b-4bc6-92fe-b7c384066a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:44.828626 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f2aa-a10b-4bc6-92fe-b7c384066a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:44.828901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f2aa-a10b-4bc6-92fe-b7c384066a0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:44.829625 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698f2aa-a10b-4bc6-92fe-b7c384066a0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:44.829960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698f2aa-a10b-4bc6-92fe-b7c384066a0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:44.832120 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698f2aa-a10b-4bc6-92fe-b7c384066a0c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:44.844670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1111/2216] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 22:02:44.849284 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cde678-085d-4457-a38e-f30b228a3646 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:44.858881 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cde678-085d-4457-a38e-f30b228a3646 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:44.864143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a829b2-daa1-41d4-af03-a34793aa6b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:44.864799 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a829b2-daa1-41d4-af03-a34793aa6b82 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:44.865097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a829b2-daa1-41d4-af03-a34793aa6b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:44.865356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a829b2-daa1-41d4-af03-a34793aa6b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:44.866147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a829b2-daa1-41d4-af03-a34793aa6b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:44.868079 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a829b2-daa1-41d4-af03-a34793aa6b82 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:44.899125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1106/2217] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:44 2022] POST /identity/v3/projects => generated 395 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:02:44.900240 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698f2aa-a10b-4bc6-92fe-b7c384066a0c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:44.910970 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698f2aa-a10b-4bc6-92fe-b7c384066a0c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:44.941036 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:44.971148 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96832e5-8b5a-4ac9-82ab-0f95a4ced9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:44.972444 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96832e5-8b5a-4ac9-82ab-0f95a4ced9cd admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:44.972737 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96832e5-8b5a-4ac9-82ab-0f95a4ced9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:44.973004 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96832e5-8b5a-4ac9-82ab-0f95a4ced9cd admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:44.973703 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96832e5-8b5a-4ac9-82ab-0f95a4ced9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:44.975678 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96832e5-8b5a-4ac9-82ab-0f95a4ced9cd admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:44.997592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1112/2218] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:44 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:02:45.001739 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a829b2-daa1-41d4-af03-a34793aa6b82 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:45.012338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a829b2-daa1-41d4-af03-a34793aa6b82 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:45.017118 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af769b1f-e9fa-476f-9af0-7bef94e9d045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:45.017779 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af769b1f-e9fa-476f-9af0-7bef94e9d045 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:45.018091 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af769b1f-e9fa-476f-9af0-7bef94e9d045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:45.018898 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af769b1f-e9fa-476f-9af0-7bef94e9d045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:45.019621 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af769b1f-e9fa-476f-9af0-7bef94e9d045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:45.021220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af769b1f-e9fa-476f-9af0-7bef94e9d045 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:45.034530 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1107/2219] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:45.039031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96832e5-8b5a-4ac9-82ab-0f95a4ced9cd admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:45.050656 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96832e5-8b5a-4ac9-82ab-0f95a4ced9cd admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:45.055820 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc5560-4b68-4d25-9cd0-7cc3df4719b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:45.056573 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc5560-4b68-4d25-9cd0-7cc3df4719b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:45.056891 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc5560-4b68-4d25-9cd0-7cc3df4719b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:45.057168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc5560-4b68-4d25-9cd0-7cc3df4719b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:45.057951 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc5560-4b68-4d25-9cd0-7cc3df4719b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:45.059697 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc5560-4b68-4d25-9cd0-7cc3df4719b8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:45.070080 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1113/2220] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:45.074242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af769b1f-e9fa-476f-9af0-7bef94e9d045 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:45.085328 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af769b1f-e9fa-476f-9af0-7bef94e9d045 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:45.087531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc5560-4b68-4d25-9cd0-7cc3df4719b8 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:45.089883 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-bfdc5560-4b68-4d25-9cd0-7cc3df4719b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:45.090714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54585604-87d7-4907-8dbe-d4324a6a6abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:45.091611 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54585604-87d7-4907-8dbe-d4324a6a6abf admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:45.091900 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54585604-87d7-4907-8dbe-d4324a6a6abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:45.092661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54585604-87d7-4907-8dbe-d4324a6a6abf admin admin] PATH_INFO: `/v3/projects/770e55d51b614d54a07928c0b5afb58e/users/a32abb99c0fc4c0e948c478fc5494ca3/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:45.104873 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc5560-4b68-4d25-9cd0-7cc3df4719b8 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:45.109220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54585604-87d7-4907-8dbe-d4324a6a6abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=770e55d51b614d54a07928c0b5afb58e, user_id=a32abb99c0fc4c0e948c478fc5494ca3, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:45.111849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d0798-ae46-49cf-b902-1bd4e3796444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:45.111988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54585604-87d7-4907-8dbe-d4324a6a6abf admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:45.112857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d0798-ae46-49cf-b902-1bd4e3796444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:45.113210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d0798-ae46-49cf-b902-1bd4e3796444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:45.113694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d0798-ae46-49cf-b902-1bd4e3796444 admin admin] PATH_INFO: `/v3/projects/8d20f02ef24645b792d6c17db3e180dd` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:45.115351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d0798-ae46-49cf-b902-1bd4e3796444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d20f02ef24645b792d6c17db3e180dd)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:45.117556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d0798-ae46-49cf-b902-1bd4e3796444 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:45.154687 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1108/2221] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:45 2022] PUT /identity/v3/projects/770e55d51b614d54a07928c0b5afb58e/users/a32abb99c0fc4c0e948c478fc5494ca3/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:45.157247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d01e1-cf2d-4c3e-a3de-401ffca8e0aa None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:45.157721 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d01e1-cf2d-4c3e-a3de-401ffca8e0aa None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:45.158725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d01e1-cf2d-4c3e-a3de-401ffca8e0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:45.200924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-6f5d01e1-cf2d-4c3e-a3de-401ffca8e0aa None None] MFA Rules not processed for user `a32abb99c0fc4c0e948c478fc5494ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:45.202216 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6f5d01e1-cf2d-4c3e-a3de-401ffca8e0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:45.202385 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-807d0798-ae46-49cf-b902-1bd4e3796444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d20f02ef24645b792d6c17db3e180dd', 'request_id': 'req-807d0798-ae46-49cf-b902-1bd4e3796444'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:45.209692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-807d0798-ae46-49cf-b902-1bd4e3796444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d20f02ef24645b792d6c17db3e180dd', 'request_id': 'req-807d0798-ae46-49cf-b902-1bd4e3796444'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:45.217351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-807d0798-ae46-49cf-b902-1bd4e3796444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d20f02ef24645b792d6c17db3e180dd', 'request_id': 'req-807d0798-ae46-49cf-b902-1bd4e3796444'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:45.236438 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-807d0798-ae46-49cf-b902-1bd4e3796444 admin admin] The token cache is being invalidate because project 8d20f02ef24645b792d6c17db3e180dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:45.236821 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-807d0798-ae46-49cf-b902-1bd4e3796444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:45.237548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-807d0798-ae46-49cf-b902-1bd4e3796444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:45.239847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1114/2222] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:45 2022] DELETE /identity/v3/projects/8d20f02ef24645b792d6c17db3e180dd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:45.244049 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d0798-ae46-49cf-b902-1bd4e3796444 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:45.245455 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-807d0798-ae46-49cf-b902-1bd4e3796444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:45.297984 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1109/2223] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:45.310288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d01e1-cf2d-4c3e-a3de-401ffca8e0aa None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:45.311720 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6f5d01e1-cf2d-4c3e-a3de-401ffca8e0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:45.334838 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d0798-ae46-49cf-b902-1bd4e3796444 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:45.340333 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9782d8e-46c9-48b0-9557-9fcaf7910d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:45.341293 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9782d8e-46c9-48b0-9557-9fcaf7910d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:45.341655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9782d8e-46c9-48b0-9557-9fcaf7910d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:45.342024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9782d8e-46c9-48b0-9557-9fcaf7910d7d admin admin] PATH_INFO: `/v3/users/aaaab1d1edb04d9886c75fa0db223495` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:45.343649 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9782d8e-46c9-48b0-9557-9fcaf7910d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaaab1d1edb04d9886c75fa0db223495)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:45.345379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9782d8e-46c9-48b0-9557-9fcaf7910d7d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:45.348352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:45.415496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:45.426708 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d01e1-cf2d-4c3e-a3de-401ffca8e0aa None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:45.434153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b9782d8e-46c9-48b0-9557-9fcaf7910d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaaab1d1edb04d9886c75fa0db223495'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:45.445999 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b0847-e5e2-4ba5-aaa3-86d610c740df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:45.448479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b0847-e5e2-4ba5-aaa3-86d610c740df service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:45.449535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b0847-e5e2-4ba5-aaa3-86d610c740df service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:45.450029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b0847-e5e2-4ba5-aaa3-86d610c740df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:45.451980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b9782d8e-46c9-48b0-9557-9fcaf7910d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaaab1d1edb04d9886c75fa0db223495'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:45.453253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b9782d8e-46c9-48b0-9557-9fcaf7910d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaaab1d1edb04d9886c75fa0db223495'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:45.464627 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b9782d8e-46c9-48b0-9557-9fcaf7910d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaaab1d1edb04d9886c75fa0db223495'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:45.465641 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b9782d8e-46c9-48b0-9557-9fcaf7910d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaaab1d1edb04d9886c75fa0db223495'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:45.467742 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b0847-e5e2-4ba5-aaa3-86d610c740df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:45.469324 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b0847-e5e2-4ba5-aaa3-86d610c740df service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:45.481076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1110/2224] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:02:45.489964 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1115/2225] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:45 2022] DELETE /identity/v3/users/aaaab1d1edb04d9886c75fa0db223495 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:46.144503 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b0847-e5e2-4ba5-aaa3-86d610c740df service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:46.160353 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b0847-e5e2-4ba5-aaa3-86d610c740df service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:46.290262 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70a62a-8f3a-470a-9ece-5af1b8739cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:46.291785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70a62a-8f3a-470a-9ece-5af1b8739cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:46.292209 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70a62a-8f3a-470a-9ece-5af1b8739cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:46.292862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70a62a-8f3a-470a-9ece-5af1b8739cd2 admin admin] PATH_INFO: `/v3/projects/c41eb570de4f400da983de0593658575` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:46.294346 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70a62a-8f3a-470a-9ece-5af1b8739cd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c41eb570de4f400da983de0593658575)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:46.297240 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70a62a-8f3a-470a-9ece-5af1b8739cd2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:46.348642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3e70a62a-8f3a-470a-9ece-5af1b8739cd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c41eb570de4f400da983de0593658575', 'request_id': 'req-3e70a62a-8f3a-470a-9ece-5af1b8739cd2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:46.355228 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3e70a62a-8f3a-470a-9ece-5af1b8739cd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c41eb570de4f400da983de0593658575', 'request_id': 'req-3e70a62a-8f3a-470a-9ece-5af1b8739cd2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:46.362660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3e70a62a-8f3a-470a-9ece-5af1b8739cd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c41eb570de4f400da983de0593658575', 'request_id': 'req-3e70a62a-8f3a-470a-9ece-5af1b8739cd2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:46.377812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3e70a62a-8f3a-470a-9ece-5af1b8739cd2 admin admin] The token cache is being invalidate because project c41eb570de4f400da983de0593658575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:46.378213 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3e70a62a-8f3a-470a-9ece-5af1b8739cd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:46.378852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3e70a62a-8f3a-470a-9ece-5af1b8739cd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:46.382183 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1111/2226] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:46 2022] DELETE /identity/v3/projects/c41eb570de4f400da983de0593658575 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:46.386856 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2e9d1-bf03-4bf6-bd3a-bb084b670001 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:46.387679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2e9d1-bf03-4bf6-bd3a-bb084b670001 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:46.387961 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2e9d1-bf03-4bf6-bd3a-bb084b670001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:46.395142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e158b-e318-415c-ad6a-0773164f4cca None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:46.395429 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e158b-e318-415c-ad6a-0773164f4cca None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:46.395702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e158b-e318-415c-ad6a-0773164f4cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:46.416826 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c8d2e9d1-bf03-4bf6-bd3a-bb084b670001 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:46.417902 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c8d2e9d1-bf03-4bf6-bd3a-bb084b670001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:46.437054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-686e158b-e318-415c-ad6a-0773164f4cca None None] MFA Rules not processed for user `6324975b68f44a06a964bd96aa0664f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:46.438571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-686e158b-e318-415c-ad6a-0773164f4cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:46.488446 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1116/2227] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:46.495878 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:46.496819 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7853e-b4f5-4c13-a042-31569f1a05fd None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:46.497120 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7853e-b4f5-4c13-a042-31569f1a05fd None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:46.497409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7853e-b4f5-4c13-a042-31569f1a05fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:46.516992 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1112/2228] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:46.523286 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-71f7853e-b4f5-4c13-a042-31569f1a05fd None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:46.524636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-71f7853e-b4f5-4c13-a042-31569f1a05fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:46.530423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e158b-e318-415c-ad6a-0773164f4cca None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:46.532695 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-686e158b-e318-415c-ad6a-0773164f4cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:46.538807 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1117/2229] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:02:46.541851 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7853e-b4f5-4c13-a042-31569f1a05fd None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:46.563626 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7853e-b4f5-4c13-a042-31569f1a05fd None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:46.567942 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b68c3c-fec0-440e-b2f3-055956d169ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:46.568623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b68c3c-fec0-440e-b2f3-055956d169ac admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:46.568906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b68c3c-fec0-440e-b2f3-055956d169ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:46.569211 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b68c3c-fec0-440e-b2f3-055956d169ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:46.570025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b68c3c-fec0-440e-b2f3-055956d169ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:46.570302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b68c3c-fec0-440e-b2f3-055956d169ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:46.572265 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b68c3c-fec0-440e-b2f3-055956d169ac admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:46.592415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1118/2230] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:02:46.593806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b68c3c-fec0-440e-b2f3-055956d169ac admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:46.608290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b68c3c-fec0-440e-b2f3-055956d169ac admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:46.613964 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3422263-9fd4-4d8d-b9cd-8f1812205b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:46.614530 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422263-9fd4-4d8d-b9cd-8f1812205b9b admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:46.614766 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422263-9fd4-4d8d-b9cd-8f1812205b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:46.615044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422263-9fd4-4d8d-b9cd-8f1812205b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:46.615743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3422263-9fd4-4d8d-b9cd-8f1812205b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:46.617713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3422263-9fd4-4d8d-b9cd-8f1812205b9b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:46.642134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e158b-e318-415c-ad6a-0773164f4cca None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:46.646850 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442b38b-bbc0-46f2-afb8-683ff0f3f040 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:46.647495 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442b38b-bbc0-46f2-afb8-683ff0f3f040 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:46.647785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442b38b-bbc0-46f2-afb8-683ff0f3f040 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:46.648054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442b38b-bbc0-46f2-afb8-683ff0f3f040 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:46.653007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1119/2231] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:46 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:02:46.654063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3422263-9fd4-4d8d-b9cd-8f1812205b9b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:46.661810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442b38b-bbc0-46f2-afb8-683ff0f3f040 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:46.663800 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442b38b-bbc0-46f2-afb8-683ff0f3f040 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:46.676619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1113/2232] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:02:46.724858 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3422263-9fd4-4d8d-b9cd-8f1812205b9b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:46.729693 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0606ad-06a9-4d80-92ba-134a0fc51636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:46.730364 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0606ad-06a9-4d80-92ba-134a0fc51636 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:46.730668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0606ad-06a9-4d80-92ba-134a0fc51636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:46.730948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0606ad-06a9-4d80-92ba-134a0fc51636 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:46.731990 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0606ad-06a9-4d80-92ba-134a0fc51636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:46.735046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0606ad-06a9-4d80-92ba-134a0fc51636 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:46.758547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1120/2233] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:46 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:46.762952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442b38b-bbc0-46f2-afb8-683ff0f3f040 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:46.776062 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442b38b-bbc0-46f2-afb8-683ff0f3f040 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:46.781619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188df61d-79a2-47a8-a384-836dd45ef4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:46.782302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188df61d-79a2-47a8-a384-836dd45ef4bd admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:46.782613 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188df61d-79a2-47a8-a384-836dd45ef4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:46.782884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188df61d-79a2-47a8-a384-836dd45ef4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:46.783596 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188df61d-79a2-47a8-a384-836dd45ef4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:46.785656 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188df61d-79a2-47a8-a384-836dd45ef4bd admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:46.797961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1114/2234] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:46.802258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0606ad-06a9-4d80-92ba-134a0fc51636 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:46.808302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:46.814930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0606ad-06a9-4d80-92ba-134a0fc51636 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:46.832745 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29b0b7-9617-45e7-8553-31093ba2d669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:46.834135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29b0b7-9617-45e7-8553-31093ba2d669 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:46.834598 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29b0b7-9617-45e7-8553-31093ba2d669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:46.835060 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29b0b7-9617-45e7-8553-31093ba2d669 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:46.836204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29b0b7-9617-45e7-8553-31093ba2d669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:46.838567 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29b0b7-9617-45e7-8553-31093ba2d669 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:46.853306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1121/2235] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:46.858565 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188df61d-79a2-47a8-a384-836dd45ef4bd admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:46.871582 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188df61d-79a2-47a8-a384-836dd45ef4bd admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:46.880931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe898-5450-4785-a811-d993e3ea0fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:46.882017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe898-5450-4785-a811-d993e3ea0fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:46.882152 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe898-5450-4785-a811-d993e3ea0fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:46.882416 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe898-5450-4785-a811-d993e3ea0fb1 admin admin] PATH_INFO: `/v3/projects/4879ad79dec54261ab77cc10c1720742/users/b3616db5c2ff48f38a0c438703813cc4/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:46.899489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fe898-5450-4785-a811-d993e3ea0fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4879ad79dec54261ab77cc10c1720742, user_id=b3616db5c2ff48f38a0c438703813cc4, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:46.902187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fe898-5450-4785-a811-d993e3ea0fb1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:46.917526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1115/2236] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:46 2022] PUT /identity/v3/projects/4879ad79dec54261ab77cc10c1720742/users/b3616db5c2ff48f38a0c438703813cc4/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:46.928661 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0095d7d-7b92-40c7-b726-e76ed5caac0c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:46.929029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0095d7d-7b92-40c7-b726-e76ed5caac0c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:46.929343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0095d7d-7b92-40c7-b726-e76ed5caac0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:46.960235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f0095d7d-7b92-40c7-b726-e76ed5caac0c None None] MFA Rules not processed for user `b3616db5c2ff48f38a0c438703813cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:46.961453 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f0095d7d-7b92-40c7-b726-e76ed5caac0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:47.049478 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1122/2237] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:47.053811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe898-5450-4785-a811-d993e3ea0fb1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:47.129207 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe898-5450-4785-a811-d993e3ea0fb1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:47.134051 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dea4c-5347-4361-b11d-ef428f8b935c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:47.134764 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dea4c-5347-4361-b11d-ef428f8b935c admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:47.135282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dea4c-5347-4361-b11d-ef428f8b935c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:47.135553 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dea4c-5347-4361-b11d-ef428f8b935c admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:47.136131 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18dea4c-5347-4361-b11d-ef428f8b935c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:47.138136 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18dea4c-5347-4361-b11d-ef428f8b935c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:47.163921 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1116/2238] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:47 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:02:47.167914 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0095d7d-7b92-40c7-b726-e76ed5caac0c None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:47.181241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0095d7d-7b92-40c7-b726-e76ed5caac0c None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:47.247146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761be9e9-cb12-416c-8d7c-6ac10e18d53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:47.247817 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761be9e9-cb12-416c-8d7c-6ac10e18d53c admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:47.248089 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761be9e9-cb12-416c-8d7c-6ac10e18d53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:47.248363 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761be9e9-cb12-416c-8d7c-6ac10e18d53c admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:47.249152 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761be9e9-cb12-416c-8d7c-6ac10e18d53c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:47.251784 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761be9e9-cb12-416c-8d7c-6ac10e18d53c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:47.274283 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1123/2239] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:47 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:47.278529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dea4c-5347-4361-b11d-ef428f8b935c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:47.289845 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dea4c-5347-4361-b11d-ef428f8b935c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:47.294921 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf05e5-cd33-497b-8b00-635d89c1a3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:47.296176 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf05e5-cd33-497b-8b00-635d89c1a3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:47.296176 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf05e5-cd33-497b-8b00-635d89c1a3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:47.296385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf05e5-cd33-497b-8b00-635d89c1a3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:47.297047 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf05e5-cd33-497b-8b00-635d89c1a3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:47.298688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf05e5-cd33-497b-8b00-635d89c1a3e8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:47.316353 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1117/2240] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:47.317663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761be9e9-cb12-416c-8d7c-6ac10e18d53c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:47.330104 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761be9e9-cb12-416c-8d7c-6ac10e18d53c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:47.337515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36edb4b-c00f-4901-9195-10dc4b18d445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:47.338839 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36edb4b-c00f-4901-9195-10dc4b18d445 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:47.339143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36edb4b-c00f-4901-9195-10dc4b18d445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:47.339554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36edb4b-c00f-4901-9195-10dc4b18d445 admin admin] PATH_INFO: `/v3/projects/0da6c4f25c0440a7b3baa9a8667c3f19/users/3f2bdf8a2edf46a491e7eb123a8ab613/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:47.365241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36edb4b-c00f-4901-9195-10dc4b18d445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da6c4f25c0440a7b3baa9a8667c3f19, user_id=3f2bdf8a2edf46a491e7eb123a8ab613, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:47.372118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36edb4b-c00f-4901-9195-10dc4b18d445 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:47.388711 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1124/2241] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:47 2022] PUT /identity/v3/projects/0da6c4f25c0440a7b3baa9a8667c3f19/users/3f2bdf8a2edf46a491e7eb123a8ab613/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:47.392966 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf05e5-cd33-497b-8b00-635d89c1a3e8 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:47.405012 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf05e5-cd33-497b-8b00-635d89c1a3e8 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:47.435397 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:47.466590 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e63d22-8c33-4145-a8ef-74ca15271210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:47.467269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e63d22-8c33-4145-a8ef-74ca15271210 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:47.467540 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e63d22-8c33-4145-a8ef-74ca15271210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:47.467813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e63d22-8c33-4145-a8ef-74ca15271210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:47.468531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e63d22-8c33-4145-a8ef-74ca15271210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:47.470150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e63d22-8c33-4145-a8ef-74ca15271210 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:47.480970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1118/2242] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:02:47.485396 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36edb4b-c00f-4901-9195-10dc4b18d445 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:47.496348 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36edb4b-c00f-4901-9195-10dc4b18d445 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:47.500871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e77f0d-7b30-41cc-9fe9-6e200b1325b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:47.501838 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e77f0d-7b30-41cc-9fe9-6e200b1325b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:47.502195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e77f0d-7b30-41cc-9fe9-6e200b1325b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:47.502469 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e77f0d-7b30-41cc-9fe9-6e200b1325b2 admin admin] PATH_INFO: `/v3/projects/0da6c4f25c0440a7b3baa9a8667c3f19/users/3f2bdf8a2edf46a491e7eb123a8ab613/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:47.504512 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e77f0d-7b30-41cc-9fe9-6e200b1325b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da6c4f25c0440a7b3baa9a8667c3f19, user_id=3f2bdf8a2edf46a491e7eb123a8ab613, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:47.507266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e77f0d-7b30-41cc-9fe9-6e200b1325b2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:47.517374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1125/2243] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:47 2022] PUT /identity/v3/projects/0da6c4f25c0440a7b3baa9a8667c3f19/users/3f2bdf8a2edf46a491e7eb123a8ab613/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:47.528884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478d4e8-0566-411e-9665-49da96d92c18 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:47.529167 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478d4e8-0566-411e-9665-49da96d92c18 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:47.529452 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478d4e8-0566-411e-9665-49da96d92c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:47.557508 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8478d4e8-0566-411e-9665-49da96d92c18 None None] MFA Rules not processed for user `3f2bdf8a2edf46a491e7eb123a8ab613`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:47.558745 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8478d4e8-0566-411e-9665-49da96d92c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:47.626169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1119/2244] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:47.638437 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e77f0d-7b30-41cc-9fe9-6e200b1325b2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:47.673616 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:47.696530 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e77f0d-7b30-41cc-9fe9-6e200b1325b2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:47.700207 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c212ae-93c0-460c-b043-c67339924009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:47.700847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c212ae-93c0-460c-b043-c67339924009 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:47.701128 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c212ae-93c0-460c-b043-c67339924009 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:47.701404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c212ae-93c0-460c-b043-c67339924009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:47.757661 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c212ae-93c0-460c-b043-c67339924009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:47.759031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c212ae-93c0-460c-b043-c67339924009 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:47.767874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1126/2245] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:02:48.106100 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3c126-e186-46a4-8e51-f6dcfeeaf601 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:48.106402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3c126-e186-46a4-8e51-f6dcfeeaf601 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:48.107106 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3c126-e186-46a4-8e51-f6dcfeeaf601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:48.130342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-00d3c126-e186-46a4-8e51-f6dcfeeaf601 None None] MFA Rules not processed for user `6324975b68f44a06a964bd96aa0664f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:48.131859 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-00d3c126-e186-46a4-8e51-f6dcfeeaf601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:48.200021 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1120/2246] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:49.108485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c212ae-93c0-460c-b043-c67339924009 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:49.118593 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c212ae-93c0-460c-b043-c67339924009 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:49.122264 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ac79c-365d-4639-9bb4-f33499a0061a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:49.122895 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ac79c-365d-4639-9bb4-f33499a0061a service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:49.123176 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ac79c-365d-4639-9bb4-f33499a0061a service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:49.123448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ac79c-365d-4639-9bb4-f33499a0061a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:49.134192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ac79c-365d-4639-9bb4-f33499a0061a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:49.135985 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ac79c-365d-4639-9bb4-f33499a0061a service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:49.147061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1127/2247] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:50.724209 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3c126-e186-46a4-8e51-f6dcfeeaf601 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:50.726089 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-00d3c126-e186-46a4-8e51-f6dcfeeaf601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:50.794126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:50.798877 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3c126-e186-46a4-8e51-f6dcfeeaf601 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:50.804090 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695988f-6669-45e1-80c3-df1f9b5e8eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:50.804958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695988f-6669-45e1-80c3-df1f9b5e8eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:50.805327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695988f-6669-45e1-80c3-df1f9b5e8eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:50.805656 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695988f-6669-45e1-80c3-df1f9b5e8eac admin admin] PATH_INFO: `/v3/users/a32abb99c0fc4c0e948c478fc5494ca3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:50.807025 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695988f-6669-45e1-80c3-df1f9b5e8eac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a32abb99c0fc4c0e948c478fc5494ca3)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:50.808955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695988f-6669-45e1-80c3-df1f9b5e8eac admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:50.856204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b695988f-6669-45e1-80c3-df1f9b5e8eac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a32abb99c0fc4c0e948c478fc5494ca3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:50.863882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b695988f-6669-45e1-80c3-df1f9b5e8eac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a32abb99c0fc4c0e948c478fc5494ca3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:50.870871 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b695988f-6669-45e1-80c3-df1f9b5e8eac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a32abb99c0fc4c0e948c478fc5494ca3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:50.872396 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b695988f-6669-45e1-80c3-df1f9b5e8eac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a32abb99c0fc4c0e948c478fc5494ca3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:50.873203 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b695988f-6669-45e1-80c3-df1f9b5e8eac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a32abb99c0fc4c0e948c478fc5494ca3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:50.891339 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1121/2248] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:50 2022] DELETE /identity/v3/users/a32abb99c0fc4c0e948c478fc5494ca3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:50.895912 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeee1b-070d-4869-ac2d-5a6503c5a77a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:50.896406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeee1b-070d-4869-ac2d-5a6503c5a77a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:50.896498 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeee1b-070d-4869-ac2d-5a6503c5a77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:50.914665 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-08eeee1b-070d-4869-ac2d-5a6503c5a77a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:50.915986 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-08eeee1b-070d-4869-ac2d-5a6503c5a77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:50.974587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1128/2249] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:50.984936 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695988f-6669-45e1-80c3-df1f9b5e8eac admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:50.986366 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b695988f-6669-45e1-80c3-df1f9b5e8eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:51.057563 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695988f-6669-45e1-80c3-df1f9b5e8eac admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:51.061494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f73543-6d89-4823-bdd5-8de795f0c1de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:51.062195 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f73543-6d89-4823-bdd5-8de795f0c1de service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:51.062540 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f73543-6d89-4823-bdd5-8de795f0c1de service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:51.062894 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f73543-6d89-4823-bdd5-8de795f0c1de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:51.074774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f73543-6d89-4823-bdd5-8de795f0c1de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:51.076281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f73543-6d89-4823-bdd5-8de795f0c1de service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:51.086033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1122/2250] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:51.523774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eeee1b-070d-4869-ac2d-5a6503c5a77a None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:51.525564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-08eeee1b-070d-4869-ac2d-5a6503c5a77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:51.543877 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eeee1b-070d-4869-ac2d-5a6503c5a77a None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:51.548821 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa681e58-80d9-43d5-9283-3d1bd0f4b742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:51.550338 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa681e58-80d9-43d5-9283-3d1bd0f4b742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:51.550692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa681e58-80d9-43d5-9283-3d1bd0f4b742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:51.551563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa681e58-80d9-43d5-9283-3d1bd0f4b742 admin admin] PATH_INFO: `/v3/projects/770e55d51b614d54a07928c0b5afb58e` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:51.552879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa681e58-80d9-43d5-9283-3d1bd0f4b742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=770e55d51b614d54a07928c0b5afb58e)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:51.555205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa681e58-80d9-43d5-9283-3d1bd0f4b742 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:51.605246 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-aa681e58-80d9-43d5-9283-3d1bd0f4b742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '770e55d51b614d54a07928c0b5afb58e', 'request_id': 'req-aa681e58-80d9-43d5-9283-3d1bd0f4b742'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:51.616847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-aa681e58-80d9-43d5-9283-3d1bd0f4b742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '770e55d51b614d54a07928c0b5afb58e', 'request_id': 'req-aa681e58-80d9-43d5-9283-3d1bd0f4b742'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:51.624512 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-aa681e58-80d9-43d5-9283-3d1bd0f4b742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '770e55d51b614d54a07928c0b5afb58e', 'request_id': 'req-aa681e58-80d9-43d5-9283-3d1bd0f4b742'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:51.633464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:51.638814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-aa681e58-80d9-43d5-9283-3d1bd0f4b742 admin admin] The token cache is being invalidate because project 770e55d51b614d54a07928c0b5afb58e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:51.639191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-aa681e58-80d9-43d5-9283-3d1bd0f4b742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:51.640327 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-aa681e58-80d9-43d5-9283-3d1bd0f4b742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:51.642274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1129/2251] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:51 2022] DELETE /identity/v3/projects/770e55d51b614d54a07928c0b5afb58e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:53.076344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f73543-6d89-4823-bdd5-8de795f0c1de service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:53.078302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-99f73543-6d89-4823-bdd5-8de795f0c1de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:53.091486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f73543-6d89-4823-bdd5-8de795f0c1de service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:53.153168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4ef14-65a2-4a99-a02e-5caaadba9bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:53.154085 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4ef14-65a2-4a99-a02e-5caaadba9bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:53.154369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4ef14-65a2-4a99-a02e-5caaadba9bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:53.154782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4ef14-65a2-4a99-a02e-5caaadba9bd4 admin admin] PATH_INFO: `/v3/users/b3616db5c2ff48f38a0c438703813cc4` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:53.156003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4ef14-65a2-4a99-a02e-5caaadba9bd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3616db5c2ff48f38a0c438703813cc4)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:53.158006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4ef14-65a2-4a99-a02e-5caaadba9bd4 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:53.184620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:53.221141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-abd4ef14-65a2-4a99-a02e-5caaadba9bd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3616db5c2ff48f38a0c438703813cc4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:53.229671 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-abd4ef14-65a2-4a99-a02e-5caaadba9bd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3616db5c2ff48f38a0c438703813cc4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:53.238978 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-abd4ef14-65a2-4a99-a02e-5caaadba9bd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3616db5c2ff48f38a0c438703813cc4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:53.239905 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-abd4ef14-65a2-4a99-a02e-5caaadba9bd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3616db5c2ff48f38a0c438703813cc4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:53.240535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-abd4ef14-65a2-4a99-a02e-5caaadba9bd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3616db5c2ff48f38a0c438703813cc4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:53.261049 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1123/2252] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:53 2022] DELETE /identity/v3/users/b3616db5c2ff48f38a0c438703813cc4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:53.268553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb91b2-109a-4e5f-af20-2e3c4401b346 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:53.269948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb91b2-109a-4e5f-af20-2e3c4401b346 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:53.270233 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb91b2-109a-4e5f-af20-2e3c4401b346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:53.293587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-55bb91b2-109a-4e5f-af20-2e3c4401b346 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:53.294862 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-55bb91b2-109a-4e5f-af20-2e3c4401b346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:53.405106 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1130/2253] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:53.420269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4ef14-65a2-4a99-a02e-5caaadba9bd4 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:53.421739 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-abd4ef14-65a2-4a99-a02e-5caaadba9bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:53.498828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4ef14-65a2-4a99-a02e-5caaadba9bd4 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:53.503436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be18a9-ee01-4593-a656-9595a0ef6984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:53.507810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be18a9-ee01-4593-a656-9595a0ef6984 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:53.508105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be18a9-ee01-4593-a656-9595a0ef6984 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:53.508389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be18a9-ee01-4593-a656-9595a0ef6984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:53.519794 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be18a9-ee01-4593-a656-9595a0ef6984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:53.521818 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be18a9-ee01-4593-a656-9595a0ef6984 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:53.542874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1124/2254] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:53.850040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb91b2-109a-4e5f-af20-2e3c4401b346 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:53.851541 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-55bb91b2-109a-4e5f-af20-2e3c4401b346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:53.874648 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb91b2-109a-4e5f-af20-2e3c4401b346 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:53.881566 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09070cb1-868e-429d-9c8b-44a0dd369417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:53.882762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09070cb1-868e-429d-9c8b-44a0dd369417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:53.883059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09070cb1-868e-429d-9c8b-44a0dd369417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:53.883504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09070cb1-868e-429d-9c8b-44a0dd369417 admin admin] PATH_INFO: `/v3/projects/4879ad79dec54261ab77cc10c1720742` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:53.884650 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09070cb1-868e-429d-9c8b-44a0dd369417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4879ad79dec54261ab77cc10c1720742)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:53.886568 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09070cb1-868e-429d-9c8b-44a0dd369417 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:53.937669 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-09070cb1-868e-429d-9c8b-44a0dd369417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4879ad79dec54261ab77cc10c1720742', 'request_id': 'req-09070cb1-868e-429d-9c8b-44a0dd369417'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:53.943816 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-09070cb1-868e-429d-9c8b-44a0dd369417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4879ad79dec54261ab77cc10c1720742', 'request_id': 'req-09070cb1-868e-429d-9c8b-44a0dd369417'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:53.949894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-09070cb1-868e-429d-9c8b-44a0dd369417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4879ad79dec54261ab77cc10c1720742', 'request_id': 'req-09070cb1-868e-429d-9c8b-44a0dd369417'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:53.962375 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-09070cb1-868e-429d-9c8b-44a0dd369417 admin admin] The token cache is being invalidate because project 4879ad79dec54261ab77cc10c1720742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:53.962663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-09070cb1-868e-429d-9c8b-44a0dd369417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:53.963309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-09070cb1-868e-429d-9c8b-44a0dd369417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:53.964902 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1131/2255] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:53 2022] DELETE /identity/v3/projects/4879ad79dec54261ab77cc10c1720742 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:53.968836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be18a9-ee01-4593-a656-9595a0ef6984 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:53.978824 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be18a9-ee01-4593-a656-9595a0ef6984 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:54.040208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437ff9a-6786-48b2-81f1-82022be312c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:54.040974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437ff9a-6786-48b2-81f1-82022be312c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:54.041250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437ff9a-6786-48b2-81f1-82022be312c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:54.041522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437ff9a-6786-48b2-81f1-82022be312c5 admin admin] PATH_INFO: `/v3/users/3f2bdf8a2edf46a491e7eb123a8ab613` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:54.042703 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437ff9a-6786-48b2-81f1-82022be312c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f2bdf8a2edf46a491e7eb123a8ab613)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:54.044598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437ff9a-6786-48b2-81f1-82022be312c5 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:54.089856 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:54.092844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4437ff9a-6786-48b2-81f1-82022be312c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f2bdf8a2edf46a491e7eb123a8ab613'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:54.101242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4437ff9a-6786-48b2-81f1-82022be312c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f2bdf8a2edf46a491e7eb123a8ab613'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:54.110148 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4437ff9a-6786-48b2-81f1-82022be312c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f2bdf8a2edf46a491e7eb123a8ab613'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:54.110767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4437ff9a-6786-48b2-81f1-82022be312c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f2bdf8a2edf46a491e7eb123a8ab613'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:54.111373 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4437ff9a-6786-48b2-81f1-82022be312c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f2bdf8a2edf46a491e7eb123a8ab613'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:54.129558 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1125/2256] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:02:53 2022] DELETE /identity/v3/users/3f2bdf8a2edf46a491e7eb123a8ab613 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:54.403940 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09070cb1-868e-429d-9c8b-44a0dd369417 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:54.411442 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-09070cb1-868e-429d-9c8b-44a0dd369417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:54.426968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09070cb1-868e-429d-9c8b-44a0dd369417 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:54.491215 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4758f-ea09-4c7e-9fa1-80c0ed748565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:54.492091 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4758f-ea09-4c7e-9fa1-80c0ed748565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:54.492552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4758f-ea09-4c7e-9fa1-80c0ed748565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:54.492835 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4758f-ea09-4c7e-9fa1-80c0ed748565 admin admin] PATH_INFO: `/v3/projects/0da6c4f25c0440a7b3baa9a8667c3f19` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:54.494182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4758f-ea09-4c7e-9fa1-80c0ed748565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0da6c4f25c0440a7b3baa9a8667c3f19)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:54.496157 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4758f-ea09-4c7e-9fa1-80c0ed748565 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:54.522869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:54.550348 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3db4758f-ea09-4c7e-9fa1-80c0ed748565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da6c4f25c0440a7b3baa9a8667c3f19', 'request_id': 'req-3db4758f-ea09-4c7e-9fa1-80c0ed748565'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:54.556458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3db4758f-ea09-4c7e-9fa1-80c0ed748565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da6c4f25c0440a7b3baa9a8667c3f19', 'request_id': 'req-3db4758f-ea09-4c7e-9fa1-80c0ed748565'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:54.563064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3db4758f-ea09-4c7e-9fa1-80c0ed748565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da6c4f25c0440a7b3baa9a8667c3f19', 'request_id': 'req-3db4758f-ea09-4c7e-9fa1-80c0ed748565'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:54.576978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3db4758f-ea09-4c7e-9fa1-80c0ed748565 admin admin] The token cache is being invalidate because project 0da6c4f25c0440a7b3baa9a8667c3f19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:02:54.577290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3db4758f-ea09-4c7e-9fa1-80c0ed748565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:54.578143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3db4758f-ea09-4c7e-9fa1-80c0ed748565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:02:54.579762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1132/2257] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:02:54 2022] DELETE /identity/v3/projects/0da6c4f25c0440a7b3baa9a8667c3f19 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:54.587723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475051e-13c9-4d3c-958a-c60ab2b1bc44 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:54.588019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475051e-13c9-4d3c-958a-c60ab2b1bc44 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:54.588323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475051e-13c9-4d3c-958a-c60ab2b1bc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:54.609942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-6475051e-13c9-4d3c-958a-c60ab2b1bc44 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:54.611148 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6475051e-13c9-4d3c-958a-c60ab2b1bc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:54.681826 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1126/2258] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:54.689171 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1222b-490d-426b-b183-1a647efa9d8c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:54.689466 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1222b-490d-426b-b183-1a647efa9d8c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:54.689747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1222b-490d-426b-b183-1a647efa9d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:54.717309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e8a1222b-490d-426b-b183-1a647efa9d8c None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:54.718637 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e8a1222b-490d-426b-b183-1a647efa9d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:54.735320 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1133/2259] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:54.739706 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475051e-13c9-4d3c-958a-c60ab2b1bc44 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:54.750423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475051e-13c9-4d3c-958a-c60ab2b1bc44 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:54.762142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891ea0f-bede-4a5b-81d6-7cc3df649871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:54.763663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891ea0f-bede-4a5b-81d6-7cc3df649871 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:54.764011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891ea0f-bede-4a5b-81d6-7cc3df649871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:54.764692 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891ea0f-bede-4a5b-81d6-7cc3df649871 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:54.766029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891ea0f-bede-4a5b-81d6-7cc3df649871 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:02:54.766450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891ea0f-bede-4a5b-81d6-7cc3df649871 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:54.769729 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891ea0f-bede-4a5b-81d6-7cc3df649871 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:54.794414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1127/2260] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:02:54.796619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1222b-490d-426b-b183-1a647efa9d8c None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:54.807906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1222b-490d-426b-b183-1a647efa9d8c None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:54.819242 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bbd3e-4440-4c6d-a2ca-ecfca4553513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:54.820017 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bbd3e-4440-4c6d-a2ca-ecfca4553513 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:54.820300 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bbd3e-4440-4c6d-a2ca-ecfca4553513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:54.820582 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bbd3e-4440-4c6d-a2ca-ecfca4553513 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:54.821343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bbd3e-4440-4c6d-a2ca-ecfca4553513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:54.824179 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bbd3e-4440-4c6d-a2ca-ecfca4553513 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:54.859143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1134/2261] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:54 2022] POST /identity/v3/projects => generated 399 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:54.863466 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891ea0f-bede-4a5b-81d6-7cc3df649871 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:54.879254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891ea0f-bede-4a5b-81d6-7cc3df649871 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:54.999359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bc2c0-0ff2-4309-993d-afb3bcf7c0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:54.999836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bc2c0-0ff2-4309-993d-afb3bcf7c0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:55.000125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bc2c0-0ff2-4309-993d-afb3bcf7c0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:55.000389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bc2c0-0ff2-4309-993d-afb3bcf7c0f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:55.001098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bc2c0-0ff2-4309-993d-afb3bcf7c0f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:55.003904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bc2c0-0ff2-4309-993d-afb3bcf7c0f6 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:55.028170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1128/2262] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:54 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:55.032306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bbd3e-4440-4c6d-a2ca-ecfca4553513 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:55.042737 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bbd3e-4440-4c6d-a2ca-ecfca4553513 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:55.054726 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f030f-a022-49e3-a617-69ba915636e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:55.055830 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f030f-a022-49e3-a617-69ba915636e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:55.056314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f030f-a022-49e3-a617-69ba915636e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:55.056778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f030f-a022-49e3-a617-69ba915636e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:55.058307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f030f-a022-49e3-a617-69ba915636e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:55.060452 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f030f-a022-49e3-a617-69ba915636e2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:55.073969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1135/2263] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:55.077005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bc2c0-0ff2-4309-993d-afb3bcf7c0f6 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:55.087823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bc2c0-0ff2-4309-993d-afb3bcf7c0f6 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:55.092743 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcd515-3ca4-4924-bcc6-bd8113430d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:55.093450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcd515-3ca4-4924-bcc6-bd8113430d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:55.093893 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcd515-3ca4-4924-bcc6-bd8113430d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:55.094256 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcd515-3ca4-4924-bcc6-bd8113430d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:55.094973 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcd515-3ca4-4924-bcc6-bd8113430d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:55.096656 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcd515-3ca4-4924-bcc6-bd8113430d21 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:55.109225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1129/2264] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:55.113196 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f030f-a022-49e3-a617-69ba915636e2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:55.129978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f030f-a022-49e3-a617-69ba915636e2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:55.129978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90eb9e-16e1-48d3-a938-eb5094878d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:55.130230 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90eb9e-16e1-48d3-a938-eb5094878d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:55.130450 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90eb9e-16e1-48d3-a938-eb5094878d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:55.130792 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90eb9e-16e1-48d3-a938-eb5094878d5b admin admin] PATH_INFO: `/v3/projects/d9a358d84a184703a4a82a2033f446c1/users/d152ccaf90b14afa96b9e2bd1dea16ff/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:55.152877 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90eb9e-16e1-48d3-a938-eb5094878d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a358d84a184703a4a82a2033f446c1, user_id=d152ccaf90b14afa96b9e2bd1dea16ff, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:55.155860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90eb9e-16e1-48d3-a938-eb5094878d5b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:55.177227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1136/2265] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:55 2022] PUT /identity/v3/projects/d9a358d84a184703a4a82a2033f446c1/users/d152ccaf90b14afa96b9e2bd1dea16ff/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:02:55.189135 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10612e87-c61a-46f2-a033-a02fc4fad13b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:55.189439 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10612e87-c61a-46f2-a033-a02fc4fad13b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:55.190517 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10612e87-c61a-46f2-a033-a02fc4fad13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:55.233389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-10612e87-c61a-46f2-a033-a02fc4fad13b None None] MFA Rules not processed for user `d152ccaf90b14afa96b9e2bd1dea16ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:55.234758 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-10612e87-c61a-46f2-a033-a02fc4fad13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:55.251105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:55.309417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1130/2266] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:55.313848 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90eb9e-16e1-48d3-a938-eb5094878d5b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:55.379067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90eb9e-16e1-48d3-a938-eb5094878d5b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:55.384255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac0369-4b4f-4ce1-a42c-312c2aa687e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:55.384922 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac0369-4b4f-4ce1-a42c-312c2aa687e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:55.385306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac0369-4b4f-4ce1-a42c-312c2aa687e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:55.385601 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac0369-4b4f-4ce1-a42c-312c2aa687e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:55.386445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac0369-4b4f-4ce1-a42c-312c2aa687e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:55.388366 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac0369-4b4f-4ce1-a42c-312c2aa687e3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:55.414477 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1137/2267] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:02:55 2022] POST /identity/v3/projects => generated 401 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:55.419002 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10612e87-c61a-46f2-a033-a02fc4fad13b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:55.431073 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10612e87-c61a-46f2-a033-a02fc4fad13b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:55.495877 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824f86c-a526-442b-803d-5833b9c175fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:55.496645 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824f86c-a526-442b-803d-5833b9c175fa admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:55.496965 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824f86c-a526-442b-803d-5833b9c175fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:55.497279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824f86c-a526-442b-803d-5833b9c175fa admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:55.498122 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824f86c-a526-442b-803d-5833b9c175fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:55.500267 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824f86c-a526-442b-803d-5833b9c175fa admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:55.519976 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1131/2268] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:02:55 2022] POST /identity/v3/users => generated 307 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:02:55.524057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac0369-4b4f-4ce1-a42c-312c2aa687e3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:55.535426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac0369-4b4f-4ce1-a42c-312c2aa687e3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:55.540114 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bf4b9-115e-41c7-a8f3-b52762bcc0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:55.540767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf4b9-115e-41c7-a8f3-b52762bcc0fa admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:55.541080 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf4b9-115e-41c7-a8f3-b52762bcc0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:55.541361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf4b9-115e-41c7-a8f3-b52762bcc0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:55.542132 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bf4b9-115e-41c7-a8f3-b52762bcc0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:55.543732 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bf4b9-115e-41c7-a8f3-b52762bcc0fa admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:55.554397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1138/2269] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:55.558486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824f86c-a526-442b-803d-5833b9c175fa admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:55.569147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824f86c-a526-442b-803d-5833b9c175fa admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:55.574645 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bf42d-8598-4910-9b30-4e621d032ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:55.575713 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf42d-8598-4910-9b30-4e621d032ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:55.576003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf42d-8598-4910-9b30-4e621d032ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:55.576283 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf42d-8598-4910-9b30-4e621d032ab8 admin admin] PATH_INFO: `/v3/projects/ec68117769384e349116572d4d60024e/users/e577c49a53d74a218f9f934e697b4a7f/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:55.593064 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bf42d-8598-4910-9b30-4e621d032ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec68117769384e349116572d4d60024e, user_id=e577c49a53d74a218f9f934e697b4a7f, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:55.595779 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bf42d-8598-4910-9b30-4e621d032ab8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:55.609718 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1132/2270] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:55 2022] PUT /identity/v3/projects/ec68117769384e349116572d4d60024e/users/e577c49a53d74a218f9f934e697b4a7f/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:55.613645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bf4b9-115e-41c7-a8f3-b52762bcc0fa admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:55.623611 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bf4b9-115e-41c7-a8f3-b52762bcc0fa admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:55.641436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:02:55.684728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d00164-58e0-4d48-bce8-61bacda0f67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:55.685415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d00164-58e0-4d48-bce8-61bacda0f67f admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:55.685709 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d00164-58e0-4d48-bce8-61bacda0f67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:55.686032 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d00164-58e0-4d48-bce8-61bacda0f67f admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:55.686741 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d00164-58e0-4d48-bce8-61bacda0f67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:55.688365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d00164-58e0-4d48-bce8-61bacda0f67f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:55.698859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1139/2271] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:02:55.702979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bf42d-8598-4910-9b30-4e621d032ab8 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:55.713681 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bf42d-8598-4910-9b30-4e621d032ab8 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:55.718344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dad806-c692-4fb5-8b1d-b7a493ba1d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:55.719214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dad806-c692-4fb5-8b1d-b7a493ba1d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:55.719493 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dad806-c692-4fb5-8b1d-b7a493ba1d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:55.719788 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dad806-c692-4fb5-8b1d-b7a493ba1d6d admin admin] PATH_INFO: `/v3/projects/ec68117769384e349116572d4d60024e/users/e577c49a53d74a218f9f934e697b4a7f/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:55.721739 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dad806-c692-4fb5-8b1d-b7a493ba1d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec68117769384e349116572d4d60024e, user_id=e577c49a53d74a218f9f934e697b4a7f, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:55.724403 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dad806-c692-4fb5-8b1d-b7a493ba1d6d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:55.734841 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1133/2272] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:02:55 2022] PUT /identity/v3/projects/ec68117769384e349116572d4d60024e/users/e577c49a53d74a218f9f934e697b4a7f/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:02:55.746077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e03f5-7d01-4c05-828a-89d257439e59 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:55.746373 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e03f5-7d01-4c05-828a-89d257439e59 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:55.746656 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e03f5-7d01-4c05-828a-89d257439e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:55.775041 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3c8e03f5-7d01-4c05-828a-89d257439e59 None None] MFA Rules not processed for user `e577c49a53d74a218f9f934e697b4a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:02:55.776258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3c8e03f5-7d01-4c05-828a-89d257439e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:55.844594 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1140/2273] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:02:55 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:02:55.855514 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dad806-c692-4fb5-8b1d-b7a493ba1d6d admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:55.857490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-00dad806-c692-4fb5-8b1d-b7a493ba1d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:55.915093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dad806-c692-4fb5-8b1d-b7a493ba1d6d admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:55.918732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53915c-1b88-491b-85c9-8d6c5a91cd93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:55.919369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53915c-1b88-491b-85c9-8d6c5a91cd93 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:55.919650 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53915c-1b88-491b-85c9-8d6c5a91cd93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:55.919925 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53915c-1b88-491b-85c9-8d6c5a91cd93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:55.936223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53915c-1b88-491b-85c9-8d6c5a91cd93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:55.937665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53915c-1b88-491b-85c9-8d6c5a91cd93 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:55.947690 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1134/2274] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:55 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:02:56.034408 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e03f5-7d01-4c05-828a-89d257439e59 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:02:56.035916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3c8e03f5-7d01-4c05-828a-89d257439e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:02:56.048227 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e03f5-7d01-4c05-828a-89d257439e59 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:02:56.055568 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba62d82-7dec-46d9-a68a-547371e1dfb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:02:56.056294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba62d82-7dec-46d9-a68a-547371e1dfb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:02:56.056670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba62d82-7dec-46d9-a68a-547371e1dfb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:02:56.057015 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba62d82-7dec-46d9-a68a-547371e1dfb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:02:56.128740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba62d82-7dec-46d9-a68a-547371e1dfb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:02:56.130420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba62d82-7dec-46d9-a68a-547371e1dfb6 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:02:56.140731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1141/2275] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:02:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:03:00.345533 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53915c-1b88-491b-85c9-8d6c5a91cd93 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:00.369080 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:00.412652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53915c-1b88-491b-85c9-8d6c5a91cd93 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:00.417468 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76994770-d4d4-43e9-ba79-d7698ff9b564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:00.418369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76994770-d4d4-43e9-ba79-d7698ff9b564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:00.418773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76994770-d4d4-43e9-ba79-d7698ff9b564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:00.419053 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76994770-d4d4-43e9-ba79-d7698ff9b564 admin admin] PATH_INFO: `/v3/users/d152ccaf90b14afa96b9e2bd1dea16ff` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:00.420250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76994770-d4d4-43e9-ba79-d7698ff9b564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d152ccaf90b14afa96b9e2bd1dea16ff)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:00.422193 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76994770-d4d4-43e9-ba79-d7698ff9b564 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:00.472103 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-76994770-d4d4-43e9-ba79-d7698ff9b564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd152ccaf90b14afa96b9e2bd1dea16ff'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:00.480388 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-76994770-d4d4-43e9-ba79-d7698ff9b564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd152ccaf90b14afa96b9e2bd1dea16ff'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:00.488121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-76994770-d4d4-43e9-ba79-d7698ff9b564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd152ccaf90b14afa96b9e2bd1dea16ff'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:00.488603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-76994770-d4d4-43e9-ba79-d7698ff9b564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd152ccaf90b14afa96b9e2bd1dea16ff'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:00.489204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-76994770-d4d4-43e9-ba79-d7698ff9b564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd152ccaf90b14afa96b9e2bd1dea16ff'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:00.511180 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1135/2276] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:03:00 2022] DELETE /identity/v3/users/d152ccaf90b14afa96b9e2bd1dea16ff => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:00.514530 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31295648-5bf8-48b7-8c34-f16c34089bd4 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:00.515040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31295648-5bf8-48b7-8c34-f16c34089bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:00.515133 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31295648-5bf8-48b7-8c34-f16c34089bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:00.532987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-31295648-5bf8-48b7-8c34-f16c34089bd4 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:00.534749 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-31295648-5bf8-48b7-8c34-f16c34089bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:00.576067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:00.599694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1142/2277] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:03:00.609590 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76994770-d4d4-43e9-ba79-d7698ff9b564 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:00.611073 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-76994770-d4d4-43e9-ba79-d7698ff9b564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:00.669718 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76994770-d4d4-43e9-ba79-d7698ff9b564 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:00.673334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770034b-182d-48be-ada1-8da341503382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:00.674032 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770034b-182d-48be-ada1-8da341503382 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:00.674324 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770034b-182d-48be-ada1-8da341503382 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:00.674602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770034b-182d-48be-ada1-8da341503382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:00.685141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770034b-182d-48be-ada1-8da341503382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:00.686806 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770034b-182d-48be-ada1-8da341503382 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:00.698062 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1136/2278] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:01.266882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31295648-5bf8-48b7-8c34-f16c34089bd4 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:01.269065 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-31295648-5bf8-48b7-8c34-f16c34089bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:01.281526 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31295648-5bf8-48b7-8c34-f16c34089bd4 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:01.286938 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:01.288170 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:01.288469 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:01.288746 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72 admin admin] PATH_INFO: `/v3/projects/d9a358d84a184703a4a82a2033f446c1` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:01.290022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a358d84a184703a4a82a2033f446c1)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:01.291963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:01.343068 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a358d84a184703a4a82a2033f446c1', 'request_id': 'req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:01.350370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a358d84a184703a4a82a2033f446c1', 'request_id': 'req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:01.358314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a358d84a184703a4a82a2033f446c1', 'request_id': 'req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:01.372089 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72 admin admin] The token cache is being invalidate because project d9a358d84a184703a4a82a2033f446c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:03:01.372378 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:01.376108 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:01.378382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1143/2279] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:03:01 2022] DELETE /identity/v3/projects/d9a358d84a184703a4a82a2033f446c1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:01.382404 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770034b-182d-48be-ada1-8da341503382 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:01.392172 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770034b-182d-48be-ada1-8da341503382 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:01.428938 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:01.460953 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2315408-ea92-4c7f-95ba-080169d6951a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:01.461832 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315408-ea92-4c7f-95ba-080169d6951a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:01.462147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315408-ea92-4c7f-95ba-080169d6951a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:01.462426 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315408-ea92-4c7f-95ba-080169d6951a admin admin] PATH_INFO: `/v3/users/e577c49a53d74a218f9f934e697b4a7f` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:01.463623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2315408-ea92-4c7f-95ba-080169d6951a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e577c49a53d74a218f9f934e697b4a7f)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:01.465548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2315408-ea92-4c7f-95ba-080169d6951a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:01.514585 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d2315408-ea92-4c7f-95ba-080169d6951a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e577c49a53d74a218f9f934e697b4a7f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:01.522099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d2315408-ea92-4c7f-95ba-080169d6951a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e577c49a53d74a218f9f934e697b4a7f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:01.529971 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d2315408-ea92-4c7f-95ba-080169d6951a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e577c49a53d74a218f9f934e697b4a7f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:01.530569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d2315408-ea92-4c7f-95ba-080169d6951a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e577c49a53d74a218f9f934e697b4a7f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:01.531529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d2315408-ea92-4c7f-95ba-080169d6951a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e577c49a53d74a218f9f934e697b4a7f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:01.549978 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1137/2280] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:03:01 2022] DELETE /identity/v3/users/e577c49a53d74a218f9f934e697b4a7f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:03:01.881634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:01.883153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:01.906310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b9b80-9ef5-42ea-b5af-8218fc2f4b72 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:01.975988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9472afe-01b9-4b51-b25b-fedf7b9789a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:01.976869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9472afe-01b9-4b51-b25b-fedf7b9789a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:01.977399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9472afe-01b9-4b51-b25b-fedf7b9789a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:01.977399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9472afe-01b9-4b51-b25b-fedf7b9789a7 admin admin] PATH_INFO: `/v3/projects/ec68117769384e349116572d4d60024e` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:01.985277 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9472afe-01b9-4b51-b25b-fedf7b9789a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec68117769384e349116572d4d60024e)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:01.987482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9472afe-01b9-4b51-b25b-fedf7b9789a7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:02.037044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e9472afe-01b9-4b51-b25b-fedf7b9789a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec68117769384e349116572d4d60024e', 'request_id': 'req-e9472afe-01b9-4b51-b25b-fedf7b9789a7'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:02.043081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e9472afe-01b9-4b51-b25b-fedf7b9789a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec68117769384e349116572d4d60024e', 'request_id': 'req-e9472afe-01b9-4b51-b25b-fedf7b9789a7'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:02.051744 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e9472afe-01b9-4b51-b25b-fedf7b9789a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec68117769384e349116572d4d60024e', 'request_id': 'req-e9472afe-01b9-4b51-b25b-fedf7b9789a7'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:02.055681 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:02.068852 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e9472afe-01b9-4b51-b25b-fedf7b9789a7 admin admin] The token cache is being invalidate because project ec68117769384e349116572d4d60024e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:03:02.069376 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e9472afe-01b9-4b51-b25b-fedf7b9789a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:02.069920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e9472afe-01b9-4b51-b25b-fedf7b9789a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:02.075040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1144/2281] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:03:01 2022] DELETE /identity/v3/projects/ec68117769384e349116572d4d60024e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:03:02.079627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495204a-5aaf-4a6e-8ca6-5c2badeb6007 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:02.079902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495204a-5aaf-4a6e-8ca6-5c2badeb6007 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:02.080194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495204a-5aaf-4a6e-8ca6-5c2badeb6007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:02.099732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-6495204a-5aaf-4a6e-8ca6-5c2badeb6007 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:02.100921 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6495204a-5aaf-4a6e-8ca6-5c2badeb6007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:02.179689 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1138/2282] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:02.187287 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990744a2-e1cd-4a63-a71b-22a21ca42bfc None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:02.187585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990744a2-e1cd-4a63-a71b-22a21ca42bfc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:02.187862 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990744a2-e1cd-4a63-a71b-22a21ca42bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:02.210089 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-990744a2-e1cd-4a63-a71b-22a21ca42bfc None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:02.215653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-990744a2-e1cd-4a63-a71b-22a21ca42bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:02.220250 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1145/2283] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:02.225296 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495204a-5aaf-4a6e-8ca6-5c2badeb6007 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:02.245900 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495204a-5aaf-4a6e-8ca6-5c2badeb6007 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:02.250669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f97cd-a119-477e-9f46-f600efa2b0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:02.251328 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f97cd-a119-477e-9f46-f600efa2b0da admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:02.251609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f97cd-a119-477e-9f46-f600efa2b0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:02.251882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f97cd-a119-477e-9f46-f600efa2b0da admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:02.252646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f97cd-a119-477e-9f46-f600efa2b0da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:03:02.252951 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f97cd-a119-477e-9f46-f600efa2b0da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:02.254579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f97cd-a119-477e-9f46-f600efa2b0da admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:02.270019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1139/2284] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:03:02.271630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990744a2-e1cd-4a63-a71b-22a21ca42bfc None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:02.283271 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990744a2-e1cd-4a63-a71b-22a21ca42bfc None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:02.289614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ce13b-a96c-41bd-86e7-49cf9c6dc9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:02.290302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce13b-a96c-41bd-86e7-49cf9c6dc9bf admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:02.290591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce13b-a96c-41bd-86e7-49cf9c6dc9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:02.291637 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce13b-a96c-41bd-86e7-49cf9c6dc9bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:02.292399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ce13b-a96c-41bd-86e7-49cf9c6dc9bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:02.295051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ce13b-a96c-41bd-86e7-49cf9c6dc9bf admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:02.324627 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1146/2285] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:03:02 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:03:02.329533 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f97cd-a119-477e-9f46-f600efa2b0da admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:02.342320 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f97cd-a119-477e-9f46-f600efa2b0da admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:02.397285 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:02.422485 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e9a13-c27c-4c43-b7c4-d048fc7ef052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:02.423223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e9a13-c27c-4c43-b7c4-d048fc7ef052 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:02.424137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e9a13-c27c-4c43-b7c4-d048fc7ef052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:02.424423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e9a13-c27c-4c43-b7c4-d048fc7ef052 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:02.425216 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e9a13-c27c-4c43-b7c4-d048fc7ef052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:02.427179 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e9a13-c27c-4c43-b7c4-d048fc7ef052 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:02.456763 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1140/2286] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:03:02 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:03:02.458339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ce13b-a96c-41bd-86e7-49cf9c6dc9bf admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:02.470086 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ce13b-a96c-41bd-86e7-49cf9c6dc9bf admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:02.476158 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccb569-70d2-4df7-b90f-6699383eb982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:02.476954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccb569-70d2-4df7-b90f-6699383eb982 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:02.477296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccb569-70d2-4df7-b90f-6699383eb982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:02.477605 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccb569-70d2-4df7-b90f-6699383eb982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:02.478476 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccb569-70d2-4df7-b90f-6699383eb982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:02.480190 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccb569-70d2-4df7-b90f-6699383eb982 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:02.501977 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1147/2287] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:03:02.507538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e9a13-c27c-4c43-b7c4-d048fc7ef052 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:02.537559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e9a13-c27c-4c43-b7c4-d048fc7ef052 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:02.543693 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f4323-8c66-4ae0-a5ee-8c1ce1b73c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:02.543934 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f4323-8c66-4ae0-a5ee-8c1ce1b73c2f admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:02.544312 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f4323-8c66-4ae0-a5ee-8c1ce1b73c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:02.544591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f4323-8c66-4ae0-a5ee-8c1ce1b73c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:02.545465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f4323-8c66-4ae0-a5ee-8c1ce1b73c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:02.547487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f4323-8c66-4ae0-a5ee-8c1ce1b73c2f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:02.561852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1141/2288] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:03:02.565672 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccb569-70d2-4df7-b90f-6699383eb982 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:02.576527 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccb569-70d2-4df7-b90f-6699383eb982 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:02.584187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd545bac-70d2-413b-860a-684119c4b200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:02.585104 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd545bac-70d2-413b-860a-684119c4b200 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:02.585385 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd545bac-70d2-413b-860a-684119c4b200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:02.585657 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd545bac-70d2-413b-860a-684119c4b200 admin admin] PATH_INFO: `/v3/projects/e360bd0e377f482380d6778b09931834/users/3b5932aa6cec463499fe93526531444a/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:02.608560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd545bac-70d2-413b-860a-684119c4b200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e360bd0e377f482380d6778b09931834, user_id=3b5932aa6cec463499fe93526531444a, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:02.609964 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd545bac-70d2-413b-860a-684119c4b200 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:02.625565 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1148/2289] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:03:02 2022] PUT /identity/v3/projects/e360bd0e377f482380d6778b09931834/users/3b5932aa6cec463499fe93526531444a/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:02.645046 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85f8c2-4472-4652-be1a-4febd6e8a5b0 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:02.645380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85f8c2-4472-4652-be1a-4febd6e8a5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:02.645626 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85f8c2-4472-4652-be1a-4febd6e8a5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:02.673480 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0d85f8c2-4472-4652-be1a-4febd6e8a5b0 None None] MFA Rules not processed for user `3b5932aa6cec463499fe93526531444a`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:02.675478 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0d85f8c2-4472-4652-be1a-4febd6e8a5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:02.758762 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1142/2290] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:02.760358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd545bac-70d2-413b-860a-684119c4b200 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:02.835722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd545bac-70d2-413b-860a-684119c4b200 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:02.840738 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8c30d-c874-48c8-b2ae-4a6ce2a1a0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:02.841398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8c30d-c874-48c8-b2ae-4a6ce2a1a0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:02.841679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8c30d-c874-48c8-b2ae-4a6ce2a1a0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:02.841971 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8c30d-c874-48c8-b2ae-4a6ce2a1a0c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:02.842891 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8c30d-c874-48c8-b2ae-4a6ce2a1a0c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:02.844835 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8c30d-c874-48c8-b2ae-4a6ce2a1a0c6 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:02.882422 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1149/2291] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:03:02 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:03:02.886301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85f8c2-4472-4652-be1a-4febd6e8a5b0 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:02.898033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85f8c2-4472-4652-be1a-4febd6e8a5b0 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:02.950577 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8c30d-c874-48c8-b2ae-4a6ce2a1a0c6 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:02.952432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1cd8c30d-c874-48c8-b2ae-4a6ce2a1a0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:02.977003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637da39-3af7-43f7-b4e2-fd17f5194c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:02.977673 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637da39-3af7-43f7-b4e2-fd17f5194c8f admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:02.977979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637da39-3af7-43f7-b4e2-fd17f5194c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:02.978609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637da39-3af7-43f7-b4e2-fd17f5194c8f admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:02.978936 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637da39-3af7-43f7-b4e2-fd17f5194c8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:02.980845 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637da39-3af7-43f7-b4e2-fd17f5194c8f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:03.005821 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1143/2292] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:03:02 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:03:03.006435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637da39-3af7-43f7-b4e2-fd17f5194c8f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:03.016985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637da39-3af7-43f7-b4e2-fd17f5194c8f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:03.022728 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaecc69-7b81-43f3-9f06-445993595b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:03.023385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaecc69-7b81-43f3-9f06-445993595b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:03.023667 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaecc69-7b81-43f3-9f06-445993595b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:03.023941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaecc69-7b81-43f3-9f06-445993595b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:03.024665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaecc69-7b81-43f3-9f06-445993595b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:03.026306 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaecc69-7b81-43f3-9f06-445993595b32 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:03.029991 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8c30d-c874-48c8-b2ae-4a6ce2a1a0c6 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:03.036697 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1144/2293] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:03:03.036828 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669e740-29de-4d87-85e7-bb6ea5136f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:03.037886 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669e740-29de-4d87-85e7-bb6ea5136f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:03.038558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669e740-29de-4d87-85e7-bb6ea5136f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:03.038967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669e740-29de-4d87-85e7-bb6ea5136f92 admin admin] PATH_INFO: `/v3/users/90836d64c1e2419b85d9c91a3bfba7a1` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:03.040178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669e740-29de-4d87-85e7-bb6ea5136f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90836d64c1e2419b85d9c91a3bfba7a1)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:03.040379 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaecc69-7b81-43f3-9f06-445993595b32 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:03.042244 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669e740-29de-4d87-85e7-bb6ea5136f92 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:03.051211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaecc69-7b81-43f3-9f06-445993595b32 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:03.056213 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e49a9b-4783-4eea-83fe-3e65daf101b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:03.056893 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e49a9b-4783-4eea-83fe-3e65daf101b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:03.057173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e49a9b-4783-4eea-83fe-3e65daf101b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:03.057448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e49a9b-4783-4eea-83fe-3e65daf101b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:03.058223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e49a9b-4783-4eea-83fe-3e65daf101b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:03.059838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e49a9b-4783-4eea-83fe-3e65daf101b7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:03.066583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:03.072151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1145/2294] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:03:03.076568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e49a9b-4783-4eea-83fe-3e65daf101b7 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:03.088174 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e49a9b-4783-4eea-83fe-3e65daf101b7 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:03.093022 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc51ba2-d980-4fa0-9033-0b6a60fee2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:03.093908 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc51ba2-d980-4fa0-9033-0b6a60fee2f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:03.094220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc51ba2-d980-4fa0-9033-0b6a60fee2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:03.094506 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc51ba2-d980-4fa0-9033-0b6a60fee2f1 admin admin] PATH_INFO: `/v3/projects/2332c57d0c3549139df13996f0ffb2c8/users/0b7a1b4748de469da23c553ba9869304/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:03.097013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b669e740-29de-4d87-85e7-bb6ea5136f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90836d64c1e2419b85d9c91a3bfba7a1'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:03.103967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b669e740-29de-4d87-85e7-bb6ea5136f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90836d64c1e2419b85d9c91a3bfba7a1'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:03.104650 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b669e740-29de-4d87-85e7-bb6ea5136f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90836d64c1e2419b85d9c91a3bfba7a1'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:03.108091 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:03.113827 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc51ba2-d980-4fa0-9033-0b6a60fee2f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2332c57d0c3549139df13996f0ffb2c8, user_id=0b7a1b4748de469da23c553ba9869304, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:03.117741 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b669e740-29de-4d87-85e7-bb6ea5136f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90836d64c1e2419b85d9c91a3bfba7a1'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:03.118351 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc51ba2-d980-4fa0-9033-0b6a60fee2f1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:03.118793 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b669e740-29de-4d87-85e7-bb6ea5136f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90836d64c1e2419b85d9c91a3bfba7a1'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:03.134494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1146/2295] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:03:03 2022] PUT /identity/v3/projects/2332c57d0c3549139df13996f0ffb2c8/users/0b7a1b4748de469da23c553ba9869304/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:03.145343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1150/2296] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:03:02 2022] DELETE /identity/v3/users/90836d64c1e2419b85d9c91a3bfba7a1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:03:03.145790 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f082a-0786-47c6-9ec5-78257346b438 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:03.146116 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f082a-0786-47c6-9ec5-78257346b438 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:03.146391 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f082a-0786-47c6-9ec5-78257346b438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:03.175524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b89f082a-0786-47c6-9ec5-78257346b438 None None] MFA Rules not processed for user `0b7a1b4748de469da23c553ba9869304`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:03.176784 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b89f082a-0786-47c6-9ec5-78257346b438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:03.248412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1147/2297] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:03:03.250067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669e740-29de-4d87-85e7-bb6ea5136f92 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:03.253305 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b669e740-29de-4d87-85e7-bb6ea5136f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:03.330766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f082a-0786-47c6-9ec5-78257346b438 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:03.332219 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b89f082a-0786-47c6-9ec5-78257346b438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:03.333166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669e740-29de-4d87-85e7-bb6ea5136f92 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:03.338007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e87c3-79dc-443a-aea3-fb301c13bf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:03.338575 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e87c3-79dc-443a-aea3-fb301c13bf39 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:03.338866 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e87c3-79dc-443a-aea3-fb301c13bf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:03.339146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e87c3-79dc-443a-aea3-fb301c13bf39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:03.339932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e87c3-79dc-443a-aea3-fb301c13bf39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:03.342049 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e87c3-79dc-443a-aea3-fb301c13bf39 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:03.362388 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f082a-0786-47c6-9ec5-78257346b438 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:03.368510 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6a34d-0196-41df-b123-e6b75e31d453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:03.369595 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6a34d-0196-41df-b123-e6b75e31d453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:03.369800 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6a34d-0196-41df-b123-e6b75e31d453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:03.370113 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6a34d-0196-41df-b123-e6b75e31d453 admin admin] PATH_INFO: `/v3/projects/41698fbb59bd4130a7760096c05990b4` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:03.371456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6a34d-0196-41df-b123-e6b75e31d453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41698fbb59bd4130a7760096c05990b4)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:03.373371 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6a34d-0196-41df-b123-e6b75e31d453 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:03.374549 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1151/2298] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:03:03 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:03:03.378553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e87c3-79dc-443a-aea3-fb301c13bf39 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:03.427128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f9a6a34d-0196-41df-b123-e6b75e31d453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41698fbb59bd4130a7760096c05990b4', 'request_id': 'req-f9a6a34d-0196-41df-b123-e6b75e31d453'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:03.433297 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f9a6a34d-0196-41df-b123-e6b75e31d453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41698fbb59bd4130a7760096c05990b4', 'request_id': 'req-f9a6a34d-0196-41df-b123-e6b75e31d453'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:03.438930 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f9a6a34d-0196-41df-b123-e6b75e31d453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41698fbb59bd4130a7760096c05990b4', 'request_id': 'req-f9a6a34d-0196-41df-b123-e6b75e31d453'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:03.445951 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e87c3-79dc-443a-aea3-fb301c13bf39 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:03.454258 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f9a6a34d-0196-41df-b123-e6b75e31d453 admin admin] The token cache is being invalidate because project 41698fbb59bd4130a7760096c05990b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:03:03.454551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f9a6a34d-0196-41df-b123-e6b75e31d453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:03.455298 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f9a6a34d-0196-41df-b123-e6b75e31d453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:03.456867 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1148/2299] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:03:03 2022] DELETE /identity/v3/projects/41698fbb59bd4130a7760096c05990b4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:03.460643 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6a34d-0196-41df-b123-e6b75e31d453 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:03.462003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f9a6a34d-0196-41df-b123-e6b75e31d453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:03.484752 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:03.520891 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e850c-862c-4216-a3a8-2c36e092a6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:03.521561 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e850c-862c-4216-a3a8-2c36e092a6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:03.521876 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e850c-862c-4216-a3a8-2c36e092a6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:03.522182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e850c-862c-4216-a3a8-2c36e092a6b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:03.522879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e850c-862c-4216-a3a8-2c36e092a6b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:03.524805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e850c-862c-4216-a3a8-2c36e092a6b1 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:03.534430 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6a34d-0196-41df-b123-e6b75e31d453 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:03.540471 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec8929-ba5f-4932-8c02-c8c8f4fa577b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:03.541526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec8929-ba5f-4932-8c02-c8c8f4fa577b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:03.541820 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec8929-ba5f-4932-8c02-c8c8f4fa577b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:03.542156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec8929-ba5f-4932-8c02-c8c8f4fa577b admin admin] PATH_INFO: `/v3/users/2615d73ac8eb4ed587d88094590ee8be` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:03.543378 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec8929-ba5f-4932-8c02-c8c8f4fa577b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2615d73ac8eb4ed587d88094590ee8be)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:03.545348 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec8929-ba5f-4932-8c02-c8c8f4fa577b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:03.545686 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1152/2300] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:03:03 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:03:03.550497 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e850c-862c-4216-a3a8-2c36e092a6b1 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:03.551814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:03.552317 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8f7e850c-862c-4216-a3a8-2c36e092a6b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:03.564945 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e850c-862c-4216-a3a8-2c36e092a6b1 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:03.569737 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0abc3-8b1e-44ef-a8e2-0b1e647eb079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:03.570429 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0abc3-8b1e-44ef-a8e2-0b1e647eb079 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:03.570710 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0abc3-8b1e-44ef-a8e2-0b1e647eb079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:03.570989 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0abc3-8b1e-44ef-a8e2-0b1e647eb079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:03.571713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0abc3-8b1e-44ef-a8e2-0b1e647eb079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:03.573352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0abc3-8b1e-44ef-a8e2-0b1e647eb079 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:03.583834 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1153/2301] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:03:03.588241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0abc3-8b1e-44ef-a8e2-0b1e647eb079 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:03.599204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0abc3-8b1e-44ef-a8e2-0b1e647eb079 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:03.602684 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-dbec8929-ba5f-4932-8c02-c8c8f4fa577b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2615d73ac8eb4ed587d88094590ee8be'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:03.603797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e115c4e-05bb-44bd-a332-6750c99b6dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:03.604676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e115c4e-05bb-44bd-a332-6750c99b6dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:03.604958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e115c4e-05bb-44bd-a332-6750c99b6dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:03.605231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e115c4e-05bb-44bd-a332-6750c99b6dd4 admin admin] PATH_INFO: `/v3/projects/08aa08c1ca144ecca21f22d2fb6dbbcd/users/60ebebbb78ba46e0bff0931a5580c711/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:03.610451 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-dbec8929-ba5f-4932-8c02-c8c8f4fa577b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2615d73ac8eb4ed587d88094590ee8be'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:03.619034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-dbec8929-ba5f-4932-8c02-c8c8f4fa577b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2615d73ac8eb4ed587d88094590ee8be'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:03.619736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-dbec8929-ba5f-4932-8c02-c8c8f4fa577b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2615d73ac8eb4ed587d88094590ee8be'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:03.620357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-dbec8929-ba5f-4932-8c02-c8c8f4fa577b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2615d73ac8eb4ed587d88094590ee8be'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:03.635593 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e115c4e-05bb-44bd-a332-6750c99b6dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08aa08c1ca144ecca21f22d2fb6dbbcd, user_id=60ebebbb78ba46e0bff0931a5580c711, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:03.638277 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e115c4e-05bb-44bd-a332-6750c99b6dd4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:03.639432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1149/2302] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:03:03 2022] DELETE /identity/v3/users/2615d73ac8eb4ed587d88094590ee8be => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:03:03.656154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1154/2303] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:03:03 2022] PUT /identity/v3/projects/08aa08c1ca144ecca21f22d2fb6dbbcd/users/60ebebbb78ba46e0bff0931a5580c711/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:03:03.660122 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec8929-ba5f-4932-8c02-c8c8f4fa577b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:03.661552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-dbec8929-ba5f-4932-8c02-c8c8f4fa577b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:03.726942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec8929-ba5f-4932-8c02-c8c8f4fa577b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:03.794066 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a55c49-0665-4cc5-9a42-275ac3266b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:03.794772 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a55c49-0665-4cc5-9a42-275ac3266b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:03.795189 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a55c49-0665-4cc5-9a42-275ac3266b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:03.795470 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a55c49-0665-4cc5-9a42-275ac3266b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:03.796197 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a55c49-0665-4cc5-9a42-275ac3266b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:03.797962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a55c49-0665-4cc5-9a42-275ac3266b08 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:03.810668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1150/2304] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:03:03.814338 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e115c4e-05bb-44bd-a332-6750c99b6dd4 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:03.831943 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a55c49-0665-4cc5-9a42-275ac3266b08 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:03.834131 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-03a55c49-0665-4cc5-9a42-275ac3266b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:03.834271 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e115c4e-05bb-44bd-a332-6750c99b6dd4 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:03.839191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47467e-1e47-44ae-987f-eb26bd919666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:03.840191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47467e-1e47-44ae-987f-eb26bd919666 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:03.840538 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47467e-1e47-44ae-987f-eb26bd919666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:03.840882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47467e-1e47-44ae-987f-eb26bd919666 admin admin] PATH_INFO: `/v3/projects/08aa08c1ca144ecca21f22d2fb6dbbcd/users/60ebebbb78ba46e0bff0931a5580c711/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:03.843676 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47467e-1e47-44ae-987f-eb26bd919666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08aa08c1ca144ecca21f22d2fb6dbbcd, user_id=60ebebbb78ba46e0bff0931a5580c711, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:03.847669 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47467e-1e47-44ae-987f-eb26bd919666 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:03.852744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a55c49-0665-4cc5-9a42-275ac3266b08 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:03.858873 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1155/2305] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:03:03 2022] PUT /identity/v3/projects/08aa08c1ca144ecca21f22d2fb6dbbcd/users/60ebebbb78ba46e0bff0931a5580c711/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:03:03.869122 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb65ad6-c2a0-4037-bcd4-23df8d44ba18 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:03.869411 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb65ad6-c2a0-4037-bcd4-23df8d44ba18 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:03.869687 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb65ad6-c2a0-4037-bcd4-23df8d44ba18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:03.900820 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:03.911518 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8fb65ad6-c2a0-4037-bcd4-23df8d44ba18 None None] MFA Rules not processed for user `60ebebbb78ba46e0bff0931a5580c711`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:03.912755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8fb65ad6-c2a0-4037-bcd4-23df8d44ba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:03.953234 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7b089-9cfb-4380-9d58-c3cc42dd40bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:03.954223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b089-9cfb-4380-9d58-c3cc42dd40bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:03.954598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b089-9cfb-4380-9d58-c3cc42dd40bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:03.954899 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b089-9cfb-4380-9d58-c3cc42dd40bb admin admin] PATH_INFO: `/v3/projects/c325a1b4f6264ce089f138074bebf2a6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:03.956174 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7b089-9cfb-4380-9d58-c3cc42dd40bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c325a1b4f6264ce089f138074bebf2a6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:03.958260 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7b089-9cfb-4380-9d58-c3cc42dd40bb admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:04.017282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1156/2306] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:04.023567 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d5c7b089-9cfb-4380-9d58-c3cc42dd40bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c325a1b4f6264ce089f138074bebf2a6', 'request_id': 'req-d5c7b089-9cfb-4380-9d58-c3cc42dd40bb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:04.030814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb65ad6-c2a0-4037-bcd4-23df8d44ba18 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:04.032461 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8fb65ad6-c2a0-4037-bcd4-23df8d44ba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:04.034518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d5c7b089-9cfb-4380-9d58-c3cc42dd40bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c325a1b4f6264ce089f138074bebf2a6', 'request_id': 'req-d5c7b089-9cfb-4380-9d58-c3cc42dd40bb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:04.041131 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d5c7b089-9cfb-4380-9d58-c3cc42dd40bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c325a1b4f6264ce089f138074bebf2a6', 'request_id': 'req-d5c7b089-9cfb-4380-9d58-c3cc42dd40bb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:04.054523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d5c7b089-9cfb-4380-9d58-c3cc42dd40bb admin admin] The token cache is being invalidate because project c325a1b4f6264ce089f138074bebf2a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:03:04.054809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d5c7b089-9cfb-4380-9d58-c3cc42dd40bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:04.055509 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d5c7b089-9cfb-4380-9d58-c3cc42dd40bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:04.057083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1151/2307] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:03:03 2022] DELETE /identity/v3/projects/c325a1b4f6264ce089f138074bebf2a6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:04.061891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde64b4d-7831-4aee-a192-d6f2dd08fe40 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:04.062212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde64b4d-7831-4aee-a192-d6f2dd08fe40 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:04.062494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde64b4d-7831-4aee-a192-d6f2dd08fe40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:04.082095 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-cde64b4d-7831-4aee-a192-d6f2dd08fe40 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:04.083287 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-cde64b4d-7831-4aee-a192-d6f2dd08fe40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:04.094283 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb65ad6-c2a0-4037-bcd4-23df8d44ba18 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:04.103748 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:04.145712 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1152/2308] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:03:04.149740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2799c-4c62-41c5-8ec6-1fecfbf9abd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:04.150432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2799c-4c62-41c5-8ec6-1fecfbf9abd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:04.150716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2799c-4c62-41c5-8ec6-1fecfbf9abd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:04.151178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2799c-4c62-41c5-8ec6-1fecfbf9abd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:04.153094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-35a2799c-4c62-41c5-8ec6-1fecfbf9abd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:04.154546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a3188-9c9f-48d0-af0d-8e2fc70cb229 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:04.155058 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a3188-9c9f-48d0-af0d-8e2fc70cb229 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:04.155537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a3188-9c9f-48d0-af0d-8e2fc70cb229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:04.174725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-735a3188-9c9f-48d0-af0d-8e2fc70cb229 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:04.176191 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-735a3188-9c9f-48d0-af0d-8e2fc70cb229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:04.186668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1153/2309] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:03:04.191275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a3188-9c9f-48d0-af0d-8e2fc70cb229 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:04.200171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a3188-9c9f-48d0-af0d-8e2fc70cb229 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:04.208058 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657826c2-c6c6-4aa4-a1d4-9425ad4d001b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:04.208903 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657826c2-c6c6-4aa4-a1d4-9425ad4d001b admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:04.209183 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657826c2-c6c6-4aa4-a1d4-9425ad4d001b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:04.209460 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657826c2-c6c6-4aa4-a1d4-9425ad4d001b admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:04.210212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657826c2-c6c6-4aa4-a1d4-9425ad4d001b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:03:04.210519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657826c2-c6c6-4aa4-a1d4-9425ad4d001b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:04.212321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657826c2-c6c6-4aa4-a1d4-9425ad4d001b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:04.226180 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1154/2310] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 22:03:04.230310 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657826c2-c6c6-4aa4-a1d4-9425ad4d001b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:04.236285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2799c-4c62-41c5-8ec6-1fecfbf9abd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:04.238714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2799c-4c62-41c5-8ec6-1fecfbf9abd6 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:04.241348 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657826c2-c6c6-4aa4-a1d4-9425ad4d001b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:04.250545 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ebe47-84d9-4501-8a46-89df6697b8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:04.250892 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1157/2311] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:03:04.251751 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ebe47-84d9-4501-8a46-89df6697b8bd admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:04.252036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ebe47-84d9-4501-8a46-89df6697b8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:04.253122 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ebe47-84d9-4501-8a46-89df6697b8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:04.253862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ebe47-84d9-4501-8a46-89df6697b8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:04.255818 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ebe47-84d9-4501-8a46-89df6697b8bd admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:04.294965 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1155/2312] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:03:04 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:03:04.295721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2799c-4c62-41c5-8ec6-1fecfbf9abd6 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:04.295913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ebe47-84d9-4501-8a46-89df6697b8bd admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:04.297131 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-35a2799c-4c62-41c5-8ec6-1fecfbf9abd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:04.308981 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2799c-4c62-41c5-8ec6-1fecfbf9abd6 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:04.316526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:04.359621 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30aa77-963c-44d5-9450-e16c2eb042b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:04.360203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30aa77-963c-44d5-9450-e16c2eb042b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:04.360487 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30aa77-963c-44d5-9450-e16c2eb042b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:04.360879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30aa77-963c-44d5-9450-e16c2eb042b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:04.363246 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7d30aa77-963c-44d5-9450-e16c2eb042b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:04.368147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ebe47-84d9-4501-8a46-89df6697b8bd admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:04.372945 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecfa7d-1b97-4ada-93ce-6f6e08d8d097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:04.373637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecfa7d-1b97-4ada-93ce-6f6e08d8d097 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:04.373914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecfa7d-1b97-4ada-93ce-6f6e08d8d097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:04.374213 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecfa7d-1b97-4ada-93ce-6f6e08d8d097 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:04.374992 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecfa7d-1b97-4ada-93ce-6f6e08d8d097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:04.377174 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecfa7d-1b97-4ada-93ce-6f6e08d8d097 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:04.400647 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1156/2313] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:03:04 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:03:04.401635 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecfa7d-1b97-4ada-93ce-6f6e08d8d097 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:04.411305 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecfa7d-1b97-4ada-93ce-6f6e08d8d097 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:04.415873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809136-538e-42ed-8ab8-70a371a132a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:04.416528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809136-538e-42ed-8ab8-70a371a132a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:04.416804 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809136-538e-42ed-8ab8-70a371a132a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:04.417078 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809136-538e-42ed-8ab8-70a371a132a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:04.417783 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88809136-538e-42ed-8ab8-70a371a132a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:04.419398 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88809136-538e-42ed-8ab8-70a371a132a9 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:04.426138 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30aa77-963c-44d5-9450-e16c2eb042b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:04.427567 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30aa77-963c-44d5-9450-e16c2eb042b7 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:04.429868 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1157/2314] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:03:04.433659 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809136-538e-42ed-8ab8-70a371a132a9 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:04.436717 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1158/2315] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:04.443466 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809136-538e-42ed-8ab8-70a371a132a9 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:04.449055 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369a0ed-f2e6-4b1c-b696-3889a98df098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:04.449728 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369a0ed-f2e6-4b1c-b696-3889a98df098 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:04.450035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369a0ed-f2e6-4b1c-b696-3889a98df098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:04.450310 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369a0ed-f2e6-4b1c-b696-3889a98df098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:04.451026 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369a0ed-f2e6-4b1c-b696-3889a98df098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:04.452665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369a0ed-f2e6-4b1c-b696-3889a98df098 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:04.468927 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1158/2316] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:03:04.470574 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30aa77-963c-44d5-9450-e16c2eb042b7 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:04.483096 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30aa77-963c-44d5-9450-e16c2eb042b7 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:04.489516 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78423ff-da18-425e-997f-3d486836477c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:04.493654 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78423ff-da18-425e-997f-3d486836477c admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:04.493654 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78423ff-da18-425e-997f-3d486836477c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:04.493654 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78423ff-da18-425e-997f-3d486836477c admin admin] PATH_INFO: `/v3/projects/325f2c3df67b4f6ea32cccf9e53d2d02/users/8a9f988857de4dbdbd05e5876425fbc6/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:04.506252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:04.509961 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78423ff-da18-425e-997f-3d486836477c admin admin] RBAC: Authorizing `identity:create_grant(project_id=325f2c3df67b4f6ea32cccf9e53d2d02, user_id=8a9f988857de4dbdbd05e5876425fbc6, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:04.513087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78423ff-da18-425e-997f-3d486836477c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:04.527710 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1159/2317] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:03:04 2022] PUT /identity/v3/projects/325f2c3df67b4f6ea32cccf9e53d2d02/users/8a9f988857de4dbdbd05e5876425fbc6/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:04.538963 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef65c6-71ee-419f-be0e-01842341176d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:04.539251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef65c6-71ee-419f-be0e-01842341176d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:04.539702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef65c6-71ee-419f-be0e-01842341176d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:04.570403 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-93ef65c6-71ee-419f-be0e-01842341176d None None] MFA Rules not processed for user `8a9f988857de4dbdbd05e5876425fbc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:04.571622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-93ef65c6-71ee-419f-be0e-01842341176d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:04.643955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1159/2318] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:04.656198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78423ff-da18-425e-997f-3d486836477c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:04.659046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c78423ff-da18-425e-997f-3d486836477c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:04.719949 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78423ff-da18-425e-997f-3d486836477c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:04.724221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd75a-367d-4530-8f6f-46c06f10f2e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:04.724889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd75a-367d-4530-8f6f-46c06f10f2e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:04.725336 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd75a-367d-4530-8f6f-46c06f10f2e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:04.725638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd75a-367d-4530-8f6f-46c06f10f2e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:04.734807 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dd75a-367d-4530-8f6f-46c06f10f2e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:04.736308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dd75a-367d-4530-8f6f-46c06f10f2e6 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:04.747112 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1160/2319] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:07.322114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef65c6-71ee-419f-be0e-01842341176d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:07.325180 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-93ef65c6-71ee-419f-be0e-01842341176d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:07.326511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd75a-367d-4530-8f6f-46c06f10f2e6 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:07.398600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd75a-367d-4530-8f6f-46c06f10f2e6 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:07.399136 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef65c6-71ee-419f-be0e-01842341176d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:07.404163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec2664-aa0f-42be-b785-80a054e0c8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:07.404322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea074395-3206-405c-9b96-1a5b201029f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:07.405143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec2664-aa0f-42be-b785-80a054e0c8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:07.405251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea074395-3206-405c-9b96-1a5b201029f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:07.405460 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea074395-3206-405c-9b96-1a5b201029f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:07.405562 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec2664-aa0f-42be-b785-80a054e0c8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:07.405739 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea074395-3206-405c-9b96-1a5b201029f2 admin admin] PATH_INFO: `/v3/users/3b5932aa6cec463499fe93526531444a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:07.405849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec2664-aa0f-42be-b785-80a054e0c8e7 admin admin] PATH_INFO: `/v3/users/8a9f988857de4dbdbd05e5876425fbc6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:07.406977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea074395-3206-405c-9b96-1a5b201029f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b5932aa6cec463499fe93526531444a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:07.407154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec2664-aa0f-42be-b785-80a054e0c8e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a9f988857de4dbdbd05e5876425fbc6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:07.409517 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea074395-3206-405c-9b96-1a5b201029f2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:07.409809 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec2664-aa0f-42be-b785-80a054e0c8e7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:07.429306 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:07.470254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ea074395-3206-405c-9b96-1a5b201029f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b5932aa6cec463499fe93526531444a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:07.474600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-96ec2664-aa0f-42be-b785-80a054e0c8e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a9f988857de4dbdbd05e5876425fbc6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:07.478755 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ea074395-3206-405c-9b96-1a5b201029f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b5932aa6cec463499fe93526531444a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:07.483311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-96ec2664-aa0f-42be-b785-80a054e0c8e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a9f988857de4dbdbd05e5876425fbc6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:07.484109 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-96ec2664-aa0f-42be-b785-80a054e0c8e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a9f988857de4dbdbd05e5876425fbc6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:07.487652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ea074395-3206-405c-9b96-1a5b201029f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b5932aa6cec463499fe93526531444a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:07.488731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ea074395-3206-405c-9b96-1a5b201029f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b5932aa6cec463499fe93526531444a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:07.489761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ea074395-3206-405c-9b96-1a5b201029f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b5932aa6cec463499fe93526531444a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:07.493963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-96ec2664-aa0f-42be-b785-80a054e0c8e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a9f988857de4dbdbd05e5876425fbc6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:07.494662 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-96ec2664-aa0f-42be-b785-80a054e0c8e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a9f988857de4dbdbd05e5876425fbc6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:07.523028 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1160/2320] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:03:07 2022] DELETE /identity/v3/users/3b5932aa6cec463499fe93526531444a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:07.525969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1161/2321] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:03:07 2022] DELETE /identity/v3/users/8a9f988857de4dbdbd05e5876425fbc6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:03:07.529381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ff882-2a2f-46f8-8483-f56e68111b42 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:07.529520 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd7435-dec4-493c-8e93-27474b2b6757 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:07.529663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ff882-2a2f-46f8-8483-f56e68111b42 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:07.529806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd7435-dec4-493c-8e93-27474b2b6757 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:07.529963 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ff882-2a2f-46f8-8483-f56e68111b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:07.530117 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd7435-dec4-493c-8e93-27474b2b6757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:07.549474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-170ff882-2a2f-46f8-8483-f56e68111b42 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:07.550795 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-170ff882-2a2f-46f8-8483-f56e68111b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:07.552356 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8fdd7435-dec4-493c-8e93-27474b2b6757 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:07.553725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8fdd7435-dec4-493c-8e93-27474b2b6757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:07.562215 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:07.616788 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1161/2322] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:07.619580 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1162/2323] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:03:07.626510 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ff882-2a2f-46f8-8483-f56e68111b42 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:07.628534 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-170ff882-2a2f-46f8-8483-f56e68111b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:07.629856 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd7435-dec4-493c-8e93-27474b2b6757 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:07.631215 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8fdd7435-dec4-493c-8e93-27474b2b6757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:07.688290 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ff882-2a2f-46f8-8483-f56e68111b42 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:07.692415 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bc0d3-2f9a-4de9-ab3b-76a88e2fe6c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:07.693050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bc0d3-2f9a-4de9-ab3b-76a88e2fe6c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:07.693327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bc0d3-2f9a-4de9-ab3b-76a88e2fe6c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:07.693602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bc0d3-2f9a-4de9-ab3b-76a88e2fe6c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:07.695752 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd7435-dec4-493c-8e93-27474b2b6757 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:07.699365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc786f-79f4-4db7-83b2-0d87f79e25f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:07.700006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc786f-79f4-4db7-83b2-0d87f79e25f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:07.700288 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc786f-79f4-4db7-83b2-0d87f79e25f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:07.700561 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc786f-79f4-4db7-83b2-0d87f79e25f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:07.703001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bc0d3-2f9a-4de9-ab3b-76a88e2fe6c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:07.704424 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bc0d3-2f9a-4de9-ab3b-76a88e2fe6c4 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:07.710240 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc786f-79f4-4db7-83b2-0d87f79e25f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:07.712418 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc786f-79f4-4db7-83b2-0d87f79e25f7 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:07.715108 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1162/2324] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:07.722324 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1163/2325] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:03:08.011401 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bc0d3-2f9a-4de9-ab3b-76a88e2fe6c4 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:08.012829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-019bc0d3-2f9a-4de9-ab3b-76a88e2fe6c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:08.014504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc786f-79f4-4db7-83b2-0d87f79e25f7 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:08.015926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6ccc786f-79f4-4db7-83b2-0d87f79e25f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:08.028390 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bc0d3-2f9a-4de9-ab3b-76a88e2fe6c4 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:08.029300 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc786f-79f4-4db7-83b2-0d87f79e25f7 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:08.034279 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:08.034708 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:08.035149 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:08.035432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:08.035718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2 admin admin] PATH_INFO: `/v3/projects/e360bd0e377f482380d6778b09931834` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:08.035953 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:08.036850 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:08.037381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce admin admin] PATH_INFO: `/v3/projects/325f2c3df67b4f6ea32cccf9e53d2d02` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:08.038916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=325f2c3df67b4f6ea32cccf9e53d2d02)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:08.041626 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:08.041745 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e360bd0e377f482380d6778b09931834)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:08.043721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:08.087783 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:08.130198 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325f2c3df67b4f6ea32cccf9e53d2d02', 'request_id': 'req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:08.138057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325f2c3df67b4f6ea32cccf9e53d2d02', 'request_id': 'req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:08.141071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e360bd0e377f482380d6778b09931834', 'request_id': 'req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:08.150406 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325f2c3df67b4f6ea32cccf9e53d2d02', 'request_id': 'req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:08.152320 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e360bd0e377f482380d6778b09931834', 'request_id': 'req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:08.160117 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e360bd0e377f482380d6778b09931834', 'request_id': 'req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:08.174993 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce admin admin] The token cache is being invalidate because project 325f2c3df67b4f6ea32cccf9e53d2d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:03:08.175580 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:08.176931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:08.180264 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1163/2326] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:03:08 2022] DELETE /identity/v3/projects/325f2c3df67b4f6ea32cccf9e53d2d02 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:08.181792 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2 admin admin] The token cache is being invalidate because project e360bd0e377f482380d6778b09931834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:03:08.182471 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:08.183620 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:08.185512 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1164/2327] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:03:08 2022] DELETE /identity/v3/projects/e360bd0e377f482380d6778b09931834 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:03:08.189399 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:08.197406 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:08.320536 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25f5f9-d5cb-4f93-b35d-9ee0a0ca37ce admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:08.433606 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8fd8b-a216-4d9d-acc9-4bff40818dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:08.434631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8fd8b-a216-4d9d-acc9-4bff40818dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:08.434912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8fd8b-a216-4d9d-acc9-4bff40818dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:08.435183 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8fd8b-a216-4d9d-acc9-4bff40818dd6 admin admin] PATH_INFO: `/v3/users/0b7a1b4748de469da23c553ba9869304` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:08.436437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8fd8b-a216-4d9d-acc9-4bff40818dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7a1b4748de469da23c553ba9869304)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:08.438465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8fd8b-a216-4d9d-acc9-4bff40818dd6 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:08.546296 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-23e8fd8b-a216-4d9d-acc9-4bff40818dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7a1b4748de469da23c553ba9869304'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:08.555575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-23e8fd8b-a216-4d9d-acc9-4bff40818dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7a1b4748de469da23c553ba9869304'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:08.565969 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-23e8fd8b-a216-4d9d-acc9-4bff40818dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7a1b4748de469da23c553ba9869304'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:08.566896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-23e8fd8b-a216-4d9d-acc9-4bff40818dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7a1b4748de469da23c553ba9869304'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:08.568080 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-23e8fd8b-a216-4d9d-acc9-4bff40818dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7a1b4748de469da23c553ba9869304'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:08.574797 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:08.601016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1164/2328] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:03:08 2022] DELETE /identity/v3/users/0b7a1b4748de469da23c553ba9869304 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:08.942884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:08.944382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:08.957761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc00d1a-fec0-4da0-a911-9f82e02aa6e2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:08.997236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:09.023353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067970c-49ac-4bc7-81eb-8e7c34b25445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:09.024296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067970c-49ac-4bc7-81eb-8e7c34b25445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:09.024501 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067970c-49ac-4bc7-81eb-8e7c34b25445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:09.024779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067970c-49ac-4bc7-81eb-8e7c34b25445 admin admin] PATH_INFO: `/v3/projects/2332c57d0c3549139df13996f0ffb2c8` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:09.026110 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067970c-49ac-4bc7-81eb-8e7c34b25445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2332c57d0c3549139df13996f0ffb2c8)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:09.028243 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067970c-49ac-4bc7-81eb-8e7c34b25445 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:09.075478 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a067970c-49ac-4bc7-81eb-8e7c34b25445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2332c57d0c3549139df13996f0ffb2c8', 'request_id': 'req-a067970c-49ac-4bc7-81eb-8e7c34b25445'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:09.081165 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a067970c-49ac-4bc7-81eb-8e7c34b25445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2332c57d0c3549139df13996f0ffb2c8', 'request_id': 'req-a067970c-49ac-4bc7-81eb-8e7c34b25445'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:09.087287 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a067970c-49ac-4bc7-81eb-8e7c34b25445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2332c57d0c3549139df13996f0ffb2c8', 'request_id': 'req-a067970c-49ac-4bc7-81eb-8e7c34b25445'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:09.099779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a067970c-49ac-4bc7-81eb-8e7c34b25445 admin admin] The token cache is being invalidate because project 2332c57d0c3549139df13996f0ffb2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:03:09.100137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a067970c-49ac-4bc7-81eb-8e7c34b25445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:09.100762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a067970c-49ac-4bc7-81eb-8e7c34b25445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:09.102303 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1165/2329] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:03:08 2022] DELETE /identity/v3/projects/2332c57d0c3549139df13996f0ffb2c8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:09.106310 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8fd8b-a216-4d9d-acc9-4bff40818dd6 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:09.108003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-23e8fd8b-a216-4d9d-acc9-4bff40818dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:09.121328 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8fd8b-a216-4d9d-acc9-4bff40818dd6 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:09.178776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5f123-a2f4-458a-b9a2-0f4c2dfac443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:09.179657 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5f123-a2f4-458a-b9a2-0f4c2dfac443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:09.179943 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5f123-a2f4-458a-b9a2-0f4c2dfac443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:09.180213 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5f123-a2f4-458a-b9a2-0f4c2dfac443 admin admin] PATH_INFO: `/v3/users/60ebebbb78ba46e0bff0931a5580c711` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:09.181399 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5f123-a2f4-458a-b9a2-0f4c2dfac443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60ebebbb78ba46e0bff0931a5580c711)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:09.183341 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5f123-a2f4-458a-b9a2-0f4c2dfac443 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:09.228260 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a1e5f123-a2f4-458a-b9a2-0f4c2dfac443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60ebebbb78ba46e0bff0931a5580c711'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:09.235444 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a1e5f123-a2f4-458a-b9a2-0f4c2dfac443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60ebebbb78ba46e0bff0931a5580c711'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:09.242467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a1e5f123-a2f4-458a-b9a2-0f4c2dfac443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60ebebbb78ba46e0bff0931a5580c711'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:09.243075 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a1e5f123-a2f4-458a-b9a2-0f4c2dfac443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60ebebbb78ba46e0bff0931a5580c711'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:09.243684 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a1e5f123-a2f4-458a-b9a2-0f4c2dfac443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60ebebbb78ba46e0bff0931a5580c711'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:09.260848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1165/2330] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:03:09 2022] DELETE /identity/v3/users/60ebebbb78ba46e0bff0931a5580c711 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:09.536098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067970c-49ac-4bc7-81eb-8e7c34b25445 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:09.537516 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a067970c-49ac-4bc7-81eb-8e7c34b25445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:09.569117 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067970c-49ac-4bc7-81eb-8e7c34b25445 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:09.626433 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2470b44-b24c-4435-b596-860606941060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:09.627333 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2470b44-b24c-4435-b596-860606941060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:09.627673 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2470b44-b24c-4435-b596-860606941060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:09.627890 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2470b44-b24c-4435-b596-860606941060 admin admin] PATH_INFO: `/v3/projects/08aa08c1ca144ecca21f22d2fb6dbbcd` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:09.629094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2470b44-b24c-4435-b596-860606941060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08aa08c1ca144ecca21f22d2fb6dbbcd)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:09.631084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2470b44-b24c-4435-b596-860606941060 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:09.683774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e2470b44-b24c-4435-b596-860606941060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08aa08c1ca144ecca21f22d2fb6dbbcd', 'request_id': 'req-e2470b44-b24c-4435-b596-860606941060'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:09.689505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e2470b44-b24c-4435-b596-860606941060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08aa08c1ca144ecca21f22d2fb6dbbcd', 'request_id': 'req-e2470b44-b24c-4435-b596-860606941060'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:09.695644 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e2470b44-b24c-4435-b596-860606941060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08aa08c1ca144ecca21f22d2fb6dbbcd', 'request_id': 'req-e2470b44-b24c-4435-b596-860606941060'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:09.704497 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:09.709156 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e2470b44-b24c-4435-b596-860606941060 admin admin] The token cache is being invalidate because project 08aa08c1ca144ecca21f22d2fb6dbbcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:03:09.709662 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e2470b44-b24c-4435-b596-860606941060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:09.710765 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e2470b44-b24c-4435-b596-860606941060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:09.712700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1166/2331] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:03:09 2022] DELETE /identity/v3/projects/08aa08c1ca144ecca21f22d2fb6dbbcd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:09.719514 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01fe03-24cc-4e2d-a6fb-968253520e9e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:09.719996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01fe03-24cc-4e2d-a6fb-968253520e9e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:09.720112 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01fe03-24cc-4e2d-a6fb-968253520e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:09.738616 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5d01fe03-24cc-4e2d-a6fb-968253520e9e None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:09.739861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5d01fe03-24cc-4e2d-a6fb-968253520e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:09.803840 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1166/2332] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:09.812622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa99f9-1fe6-4879-8351-13ab130220c2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:09.813135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa99f9-1fe6-4879-8351-13ab130220c2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:09.813416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa99f9-1fe6-4879-8351-13ab130220c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:09.834854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-bbfa99f9-1fe6-4879-8351-13ab130220c2 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:09.835894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-bbfa99f9-1fe6-4879-8351-13ab130220c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:09.847114 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1167/2333] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:09.852947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01fe03-24cc-4e2d-a6fb-968253520e9e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:09.862526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:09.867829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01fe03-24cc-4e2d-a6fb-968253520e9e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:09.874557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d1f44-ed80-41f7-81cf-71ef1c8766c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:09.875321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d1f44-ed80-41f7-81cf-71ef1c8766c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:09.875858 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d1f44-ed80-41f7-81cf-71ef1c8766c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:09.876431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d1f44-ed80-41f7-81cf-71ef1c8766c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:09.878043 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d1f44-ed80-41f7-81cf-71ef1c8766c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:03:09.878837 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d1f44-ed80-41f7-81cf-71ef1c8766c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:09.881318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d1f44-ed80-41f7-81cf-71ef1c8766c3 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:09.898230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1167/2334] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:03:09.899171 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa99f9-1fe6-4879-8351-13ab130220c2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:09.910056 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa99f9-1fe6-4879-8351-13ab130220c2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:09.916954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45906eaa-6f6c-41e8-9c71-d75bceeabfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:09.917521 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45906eaa-6f6c-41e8-9c71-d75bceeabfd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:09.917805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45906eaa-6f6c-41e8-9c71-d75bceeabfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:09.918126 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45906eaa-6f6c-41e8-9c71-d75bceeabfd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:09.918805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45906eaa-6f6c-41e8-9c71-d75bceeabfd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:09.920875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45906eaa-6f6c-41e8-9c71-d75bceeabfd4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:09.951170 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1168/2335] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:03:09 2022] POST /identity/v3/projects => generated 359 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:03:09.955578 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d1f44-ed80-41f7-81cf-71ef1c8766c3 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:09.973326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d1f44-ed80-41f7-81cf-71ef1c8766c3 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:10.037331 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646e9f5-ae38-49e1-abb2-f07e31de6da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:10.038041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646e9f5-ae38-49e1-abb2-f07e31de6da9 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:10.038371 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646e9f5-ae38-49e1-abb2-f07e31de6da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:10.038702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646e9f5-ae38-49e1-abb2-f07e31de6da9 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:10.039454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646e9f5-ae38-49e1-abb2-f07e31de6da9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:10.041378 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646e9f5-ae38-49e1-abb2-f07e31de6da9 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:10.065804 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1168/2336] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:03:09 2022] POST /identity/v3/users => generated 280 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:03:10.072957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45906eaa-6f6c-41e8-9c71-d75bceeabfd4 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:10.083734 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45906eaa-6f6c-41e8-9c71-d75bceeabfd4 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:10.088593 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd060de7-286b-4f91-992b-2c31c6c5d88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:10.089286 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd060de7-286b-4f91-992b-2c31c6c5d88a admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:10.089569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd060de7-286b-4f91-992b-2c31c6c5d88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:10.089839 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd060de7-286b-4f91-992b-2c31c6c5d88a admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:10.090621 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd060de7-286b-4f91-992b-2c31c6c5d88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:10.092190 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd060de7-286b-4f91-992b-2c31c6c5d88a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:10.104050 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1169/2337] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:03:10.108731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646e9f5-ae38-49e1-abb2-f07e31de6da9 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:10.119980 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646e9f5-ae38-49e1-abb2-f07e31de6da9 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:10.124570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40aa1a7-f9de-437a-bd8d-ed4d9bd4fe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:10.125223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40aa1a7-f9de-437a-bd8d-ed4d9bd4fe88 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:10.125503 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40aa1a7-f9de-437a-bd8d-ed4d9bd4fe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:10.125779 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40aa1a7-f9de-437a-bd8d-ed4d9bd4fe88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:10.126542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40aa1a7-f9de-437a-bd8d-ed4d9bd4fe88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:10.128740 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40aa1a7-f9de-437a-bd8d-ed4d9bd4fe88 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:10.138728 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1169/2338] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:03:10.143630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd060de7-286b-4f91-992b-2c31c6c5d88a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:10.153638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd060de7-286b-4f91-992b-2c31c6c5d88a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:10.158258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13edb5-22ae-4761-9c81-f2639137267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:10.159162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13edb5-22ae-4761-9c81-f2639137267c admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:10.159443 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13edb5-22ae-4761-9c81-f2639137267c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:10.159719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13edb5-22ae-4761-9c81-f2639137267c admin admin] PATH_INFO: `/v3/projects/9f713d58eca941fd8232b9954b863eb5/users/3445e8b9bf994bbeb2ff6ad6d9d5b196/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:10.174542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13edb5-22ae-4761-9c81-f2639137267c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f713d58eca941fd8232b9954b863eb5, user_id=3445e8b9bf994bbeb2ff6ad6d9d5b196, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:10.177193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13edb5-22ae-4761-9c81-f2639137267c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:10.190168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1170/2339] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:03:10 2022] PUT /identity/v3/projects/9f713d58eca941fd8232b9954b863eb5/users/3445e8b9bf994bbeb2ff6ad6d9d5b196/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:10.201445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce3325-0105-4e6f-9e06-e948340cd26f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:10.201754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce3325-0105-4e6f-9e06-e948340cd26f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:10.202073 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce3325-0105-4e6f-9e06-e948340cd26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:10.229705 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-dcce3325-0105-4e6f-9e06-e948340cd26f None None] MFA Rules not processed for user `3445e8b9bf994bbeb2ff6ad6d9d5b196`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:10.230942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-dcce3325-0105-4e6f-9e06-e948340cd26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:10.298420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1170/2340] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:10 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:10.333251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13edb5-22ae-4761-9c81-f2639137267c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:10.334959 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7c13edb5-22ae-4761-9c81-f2639137267c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:10.391536 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13edb5-22ae-4761-9c81-f2639137267c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:10.395255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcfd56-2452-4c94-8db5-3df2334ccd8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:10.395895 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcfd56-2452-4c94-8db5-3df2334ccd8f service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:10.396182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcfd56-2452-4c94-8db5-3df2334ccd8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:10.396467 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcfd56-2452-4c94-8db5-3df2334ccd8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:10.404687 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcfd56-2452-4c94-8db5-3df2334ccd8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:10.406145 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcfd56-2452-4c94-8db5-3df2334ccd8f service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:10.417325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1171/2341] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:10 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:10.431548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce3325-0105-4e6f-9e06-e948340cd26f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:10.495344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce3325-0105-4e6f-9e06-e948340cd26f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:10.499923 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa27e43-ab9a-4643-879f-17569324f3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:10.500786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa27e43-ab9a-4643-879f-17569324f3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:10.501071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa27e43-ab9a-4643-879f-17569324f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:10.501347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa27e43-ab9a-4643-879f-17569324f3b7 admin admin] PATH_INFO: `/v3/users/3445e8b9bf994bbeb2ff6ad6d9d5b196` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:10.503073 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa27e43-ab9a-4643-879f-17569324f3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3445e8b9bf994bbeb2ff6ad6d9d5b196)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:10.505018 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa27e43-ab9a-4643-879f-17569324f3b7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:10.506490 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:10.551261 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-afa27e43-ab9a-4643-879f-17569324f3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3445e8b9bf994bbeb2ff6ad6d9d5b196'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:10.558218 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-afa27e43-ab9a-4643-879f-17569324f3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3445e8b9bf994bbeb2ff6ad6d9d5b196'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:10.565912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-afa27e43-ab9a-4643-879f-17569324f3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3445e8b9bf994bbeb2ff6ad6d9d5b196'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:10.566589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-afa27e43-ab9a-4643-879f-17569324f3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3445e8b9bf994bbeb2ff6ad6d9d5b196'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:10.567212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-afa27e43-ab9a-4643-879f-17569324f3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3445e8b9bf994bbeb2ff6ad6d9d5b196'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:10.587116 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1171/2342] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:03:10 2022] DELETE /identity/v3/users/3445e8b9bf994bbeb2ff6ad6d9d5b196 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:10.591971 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8ee70-c00e-47d9-8d1a-63aca35d74ef None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:10.592271 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8ee70-c00e-47d9-8d1a-63aca35d74ef None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:10.592555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8ee70-c00e-47d9-8d1a-63aca35d74ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:10.611497 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-74b8ee70-c00e-47d9-8d1a-63aca35d74ef None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:10.612697 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-74b8ee70-c00e-47d9-8d1a-63aca35d74ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:10.677464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1172/2343] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:10.687677 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa27e43-ab9a-4643-879f-17569324f3b7 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:10.689129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-afa27e43-ab9a-4643-879f-17569324f3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:10.747760 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa27e43-ab9a-4643-879f-17569324f3b7 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:10.752429 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80704f-9d9e-46b0-a187-c76ed004659a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:10.753646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80704f-9d9e-46b0-a187-c76ed004659a service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:10.754077 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80704f-9d9e-46b0-a187-c76ed004659a service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:10.754397 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80704f-9d9e-46b0-a187-c76ed004659a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:10.765128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80704f-9d9e-46b0-a187-c76ed004659a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:10.766701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80704f-9d9e-46b0-a187-c76ed004659a service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:10.777456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1172/2344] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:11.136881 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8ee70-c00e-47d9-8d1a-63aca35d74ef None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:11.138729 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-74b8ee70-c00e-47d9-8d1a-63aca35d74ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:11.155743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8ee70-c00e-47d9-8d1a-63aca35d74ef None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:11.173755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179cfa9-11d1-4cfa-84bb-5499a71c5f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:11.174959 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179cfa9-11d1-4cfa-84bb-5499a71c5f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:11.175395 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179cfa9-11d1-4cfa-84bb-5499a71c5f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:11.175872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179cfa9-11d1-4cfa-84bb-5499a71c5f2e admin admin] PATH_INFO: `/v3/projects/9f713d58eca941fd8232b9954b863eb5` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:11.178167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179cfa9-11d1-4cfa-84bb-5499a71c5f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f713d58eca941fd8232b9954b863eb5)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:11.182181 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179cfa9-11d1-4cfa-84bb-5499a71c5f2e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:11.233420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:11.245755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3179cfa9-11d1-4cfa-84bb-5499a71c5f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f713d58eca941fd8232b9954b863eb5', 'request_id': 'req-3179cfa9-11d1-4cfa-84bb-5499a71c5f2e'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:11.251603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3179cfa9-11d1-4cfa-84bb-5499a71c5f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f713d58eca941fd8232b9954b863eb5', 'request_id': 'req-3179cfa9-11d1-4cfa-84bb-5499a71c5f2e'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:11.257818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3179cfa9-11d1-4cfa-84bb-5499a71c5f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f713d58eca941fd8232b9954b863eb5', 'request_id': 'req-3179cfa9-11d1-4cfa-84bb-5499a71c5f2e'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:11.271988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3179cfa9-11d1-4cfa-84bb-5499a71c5f2e admin admin] The token cache is being invalidate because project 9f713d58eca941fd8232b9954b863eb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:03:11.272276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3179cfa9-11d1-4cfa-84bb-5499a71c5f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:11.272984 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-3179cfa9-11d1-4cfa-84bb-5499a71c5f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:11.275084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1173/2345] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:03:11 2022] DELETE /identity/v3/projects/9f713d58eca941fd8232b9954b863eb5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:11.279913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fe7e3-bbf2-4a88-b4e5-2bb8c3580783 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:11.280203 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fe7e3-bbf2-4a88-b4e5-2bb8c3580783 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:11.280477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fe7e3-bbf2-4a88-b4e5-2bb8c3580783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:11.299047 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-a69fe7e3-bbf2-4a88-b4e5-2bb8c3580783 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:11.300365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a69fe7e3-bbf2-4a88-b4e5-2bb8c3580783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:11.364731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1173/2346] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:11.372556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae51067-305d-4a16-b3c3-2721fa5a8e94 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:11.372851 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae51067-305d-4a16-b3c3-2721fa5a8e94 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:11.373189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae51067-305d-4a16-b3c3-2721fa5a8e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:11.392354 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3ae51067-305d-4a16-b3c3-2721fa5a8e94 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:11.393655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3ae51067-305d-4a16-b3c3-2721fa5a8e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:11.402100 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1174/2347] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:11.406669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fe7e3-bbf2-4a88-b4e5-2bb8c3580783 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:11.434501 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fe7e3-bbf2-4a88-b4e5-2bb8c3580783 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:11.439702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89394d92-499d-42bc-ad0b-44d365a2ba50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:11.440165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89394d92-499d-42bc-ad0b-44d365a2ba50 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:11.440449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89394d92-499d-42bc-ad0b-44d365a2ba50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:11.440726 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89394d92-499d-42bc-ad0b-44d365a2ba50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:11.441449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89394d92-499d-42bc-ad0b-44d365a2ba50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:03:11.441755 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89394d92-499d-42bc-ad0b-44d365a2ba50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:11.443429 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89394d92-499d-42bc-ad0b-44d365a2ba50 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:11.458239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1174/2348] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:03:11.462763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae51067-305d-4a16-b3c3-2721fa5a8e94 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:11.474027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae51067-305d-4a16-b3c3-2721fa5a8e94 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:11.479746 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c5abb-feab-4ab2-a342-be7ae80d2390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:11.480596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c5abb-feab-4ab2-a342-be7ae80d2390 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:11.480920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c5abb-feab-4ab2-a342-be7ae80d2390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:11.481313 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c5abb-feab-4ab2-a342-be7ae80d2390 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:11.482396 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c5abb-feab-4ab2-a342-be7ae80d2390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:11.484326 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c5abb-feab-4ab2-a342-be7ae80d2390 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:11.512818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1175/2349] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:03:11 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:03:11.516920 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89394d92-499d-42bc-ad0b-44d365a2ba50 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:11.527538 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89394d92-499d-42bc-ad0b-44d365a2ba50 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:11.532335 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:11.595459 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59178cd6-8f77-43f7-81b7-64e1047a1fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:11.596158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59178cd6-8f77-43f7-81b7-64e1047a1fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:11.596433 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59178cd6-8f77-43f7-81b7-64e1047a1fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:11.596713 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59178cd6-8f77-43f7-81b7-64e1047a1fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:11.597389 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59178cd6-8f77-43f7-81b7-64e1047a1fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:11.599384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59178cd6-8f77-43f7-81b7-64e1047a1fc0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:11.621597 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1175/2350] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:03:11 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:03:11.625542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c5abb-feab-4ab2-a342-be7ae80d2390 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:11.637361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c5abb-feab-4ab2-a342-be7ae80d2390 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:11.642745 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c4659-f4c9-4151-849e-4fb08ab17ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:11.643428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c4659-f4c9-4151-849e-4fb08ab17ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:11.643709 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c4659-f4c9-4151-849e-4fb08ab17ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:11.643980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c4659-f4c9-4151-849e-4fb08ab17ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:11.644760 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c4659-f4c9-4151-849e-4fb08ab17ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:11.646421 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c4659-f4c9-4151-849e-4fb08ab17ab8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:11.657107 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1176/2351] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:03:11.661572 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59178cd6-8f77-43f7-81b7-64e1047a1fc0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:11.672051 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59178cd6-8f77-43f7-81b7-64e1047a1fc0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:11.677387 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1eaa87-d018-42eb-9d20-6aec00526305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:11.678125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1eaa87-d018-42eb-9d20-6aec00526305 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:11.678546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1eaa87-d018-42eb-9d20-6aec00526305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:11.678823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1eaa87-d018-42eb-9d20-6aec00526305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:11.679551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1eaa87-d018-42eb-9d20-6aec00526305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:11.681186 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1eaa87-d018-42eb-9d20-6aec00526305 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:11.692622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1176/2352] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:03:11.702596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c4659-f4c9-4151-849e-4fb08ab17ab8 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:11.708475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c4659-f4c9-4151-849e-4fb08ab17ab8 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:11.713153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a25d2f-2351-4eb3-8d09-1888b8b00326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:11.714060 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a25d2f-2351-4eb3-8d09-1888b8b00326 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:11.714344 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a25d2f-2351-4eb3-8d09-1888b8b00326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:11.714622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a25d2f-2351-4eb3-8d09-1888b8b00326 admin admin] PATH_INFO: `/v3/projects/f6a0be9be313454284f3f30403ec73b6/users/75ce68830ab447fb929b50a05150e6d8/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:11.729002 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a25d2f-2351-4eb3-8d09-1888b8b00326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a0be9be313454284f3f30403ec73b6, user_id=75ce68830ab447fb929b50a05150e6d8, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:11.731677 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a25d2f-2351-4eb3-8d09-1888b8b00326 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:11.744500 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1177/2353] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:03:11 2022] PUT /identity/v3/projects/f6a0be9be313454284f3f30403ec73b6/users/75ce68830ab447fb929b50a05150e6d8/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:11.756018 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f5a7f-5312-4e5f-8419-e1f20833c704 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:11.756482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f5a7f-5312-4e5f-8419-e1f20833c704 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:11.756588 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f5a7f-5312-4e5f-8419-e1f20833c704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:11.786759 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b35f5a7f-5312-4e5f-8419-e1f20833c704 None None] MFA Rules not processed for user `75ce68830ab447fb929b50a05150e6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:11.788204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b35f5a7f-5312-4e5f-8419-e1f20833c704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:11.854292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1177/2354] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:11.866643 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a25d2f-2351-4eb3-8d09-1888b8b00326 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:11.868343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-13a25d2f-2351-4eb3-8d09-1888b8b00326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:11.923234 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a25d2f-2351-4eb3-8d09-1888b8b00326 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:11.927449 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3ba90-5e91-4ae7-94a3-d538e1f6fd15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a3c022963e74e989a703938ff057757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:11.928176 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3ba90-5e91-4ae7-94a3-d538e1f6fd15 service glance] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:11.928366 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3ba90-5e91-4ae7-94a3-d538e1f6fd15 service glance] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:11.928637 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3ba90-5e91-4ae7-94a3-d538e1f6fd15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:11.938403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3ba90-5e91-4ae7-94a3-d538e1f6fd15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:11.940375 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3ba90-5e91-4ae7-94a3-d538e1f6fd15 service glance] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:11.949558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1178/2355] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:11 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:13.560279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f5a7f-5312-4e5f-8419-e1f20833c704 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:13.561738 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b35f5a7f-5312-4e5f-8419-e1f20833c704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:13.627525 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f5a7f-5312-4e5f-8419-e1f20833c704 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:13.632314 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d0f1a-74e7-46c8-b941-4e4ece741ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:13.633419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d0f1a-74e7-46c8-b941-4e4ece741ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:13.633811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d0f1a-74e7-46c8-b941-4e4ece741ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:13.634226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d0f1a-74e7-46c8-b941-4e4ece741ba1 admin admin] PATH_INFO: `/v3/users/f20eaed1ee4c4c5ab3c43c326221759c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:13.635537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d0f1a-74e7-46c8-b941-4e4ece741ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f20eaed1ee4c4c5ab3c43c326221759c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:13.637486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d0f1a-74e7-46c8-b941-4e4ece741ba1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:13.659127 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:13.684945 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-651d0f1a-74e7-46c8-b941-4e4ece741ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f20eaed1ee4c4c5ab3c43c326221759c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:13.692182 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-651d0f1a-74e7-46c8-b941-4e4ece741ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f20eaed1ee4c4c5ab3c43c326221759c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:13.699550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-651d0f1a-74e7-46c8-b941-4e4ece741ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f20eaed1ee4c4c5ab3c43c326221759c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:13.700295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-651d0f1a-74e7-46c8-b941-4e4ece741ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f20eaed1ee4c4c5ab3c43c326221759c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:13.700980 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-651d0f1a-74e7-46c8-b941-4e4ece741ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f20eaed1ee4c4c5ab3c43c326221759c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:13.719743 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1178/2356] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:03:13 2022] DELETE /identity/v3/users/f20eaed1ee4c4c5ab3c43c326221759c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:13.724005 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe8d61-1c43-48fd-bb30-4758c072da3d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:13.724458 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe8d61-1c43-48fd-bb30-4758c072da3d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:13.724564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe8d61-1c43-48fd-bb30-4758c072da3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:13.743216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-79fe8d61-1c43-48fd-bb30-4758c072da3d None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:13.744422 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-79fe8d61-1c43-48fd-bb30-4758c072da3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:13.802342 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1179/2357] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:13.811777 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d0f1a-74e7-46c8-b941-4e4ece741ba1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:13.813155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-651d0f1a-74e7-46c8-b941-4e4ece741ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:13.873119 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d0f1a-74e7-46c8-b941-4e4ece741ba1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:13.876756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150837e-2113-4d49-8b90-cfc5ba61234b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:13.877951 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150837e-2113-4d49-8b90-cfc5ba61234b service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:13.878190 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150837e-2113-4d49-8b90-cfc5ba61234b service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:13.878465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150837e-2113-4d49-8b90-cfc5ba61234b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:13.887846 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150837e-2113-4d49-8b90-cfc5ba61234b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:13.889429 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150837e-2113-4d49-8b90-cfc5ba61234b service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:13.900587 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1179/2358] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:14.421425 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe8d61-1c43-48fd-bb30-4758c072da3d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:14.422988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-79fe8d61-1c43-48fd-bb30-4758c072da3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:14.431002 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:14.436896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe8d61-1c43-48fd-bb30-4758c072da3d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:14.443614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edcbbf-451b-4c83-a106-4fd07dc81d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:14.444632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edcbbf-451b-4c83-a106-4fd07dc81d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:14.444885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edcbbf-451b-4c83-a106-4fd07dc81d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:14.445241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edcbbf-451b-4c83-a106-4fd07dc81d62 admin admin] PATH_INFO: `/v3/projects/d4ad87642fb14460a027c6a187af1bd9` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:14.447508 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edcbbf-451b-4c83-a106-4fd07dc81d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ad87642fb14460a027c6a187af1bd9)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:14.449758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edcbbf-451b-4c83-a106-4fd07dc81d62 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:14.497465 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-69edcbbf-451b-4c83-a106-4fd07dc81d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ad87642fb14460a027c6a187af1bd9', 'request_id': 'req-69edcbbf-451b-4c83-a106-4fd07dc81d62'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:14.503503 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-69edcbbf-451b-4c83-a106-4fd07dc81d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ad87642fb14460a027c6a187af1bd9', 'request_id': 'req-69edcbbf-451b-4c83-a106-4fd07dc81d62'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:14.509795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-69edcbbf-451b-4c83-a106-4fd07dc81d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ad87642fb14460a027c6a187af1bd9', 'request_id': 'req-69edcbbf-451b-4c83-a106-4fd07dc81d62'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:14.524146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-69edcbbf-451b-4c83-a106-4fd07dc81d62 admin admin] The token cache is being invalidate because project d4ad87642fb14460a027c6a187af1bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:03:14.524379 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-69edcbbf-451b-4c83-a106-4fd07dc81d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:14.525003 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-69edcbbf-451b-4c83-a106-4fd07dc81d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:14.530220 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1180/2359] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:03:14 2022] DELETE /identity/v3/projects/d4ad87642fb14460a027c6a187af1bd9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:14.531746 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09601105-e194-4026-a74e-2d826316ecd4 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:14.532038 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09601105-e194-4026-a74e-2d826316ecd4 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:14.532527 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09601105-e194-4026-a74e-2d826316ecd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:14.553384 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-09601105-e194-4026-a74e-2d826316ecd4 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:14.554700 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-09601105-e194-4026-a74e-2d826316ecd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:14.619330 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1180/2360] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:14.628522 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ddd97-89db-4454-8d93-b56878087139 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:14.628817 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ddd97-89db-4454-8d93-b56878087139 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:14.629128 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ddd97-89db-4454-8d93-b56878087139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:14.648988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a47ddd97-89db-4454-8d93-b56878087139 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:14.650239 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a47ddd97-89db-4454-8d93-b56878087139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:14.663345 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1181/2361] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:14.664665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09601105-e194-4026-a74e-2d826316ecd4 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:14.674277 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09601105-e194-4026-a74e-2d826316ecd4 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:14.680931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981aa05-b4a9-4b61-b323-6d8cacec1fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:14.681627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981aa05-b4a9-4b61-b323-6d8cacec1fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:14.681909 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981aa05-b4a9-4b61-b323-6d8cacec1fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:14.682216 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981aa05-b4a9-4b61-b323-6d8cacec1fe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:14.683009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981aa05-b4a9-4b61-b323-6d8cacec1fe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:03:14.683322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981aa05-b4a9-4b61-b323-6d8cacec1fe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:14.685606 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981aa05-b4a9-4b61-b323-6d8cacec1fe6 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:14.702214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1181/2362] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:03:14.707382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ddd97-89db-4454-8d93-b56878087139 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:14.717423 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ddd97-89db-4454-8d93-b56878087139 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:14.722259 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1601a92-3876-4b5b-b271-5375bc395b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:14.722949 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1601a92-3876-4b5b-b271-5375bc395b65 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:14.723269 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1601a92-3876-4b5b-b271-5375bc395b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:14.723506 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1601a92-3876-4b5b-b271-5375bc395b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:14.724204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1601a92-3876-4b5b-b271-5375bc395b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:14.726156 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1601a92-3876-4b5b-b271-5375bc395b65 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:14.759020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1182/2363] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:03:14 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:03:14.760287 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981aa05-b4a9-4b61-b323-6d8cacec1fe6 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:14.775024 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981aa05-b4a9-4b61-b323-6d8cacec1fe6 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:14.807890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:14.844855 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ceee42-14f1-4abc-a567-14fc9b73cd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:14.845536 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceee42-14f1-4abc-a567-14fc9b73cd3d admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:14.845876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceee42-14f1-4abc-a567-14fc9b73cd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:14.846183 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceee42-14f1-4abc-a567-14fc9b73cd3d admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:14.846927 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ceee42-14f1-4abc-a567-14fc9b73cd3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:14.849006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ceee42-14f1-4abc-a567-14fc9b73cd3d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:14.873731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1182/2364] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:03:14 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:03:14.877556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1601a92-3876-4b5b-b271-5375bc395b65 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:14.888305 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1601a92-3876-4b5b-b271-5375bc395b65 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:14.894037 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985bfb1-e2c0-468b-aa61-9398742350f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:14.894700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985bfb1-e2c0-468b-aa61-9398742350f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:14.895158 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985bfb1-e2c0-468b-aa61-9398742350f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:14.895599 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985bfb1-e2c0-468b-aa61-9398742350f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:14.896331 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985bfb1-e2c0-468b-aa61-9398742350f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:14.897965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985bfb1-e2c0-468b-aa61-9398742350f2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:14.909660 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1183/2365] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:03:14.921727 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ceee42-14f1-4abc-a567-14fc9b73cd3d admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:14.932714 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ceee42-14f1-4abc-a567-14fc9b73cd3d admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:14.938207 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb015bd-ebad-44d4-b99e-b2b8088bc663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:14.938895 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb015bd-ebad-44d4-b99e-b2b8088bc663 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:14.939176 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb015bd-ebad-44d4-b99e-b2b8088bc663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:14.940382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb015bd-ebad-44d4-b99e-b2b8088bc663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:14.940955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb015bd-ebad-44d4-b99e-b2b8088bc663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:14.943173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb015bd-ebad-44d4-b99e-b2b8088bc663 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:14.954598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1183/2366] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:03:14.959293 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985bfb1-e2c0-468b-aa61-9398742350f2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:14.970021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985bfb1-e2c0-468b-aa61-9398742350f2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:14.975991 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9401f3-9ae8-4a46-bda6-80a1722b286c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:14.977631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9401f3-9ae8-4a46-bda6-80a1722b286c admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:14.978249 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9401f3-9ae8-4a46-bda6-80a1722b286c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:14.978718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9401f3-9ae8-4a46-bda6-80a1722b286c admin admin] PATH_INFO: `/v3/projects/9fb8bc49b4b5414f992be1c603f28f11/users/e04e9fe3a52a43ab913c8e4ce8ecb323/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:14.996071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9401f3-9ae8-4a46-bda6-80a1722b286c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb8bc49b4b5414f992be1c603f28f11, user_id=e04e9fe3a52a43ab913c8e4ce8ecb323, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:14.999297 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9401f3-9ae8-4a46-bda6-80a1722b286c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:15.015029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1184/2367] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:03:14 2022] PUT /identity/v3/projects/9fb8bc49b4b5414f992be1c603f28f11/users/e04e9fe3a52a43ab913c8e4ce8ecb323/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:15.025354 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967410e3-8878-4578-8910-eed284341044 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:15.025559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967410e3-8878-4578-8910-eed284341044 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:15.025840 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967410e3-8878-4578-8910-eed284341044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:15.053531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-967410e3-8878-4578-8910-eed284341044 None None] MFA Rules not processed for user `e04e9fe3a52a43ab913c8e4ce8ecb323`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:15.054824 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-967410e3-8878-4578-8910-eed284341044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:15.145575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1184/2368] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:15.162692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9401f3-9ae8-4a46-bda6-80a1722b286c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:15.164689 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0b9401f3-9ae8-4a46-bda6-80a1722b286c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:15.239599 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9401f3-9ae8-4a46-bda6-80a1722b286c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:15.247169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a8803-a97d-4d94-919a-fc2f85306b1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:15.249269 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a8803-a97d-4d94-919a-fc2f85306b1f service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:15.249577 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a8803-a97d-4d94-919a-fc2f85306b1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:15.249854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a8803-a97d-4d94-919a-fc2f85306b1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:15.260546 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a8803-a97d-4d94-919a-fc2f85306b1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:15.262028 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a8803-a97d-4d94-919a-fc2f85306b1f service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:15.272923 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1185/2369] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:03:16.027663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7753-0252-4a89-b850-70730dd353a2 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:16.028159 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7753-0252-4a89-b850-70730dd353a2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:16.028334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7753-0252-4a89-b850-70730dd353a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:16.045784 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-afeb7753-0252-4a89-b850-70730dd353a2 None None] MFA Rules not processed for user `bd1a33ca9f5144c69a66affd662bb9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:16.047024 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-afeb7753-0252-4a89-b850-70730dd353a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:16.104319 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1185/2370] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:25.268012 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:25.533503 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a8803-a97d-4d94-919a-fc2f85306b1f service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:25.606157 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a8803-a97d-4d94-919a-fc2f85306b1f service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:25.612356 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53f504-05da-4281-acad-644003a62e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:25.613302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f504-05da-4281-acad-644003a62e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:25.613583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f504-05da-4281-acad-644003a62e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:25.613910 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f504-05da-4281-acad-644003a62e30 admin admin] PATH_INFO: `/v3/users/e04e9fe3a52a43ab913c8e4ce8ecb323` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:25.615107 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53f504-05da-4281-acad-644003a62e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04e9fe3a52a43ab913c8e4ce8ecb323)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:25.616993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53f504-05da-4281-acad-644003a62e30 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:25.672933 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ed53f504-05da-4281-acad-644003a62e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04e9fe3a52a43ab913c8e4ce8ecb323'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:25.682553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ed53f504-05da-4281-acad-644003a62e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04e9fe3a52a43ab913c8e4ce8ecb323'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:25.683320 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ed53f504-05da-4281-acad-644003a62e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04e9fe3a52a43ab913c8e4ce8ecb323'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:25.691975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ed53f504-05da-4281-acad-644003a62e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04e9fe3a52a43ab913c8e4ce8ecb323'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:25.692619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-ed53f504-05da-4281-acad-644003a62e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04e9fe3a52a43ab913c8e4ce8ecb323'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:25.710541 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1186/2371] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:03:25 2022] DELETE /identity/v3/users/e04e9fe3a52a43ab913c8e4ce8ecb323 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:25.715733 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f45dd0-d993-43a0-ad25-7fde5d6b5241 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:25.716206 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f45dd0-d993-43a0-ad25-7fde5d6b5241 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:25.716300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f45dd0-d993-43a0-ad25-7fde5d6b5241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:25.734130 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-93f45dd0-d993-43a0-ad25-7fde5d6b5241 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:25.736464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-93f45dd0-d993-43a0-ad25-7fde5d6b5241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:25.774970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:25.801996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1186/2372] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:25.811616 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53f504-05da-4281-acad-644003a62e30 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:25.813002 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ed53f504-05da-4281-acad-644003a62e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:25.873052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53f504-05da-4281-acad-644003a62e30 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:25.877202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303718ac-9aea-46c5-8a35-4ec3a946dc60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:25.877996 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303718ac-9aea-46c5-8a35-4ec3a946dc60 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:25.878284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303718ac-9aea-46c5-8a35-4ec3a946dc60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:25.878564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303718ac-9aea-46c5-8a35-4ec3a946dc60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:25.887859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303718ac-9aea-46c5-8a35-4ec3a946dc60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:25.889290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303718ac-9aea-46c5-8a35-4ec3a946dc60 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:25.899519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1187/2373] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:26.183443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f45dd0-d993-43a0-ad25-7fde5d6b5241 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:26.184933 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-93f45dd0-d993-43a0-ad25-7fde5d6b5241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:26.198170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f45dd0-d993-43a0-ad25-7fde5d6b5241 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:26.202662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57b4fe-521b-4a2e-96e1-63ca479b9253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:26.205956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57b4fe-521b-4a2e-96e1-63ca479b9253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:26.205956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57b4fe-521b-4a2e-96e1-63ca479b9253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:26.205956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57b4fe-521b-4a2e-96e1-63ca479b9253 admin admin] PATH_INFO: `/v3/projects/9fb8bc49b4b5414f992be1c603f28f11` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:26.205956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57b4fe-521b-4a2e-96e1-63ca479b9253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb8bc49b4b5414f992be1c603f28f11)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:26.208049 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57b4fe-521b-4a2e-96e1-63ca479b9253 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:26.268331 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4c57b4fe-521b-4a2e-96e1-63ca479b9253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb8bc49b4b5414f992be1c603f28f11', 'request_id': 'req-4c57b4fe-521b-4a2e-96e1-63ca479b9253'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:26.274604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4c57b4fe-521b-4a2e-96e1-63ca479b9253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb8bc49b4b5414f992be1c603f28f11', 'request_id': 'req-4c57b4fe-521b-4a2e-96e1-63ca479b9253'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:26.280627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4c57b4fe-521b-4a2e-96e1-63ca479b9253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb8bc49b4b5414f992be1c603f28f11', 'request_id': 'req-4c57b4fe-521b-4a2e-96e1-63ca479b9253'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:26.293551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4c57b4fe-521b-4a2e-96e1-63ca479b9253 admin admin] The token cache is being invalidate because project 9fb8bc49b4b5414f992be1c603f28f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:03:26.294003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4c57b4fe-521b-4a2e-96e1-63ca479b9253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:26.294628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4c57b4fe-521b-4a2e-96e1-63ca479b9253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:26.296185 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1187/2374] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:03:26 2022] DELETE /identity/v3/projects/9fb8bc49b4b5414f992be1c603f28f11 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:28.292906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225c3ac-20cd-48c7-a0a4-9f130c9ab12f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:28.293451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225c3ac-20cd-48c7-a0a4-9f130c9ab12f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:28.293725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225c3ac-20cd-48c7-a0a4-9f130c9ab12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:28.313165 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c225c3ac-20cd-48c7-a0a4-9f130c9ab12f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:28.314454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c225c3ac-20cd-48c7-a0a4-9f130c9ab12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:28.335819 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:28.384851 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1188/2375] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Jun 7 22:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:28.401741 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57b4fe-521b-4a2e-96e1-63ca479b9253 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:28.403299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4c57b4fe-521b-4a2e-96e1-63ca479b9253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:28.481565 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57b4fe-521b-4a2e-96e1-63ca479b9253 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:28.487569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5b684-e9dc-44ae-9061-c2e71255560b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:28.488835 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5b684-e9dc-44ae-9061-c2e71255560b service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:28.488835 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5b684-e9dc-44ae-9061-c2e71255560b service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:28.488835 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5b684-e9dc-44ae-9061-c2e71255560b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:28.498150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5b684-e9dc-44ae-9061-c2e71255560b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:28.499719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5b684-e9dc-44ae-9061-c2e71255560b service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:28.514099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1188/2376] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:31.183370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fa3c2-c6a5-4429-9c06-94d1b81e5946 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:31.183881 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fa3c2-c6a5-4429-9c06-94d1b81e5946 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:31.184005 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fa3c2-c6a5-4429-9c06-94d1b81e5946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:31.201761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-703fa3c2-c6a5-4429-9c06-94d1b81e5946 None None] MFA Rules not processed for user `4ba5f51282f548cbbcf0dcaf8fbb4cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:31.203027 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-703fa3c2-c6a5-4429-9c06-94d1b81e5946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:31.262183 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1189/2377] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:32.857790 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0886a-2c2d-409f-9288-2b9771a5f3c4 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:32.858286 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0886a-2c2d-409f-9288-2b9771a5f3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:32.858369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0886a-2c2d-409f-9288-2b9771a5f3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:32.876747 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c5c0886a-2c2d-409f-9288-2b9771a5f3c4 None None] MFA Rules not processed for user `4fc55e3a9107489a9b24385ac5379ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:32.878445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c5c0886a-2c2d-409f-9288-2b9771a5f3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:32.933007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:32.946034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1189/2378] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 7 22:03:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:33.000427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fa3c2-c6a5-4429-9c06-94d1b81e5946 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:33.002038 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-703fa3c2-c6a5-4429-9c06-94d1b81e5946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:33.081815 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fa3c2-c6a5-4429-9c06-94d1b81e5946 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:33.087801 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6641d7-1a58-43e5-9d9c-e0a5ef0c0060 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b69c708fbc470aae3e3954e21a1e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:33.088542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6641d7-1a58-43e5-9d9c-e0a5ef0c0060 service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:33.089747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6641d7-1a58-43e5-9d9c-e0a5ef0c0060 service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:33.090066 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6641d7-1a58-43e5-9d9c-e0a5ef0c0060 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:33.099347 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6641d7-1a58-43e5-9d9c-e0a5ef0c0060 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:33.100994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6641d7-1a58-43e5-9d9c-e0a5ef0c0060 service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:33.109445 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1190/2379] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 7 22:03:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 22:03:33.263537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2c984-58a4-4dd6-a69f-41aef5be242c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:33.263727 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2c984-58a4-4dd6-a69f-41aef5be242c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:33.264011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2c984-58a4-4dd6-a69f-41aef5be242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:33.283224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-62f2c984-58a4-4dd6-a69f-41aef5be242c None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:33.284737 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-62f2c984-58a4-4dd6-a69f-41aef5be242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:33.293090 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1190/2380] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Jun 7 22:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:33.333179 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6641d7-1a58-43e5-9d9c-e0a5ef0c0060 service swift] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:33.334731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9b6641d7-1a58-43e5-9d9c-e0a5ef0c0060 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:33.351442 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6641d7-1a58-43e5-9d9c-e0a5ef0c0060 service swift] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:33.369137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90759fe-ab5d-4b29-bfa1-b24daae53a2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:33.370738 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90759fe-ab5d-4b29-bfa1-b24daae53a2a service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:33.371232 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90759fe-ab5d-4b29-bfa1-b24daae53a2a service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:33.371514 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90759fe-ab5d-4b29-bfa1-b24daae53a2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:33.385391 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90759fe-ab5d-4b29-bfa1-b24daae53a2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:33.387398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90759fe-ab5d-4b29-bfa1-b24daae53a2a service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:33.402659 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1191/2381] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:36.810333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d45b3-62e0-43e0-96cd-ae8d878ebfa6 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:36.811230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d45b3-62e0-43e0-96cd-ae8d878ebfa6 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:36.811671 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d45b3-62e0-43e0-96cd-ae8d878ebfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:36.929335 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f36d45b3-62e0-43e0-96cd-ae8d878ebfa6 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:36.931092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f36d45b3-62e0-43e0-96cd-ae8d878ebfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:37.021163 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1191/2382] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Jun 7 22:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:37.042073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90759fe-ab5d-4b29-bfa1-b24daae53a2a service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:37.098221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90759fe-ab5d-4b29-bfa1-b24daae53a2a service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:37.105978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a73911-22ab-4921-9f8b-27ad580dad00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:37.106965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a73911-22ab-4921-9f8b-27ad580dad00 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:37.107867 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a73911-22ab-4921-9f8b-27ad580dad00 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:37.108357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a73911-22ab-4921-9f8b-27ad580dad00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:37.120092 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a73911-22ab-4921-9f8b-27ad580dad00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:37.122240 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a73911-22ab-4921-9f8b-27ad580dad00 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:37.129328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:37.137257 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1192/2383] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:40.907338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec202f6-aa41-47eb-bdac-ca1c8a1101d2 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:40.908417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec202f6-aa41-47eb-bdac-ca1c8a1101d2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:40.908777 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec202f6-aa41-47eb-bdac-ca1c8a1101d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:40.931317 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1ec202f6-aa41-47eb-bdac-ca1c8a1101d2 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:40.933144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1ec202f6-aa41-47eb-bdac-ca1c8a1101d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:40.944126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1192/2384] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Jun 7 22:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:40.971231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a73911-22ab-4921-9f8b-27ad580dad00 service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:40.984941 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a73911-22ab-4921-9f8b-27ad580dad00 service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:40.991664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665686ff-45c8-43c2-b8cb-4acce9388ae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:40.993232 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665686ff-45c8-43c2-b8cb-4acce9388ae7 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:40.993988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665686ff-45c8-43c2-b8cb-4acce9388ae7 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:40.994430 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665686ff-45c8-43c2-b8cb-4acce9388ae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:41.004699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665686ff-45c8-43c2-b8cb-4acce9388ae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:41.006538 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665686ff-45c8-43c2-b8cb-4acce9388ae7 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:41.030492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1193/2385] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:42.321845 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec202f6-aa41-47eb-bdac-ca1c8a1101d2 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:42.323470 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1ec202f6-aa41-47eb-bdac-ca1c8a1101d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:42.338989 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec202f6-aa41-47eb-bdac-ca1c8a1101d2 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:42.344145 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375e00e-71af-4215-b9a4-b6afe04a4b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:42.345672 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375e00e-71af-4215-b9a4-b6afe04a4b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:42.346087 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375e00e-71af-4215-b9a4-b6afe04a4b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:42.346613 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375e00e-71af-4215-b9a4-b6afe04a4b3b admin admin] PATH_INFO: `/v3/users/75ce68830ab447fb929b50a05150e6d8` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:42.348120 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375e00e-71af-4215-b9a4-b6afe04a4b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ce68830ab447fb929b50a05150e6d8)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:42.356190 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375e00e-71af-4215-b9a4-b6afe04a4b3b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:42.434586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8375e00e-71af-4215-b9a4-b6afe04a4b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ce68830ab447fb929b50a05150e6d8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:42.445150 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8375e00e-71af-4215-b9a4-b6afe04a4b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ce68830ab447fb929b50a05150e6d8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:42.459270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8375e00e-71af-4215-b9a4-b6afe04a4b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ce68830ab447fb929b50a05150e6d8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:42.460035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8375e00e-71af-4215-b9a4-b6afe04a4b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ce68830ab447fb929b50a05150e6d8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:42.460728 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8375e00e-71af-4215-b9a4-b6afe04a4b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ce68830ab447fb929b50a05150e6d8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:42.481748 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1193/2386] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:03:42 2022] DELETE /identity/v3/users/75ce68830ab447fb929b50a05150e6d8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:42.486943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8098f1-6c39-4c4b-a20b-17365e0af898 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:42.487457 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8098f1-6c39-4c4b-a20b-17365e0af898 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:42.487965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8098f1-6c39-4c4b-a20b-17365e0af898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:42.528306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6a8098f1-6c39-4c4b-a20b-17365e0af898 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:42.529726 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6a8098f1-6c39-4c4b-a20b-17365e0af898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:42.628206 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375e00e-71af-4215-b9a4-b6afe04a4b3b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:42.629727 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8375e00e-71af-4215-b9a4-b6afe04a4b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:42.630949 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1194/2387] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:42.675013 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:42.762827 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375e00e-71af-4215-b9a4-b6afe04a4b3b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:42.766961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843c6ea-f3db-43e3-95a4-185e6e2f2c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:42.767754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843c6ea-f3db-43e3-95a4-185e6e2f2c17 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:42.768045 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843c6ea-f3db-43e3-95a4-185e6e2f2c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:42.768322 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843c6ea-f3db-43e3-95a4-185e6e2f2c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:42.784452 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843c6ea-f3db-43e3-95a4-185e6e2f2c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:42.786852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843c6ea-f3db-43e3-95a4-185e6e2f2c17 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:42.805328 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1194/2388] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:43.183841 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8098f1-6c39-4c4b-a20b-17365e0af898 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:43.185777 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6a8098f1-6c39-4c4b-a20b-17365e0af898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:43.200240 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8098f1-6c39-4c4b-a20b-17365e0af898 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:43.205817 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ccb7a-3494-4907-8783-447438b7684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:43.206794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ccb7a-3494-4907-8783-447438b7684f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:43.207147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ccb7a-3494-4907-8783-447438b7684f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:43.207499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ccb7a-3494-4907-8783-447438b7684f admin admin] PATH_INFO: `/v3/projects/f6a0be9be313454284f3f30403ec73b6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:43.208872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ccb7a-3494-4907-8783-447438b7684f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a0be9be313454284f3f30403ec73b6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:43.212237 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ccb7a-3494-4907-8783-447438b7684f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:43.278000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e59ccb7a-3494-4907-8783-447438b7684f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a0be9be313454284f3f30403ec73b6', 'request_id': 'req-e59ccb7a-3494-4907-8783-447438b7684f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:43.285422 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e59ccb7a-3494-4907-8783-447438b7684f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a0be9be313454284f3f30403ec73b6', 'request_id': 'req-e59ccb7a-3494-4907-8783-447438b7684f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:43.297885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e59ccb7a-3494-4907-8783-447438b7684f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a0be9be313454284f3f30403ec73b6', 'request_id': 'req-e59ccb7a-3494-4907-8783-447438b7684f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:43.317285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e59ccb7a-3494-4907-8783-447438b7684f admin admin] The token cache is being invalidate because project f6a0be9be313454284f3f30403ec73b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:03:43.319389 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e59ccb7a-3494-4907-8783-447438b7684f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:43.320189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e59ccb7a-3494-4907-8783-447438b7684f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:43.322588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1195/2389] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:03:43 2022] DELETE /identity/v3/projects/f6a0be9be313454284f3f30403ec73b6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:43.327251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038c0cc-645c-4263-9186-a25f036fe2c0 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:43.327770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038c0cc-645c-4263-9186-a25f036fe2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:43.327885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038c0cc-645c-4263-9186-a25f036fe2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:43.380767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0038c0cc-645c-4263-9186-a25f036fe2c0 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:43.382247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0038c0cc-645c-4263-9186-a25f036fe2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:43.451324 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1195/2390] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:43.459323 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d70fea-83ce-48da-b12c-e5af1cae1ee5 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:43.459323 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d70fea-83ce-48da-b12c-e5af1cae1ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:43.459323 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d70fea-83ce-48da-b12c-e5af1cae1ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:43.481859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-26d70fea-83ce-48da-b12c-e5af1cae1ee5 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:43.483392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-26d70fea-83ce-48da-b12c-e5af1cae1ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:43.492470 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1196/2391] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:43.496899 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038c0cc-645c-4263-9186-a25f036fe2c0 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:43.507352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038c0cc-645c-4263-9186-a25f036fe2c0 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:43.511974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effb189-12fc-488b-a98a-8a60df08d6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:43.512623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effb189-12fc-488b-a98a-8a60df08d6dc admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:43.512902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effb189-12fc-488b-a98a-8a60df08d6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:43.513175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effb189-12fc-488b-a98a-8a60df08d6dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:43.513896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effb189-12fc-488b-a98a-8a60df08d6dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:03:43.514231 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effb189-12fc-488b-a98a-8a60df08d6dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:43.515814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effb189-12fc-488b-a98a-8a60df08d6dc admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:43.534147 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1196/2392] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:03:43.538570 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d70fea-83ce-48da-b12c-e5af1cae1ee5 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:43.550624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d70fea-83ce-48da-b12c-e5af1cae1ee5 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:43.557849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1455da-9df8-4cb6-b687-2b27751fe8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:43.558897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1455da-9df8-4cb6-b687-2b27751fe8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:43.559340 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1455da-9df8-4cb6-b687-2b27751fe8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:43.559775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1455da-9df8-4cb6-b687-2b27751fe8c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:43.560642 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1455da-9df8-4cb6-b687-2b27751fe8c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:43.562835 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1455da-9df8-4cb6-b687-2b27751fe8c6 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:43.609610 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1197/2393] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:03:43 2022] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:03:43.616280 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effb189-12fc-488b-a98a-8a60df08d6dc admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:43.641126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effb189-12fc-488b-a98a-8a60df08d6dc admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:43.755588 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fea07-2fb1-49e2-8001-06c5603eb52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:43.756559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fea07-2fb1-49e2-8001-06c5603eb52a admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:43.756998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fea07-2fb1-49e2-8001-06c5603eb52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:43.757456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fea07-2fb1-49e2-8001-06c5603eb52a admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:43.758372 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505fea07-2fb1-49e2-8001-06c5603eb52a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:43.760733 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505fea07-2fb1-49e2-8001-06c5603eb52a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:43.800909 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1197/2394] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:03:43 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:03:43.802103 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1455da-9df8-4cb6-b687-2b27751fe8c6 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:43.818995 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1455da-9df8-4cb6-b687-2b27751fe8c6 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:43.823980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca2176-31cd-4d4c-ac6e-a115f26caa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:43.824678 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca2176-31cd-4d4c-ac6e-a115f26caa83 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:43.824964 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca2176-31cd-4d4c-ac6e-a115f26caa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:43.825259 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca2176-31cd-4d4c-ac6e-a115f26caa83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:43.826010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca2176-31cd-4d4c-ac6e-a115f26caa83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:43.827615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca2176-31cd-4d4c-ac6e-a115f26caa83 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:43.839338 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1198/2395] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:03:43.843337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fea07-2fb1-49e2-8001-06c5603eb52a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:43.854727 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fea07-2fb1-49e2-8001-06c5603eb52a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:43.860487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efdd9a-4d48-458a-b2dc-ccf8463ef6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:43.861152 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efdd9a-4d48-458a-b2dc-ccf8463ef6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:43.861435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efdd9a-4d48-458a-b2dc-ccf8463ef6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:43.861710 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efdd9a-4d48-458a-b2dc-ccf8463ef6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:43.862528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efdd9a-4d48-458a-b2dc-ccf8463ef6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:43.864926 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efdd9a-4d48-458a-b2dc-ccf8463ef6e5 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:43.877693 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1198/2396] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:03:43.882188 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca2176-31cd-4d4c-ac6e-a115f26caa83 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:43.893463 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca2176-31cd-4d4c-ac6e-a115f26caa83 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:43.898816 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c9aba-538e-414f-bdba-e1a14ec0c27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:43.899856 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c9aba-538e-414f-bdba-e1a14ec0c27b admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:43.900314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c9aba-538e-414f-bdba-e1a14ec0c27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:43.900671 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c9aba-538e-414f-bdba-e1a14ec0c27b admin admin] PATH_INFO: `/v3/projects/523ff95216084fee850c441f2b9023f5/users/2441dce53bb54164b1978f7294927de2/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:43.918856 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c9aba-538e-414f-bdba-e1a14ec0c27b admin admin] RBAC: Authorizing `identity:create_grant(project_id=523ff95216084fee850c441f2b9023f5, user_id=2441dce53bb54164b1978f7294927de2, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:43.922185 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c9aba-538e-414f-bdba-e1a14ec0c27b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:43.941449 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1199/2397] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:03:43 2022] PUT /identity/v3/projects/523ff95216084fee850c441f2b9023f5/users/2441dce53bb54164b1978f7294927de2/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:43.951864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf47e6-c339-4b0d-badf-4b07beff00bf None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:43.952159 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf47e6-c339-4b0d-badf-4b07beff00bf None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:43.952442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf47e6-c339-4b0d-badf-4b07beff00bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:43.960797 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:43.998735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-15bf47e6-c339-4b0d-badf-4b07beff00bf None None] MFA Rules not processed for user `2441dce53bb54164b1978f7294927de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:43.999987 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-15bf47e6-c339-4b0d-badf-4b07beff00bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:44.072896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1199/2398] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:44.083979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c9aba-538e-414f-bdba-e1a14ec0c27b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:44.085605 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ea6c9aba-538e-414f-bdba-e1a14ec0c27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:44.096576 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:44.158727 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c9aba-538e-414f-bdba-e1a14ec0c27b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:44.162872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c301eb-069b-47ae-8dfe-38b32290718d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:44.163561 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c301eb-069b-47ae-8dfe-38b32290718d service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:44.163970 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c301eb-069b-47ae-8dfe-38b32290718d service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:44.164257 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c301eb-069b-47ae-8dfe-38b32290718d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:44.174930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c301eb-069b-47ae-8dfe-38b32290718d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:44.176352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c301eb-069b-47ae-8dfe-38b32290718d service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:44.186797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1200/2399] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:45.124402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58380de7-5ce3-4818-bd38-4480dba80561 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:45.124967 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58380de7-5ce3-4818-bd38-4480dba80561 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:45.124967 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58380de7-5ce3-4818-bd38-4480dba80561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:45.143766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-58380de7-5ce3-4818-bd38-4480dba80561 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:45.144979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-58380de7-5ce3-4818-bd38-4480dba80561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:45.209596 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1200/2400] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Jun 7 22:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:45.226736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c301eb-069b-47ae-8dfe-38b32290718d service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:45.228038 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-01c301eb-069b-47ae-8dfe-38b32290718d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:45.307909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c301eb-069b-47ae-8dfe-38b32290718d service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:45.313604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d25c5-3dba-4cea-a21a-a7a6e93f5f80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:45.314193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d25c5-3dba-4cea-a21a-a7a6e93f5f80 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:45.314478 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d25c5-3dba-4cea-a21a-a7a6e93f5f80 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:45.314800 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d25c5-3dba-4cea-a21a-a7a6e93f5f80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:45.323232 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d25c5-3dba-4cea-a21a-a7a6e93f5f80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:45.324826 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d25c5-3dba-4cea-a21a-a7a6e93f5f80 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:45.334749 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1201/2401] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:48.659452 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3b0b1-d34e-4b21-914a-ed9dbe7a8045 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:48.660026 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3b0b1-d34e-4b21-914a-ed9dbe7a8045 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:48.660354 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3b0b1-d34e-4b21-914a-ed9dbe7a8045 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:48.661760 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1201/2402] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 7 22:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 22:03:48.667591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d3fc8-dfe1-48be-ac61-12ff1eab68bf None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:48.668040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d3fc8-dfe1-48be-ac61-12ff1eab68bf None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:48.668167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d3fc8-dfe1-48be-ac61-12ff1eab68bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:48.708036 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-3a4d3fc8-dfe1-48be-ac61-12ff1eab68bf None None] MFA Rules not processed for user `1d5760a3f9f946978b1251d3e2aaa943`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:48.709256 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-3a4d3fc8-dfe1-48be-ac61-12ff1eab68bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:48.718910 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1202/2403] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 7 22:03:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:48.730686 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3b0b1-d34e-4b21-914a-ed9dbe7a8045 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:48.732680 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-efb3b0b1-d34e-4b21-914a-ed9dbe7a8045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:48.796034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3b0b1-d34e-4b21-914a-ed9dbe7a8045 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:48.801429 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d913518-be7a-4b58-8685-57a44b620fae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a3c022963e74e989a703938ff057757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:48.801429 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d913518-be7a-4b58-8685-57a44b620fae service glance] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:48.801429 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d913518-be7a-4b58-8685-57a44b620fae service glance] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:48.801757 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d913518-be7a-4b58-8685-57a44b620fae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:48.813362 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d913518-be7a-4b58-8685-57a44b620fae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:48.815432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d913518-be7a-4b58-8685-57a44b620fae service glance] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:48.826707 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1202/2404] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:48.893099 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b123b5a-5f81-4d64-97e4-323f9e9ae4b3 None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:48.893318 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b123b5a-5f81-4d64-97e4-323f9e9ae4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:48.893601 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b123b5a-5f81-4d64-97e4-323f9e9ae4b3 None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:48.895009 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1203/2405] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 7 22:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 22:03:48.899611 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b1b71-ecdf-4760-8522-4dab876d3533 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:48.899907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b1b71-ecdf-4760-8522-4dab876d3533 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:48.900187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b1b71-ecdf-4760-8522-4dab876d3533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:48.918597 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-bd4b1b71-ecdf-4760-8522-4dab876d3533 None None] MFA Rules not processed for user `aab50bc9064e444184afb1b4c585ce39`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:48.919795 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bd4b1b71-ecdf-4760-8522-4dab876d3533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:48.949701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:48.971687 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1203/2406] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 7 22:03:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:48.983422 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b123b5a-5f81-4d64-97e4-323f9e9ae4b3 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:48.985086 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8b123b5a-5f81-4d64-97e4-323f9e9ae4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:48.998905 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b123b5a-5f81-4d64-97e4-323f9e9ae4b3 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:49.002425 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e65f0-21b9-498e-8637-2ef7914754a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:49.003050 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e65f0-21b9-498e-8637-2ef7914754a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:49.003330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e65f0-21b9-498e-8637-2ef7914754a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:49.003603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e65f0-21b9-498e-8637-2ef7914754a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:49.010566 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e65f0-21b9-498e-8637-2ef7914754a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:49.011981 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e65f0-21b9-498e-8637-2ef7914754a9 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:49.019634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1204/2407] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:03:49.111323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c178e89-b604-444f-a1ac-396c70065697 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:49.111617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c178e89-b604-444f-a1ac-396c70065697 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:49.111896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c178e89-b604-444f-a1ac-396c70065697 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:49.113948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1204/2408] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 7 22:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 22:03:49.119368 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e3343-2fd3-4e86-a140-d730b0b83a31 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:49.119562 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e3343-2fd3-4e86-a140-d730b0b83a31 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:49.119845 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e3343-2fd3-4e86-a140-d730b0b83a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:49.139170 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-db8e3343-2fd3-4e86-a140-d730b0b83a31 None None] MFA Rules not processed for user `1d5760a3f9f946978b1251d3e2aaa943`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:49.140381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-db8e3343-2fd3-4e86-a140-d730b0b83a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:49.150095 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1205/2409] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 7 22:03:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:49.161440 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c178e89-b604-444f-a1ac-396c70065697 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:49.174529 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c178e89-b604-444f-a1ac-396c70065697 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:49.178223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02e551-8fda-423f-a6a1-3badd14fb6d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:49.178960 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02e551-8fda-423f-a6a1-3badd14fb6d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:49.179163 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02e551-8fda-423f-a6a1-3badd14fb6d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:49.179472 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02e551-8fda-423f-a6a1-3badd14fb6d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:49.192173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02e551-8fda-423f-a6a1-3badd14fb6d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:49.193617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02e551-8fda-423f-a6a1-3badd14fb6d3 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:49.206634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1205/2410] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:50.346145 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edfe48-4cf4-4258-930e-4089d63cd061 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:50.346620 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edfe48-4cf4-4258-930e-4089d63cd061 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:50.346735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edfe48-4cf4-4258-930e-4089d63cd061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:50.501089 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-13edfe48-4cf4-4258-930e-4089d63cd061 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:50.502234 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-13edfe48-4cf4-4258-930e-4089d63cd061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:50.510187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1206/2411] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Jun 7 22:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:50.524703 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02e551-8fda-423f-a6a1-3badd14fb6d3 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:50.536348 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02e551-8fda-423f-a6a1-3badd14fb6d3 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:50.541779 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41370fcf-64fd-4eae-a3d6-25efd5423c19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:50.542437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41370fcf-64fd-4eae-a3d6-25efd5423c19 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:50.542724 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41370fcf-64fd-4eae-a3d6-25efd5423c19 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:50.543002 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41370fcf-64fd-4eae-a3d6-25efd5423c19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:50.551759 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41370fcf-64fd-4eae-a3d6-25efd5423c19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:50.553329 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41370fcf-64fd-4eae-a3d6-25efd5423c19 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:50.562713 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1206/2412] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:54.333947 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa191347-03d3-4e5d-b956-bdfc57131f7e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:54.334838 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa191347-03d3-4e5d-b956-bdfc57131f7e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:54.335310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa191347-03d3-4e5d-b956-bdfc57131f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:54.345678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41370fcf-64fd-4eae-a3d6-25efd5423c19 service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:54.358617 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-aa191347-03d3-4e5d-b956-bdfc57131f7e None None] MFA Rules not processed for user `4fc55e3a9107489a9b24385ac5379ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:54.360007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-aa191347-03d3-4e5d-b956-bdfc57131f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:54.368121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41370fcf-64fd-4eae-a3d6-25efd5423c19 service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:54.372978 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682979cb-3cfd-466a-aca1-83838532f792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:54.374225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682979cb-3cfd-466a-aca1-83838532f792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:54.374778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682979cb-3cfd-466a-aca1-83838532f792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:54.375242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682979cb-3cfd-466a-aca1-83838532f792 admin admin] PATH_INFO: `/v3/users/2441dce53bb54164b1978f7294927de2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:54.377299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682979cb-3cfd-466a-aca1-83838532f792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2441dce53bb54164b1978f7294927de2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:54.379650 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682979cb-3cfd-466a-aca1-83838532f792 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:54.410606 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:54.429977 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1207/2413] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 7 22:03:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:54.442965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa191347-03d3-4e5d-b956-bdfc57131f7e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:54.445166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-aa191347-03d3-4e5d-b956-bdfc57131f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:54.462089 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-682979cb-3cfd-466a-aca1-83838532f792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2441dce53bb54164b1978f7294927de2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:54.479052 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-682979cb-3cfd-466a-aca1-83838532f792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2441dce53bb54164b1978f7294927de2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:54.498346 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-682979cb-3cfd-466a-aca1-83838532f792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2441dce53bb54164b1978f7294927de2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:54.499499 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-682979cb-3cfd-466a-aca1-83838532f792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2441dce53bb54164b1978f7294927de2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:54.500208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-682979cb-3cfd-466a-aca1-83838532f792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2441dce53bb54164b1978f7294927de2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:54.538332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1207/2414] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:03:54 2022] DELETE /identity/v3/users/2441dce53bb54164b1978f7294927de2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:03:54.542925 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9856f-6096-4a0d-8cb7-1d7b7a174508 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:54.543295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9856f-6096-4a0d-8cb7-1d7b7a174508 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:54.543769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9856f-6096-4a0d-8cb7-1d7b7a174508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:54.548897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa191347-03d3-4e5d-b956-bdfc57131f7e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:54.580562 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-80c9856f-6096-4a0d-8cb7-1d7b7a174508 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:03:54.582637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-80c9856f-6096-4a0d-8cb7-1d7b7a174508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:54.679478 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ae9f4-6240-4cb0-a7dc-5a3071470c5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b69c708fbc470aae3e3954e21a1e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:54.680258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ae9f4-6240-4cb0-a7dc-5a3071470c5f service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:54.680606 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ae9f4-6240-4cb0-a7dc-5a3071470c5f service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:54.681852 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ae9f4-6240-4cb0-a7dc-5a3071470c5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:54.685962 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-028ae9f4-6240-4cb0-a7dc-5a3071470c5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:54.721736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1208/2415] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:03:54.731637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9856f-6096-4a0d-8cb7-1d7b7a174508 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:54.733488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-80c9856f-6096-4a0d-8cb7-1d7b7a174508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:54.783172 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:54.814137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ae9f4-6240-4cb0-a7dc-5a3071470c5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:54.816020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ae9f4-6240-4cb0-a7dc-5a3071470c5f service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:54.818977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9856f-6096-4a0d-8cb7-1d7b7a174508 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:54.825068 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e0f0d-467b-4338-95a9-74ff5dd808c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:54.826239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e0f0d-467b-4338-95a9-74ff5dd808c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:54.826808 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e0f0d-467b-4338-95a9-74ff5dd808c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:54.827296 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e0f0d-467b-4338-95a9-74ff5dd808c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:54.842110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e0f0d-467b-4338-95a9-74ff5dd808c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:54.843619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1208/2416] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 7 22:03:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 07 22:03:54.846027 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e0f0d-467b-4338-95a9-74ff5dd808c5 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:54.888388 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1209/2417] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:03:55.261820 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ae9f4-6240-4cb0-a7dc-5a3071470c5f service swift] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:03:55.263432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-028ae9f4-6240-4cb0-a7dc-5a3071470c5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:03:55.295728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ae9f4-6240-4cb0-a7dc-5a3071470c5f service swift] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:03:55.308929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee84459-85d0-4084-ad37-61ac54a9c966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:03:55.309822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee84459-85d0-4084-ad37-61ac54a9c966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:03:55.310130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee84459-85d0-4084-ad37-61ac54a9c966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:03:55.310400 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee84459-85d0-4084-ad37-61ac54a9c966 admin admin] PATH_INFO: `/v3/projects/523ff95216084fee850c441f2b9023f5` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:03:55.315729 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee84459-85d0-4084-ad37-61ac54a9c966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=523ff95216084fee850c441f2b9023f5)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:03:55.318115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee84459-85d0-4084-ad37-61ac54a9c966 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:03:55.393873 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:03:55.426716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5ee84459-85d0-4084-ad37-61ac54a9c966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523ff95216084fee850c441f2b9023f5', 'request_id': 'req-5ee84459-85d0-4084-ad37-61ac54a9c966'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:55.443167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5ee84459-85d0-4084-ad37-61ac54a9c966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523ff95216084fee850c441f2b9023f5', 'request_id': 'req-5ee84459-85d0-4084-ad37-61ac54a9c966'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:55.458306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5ee84459-85d0-4084-ad37-61ac54a9c966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523ff95216084fee850c441f2b9023f5', 'request_id': 'req-5ee84459-85d0-4084-ad37-61ac54a9c966'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:55.476245 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5ee84459-85d0-4084-ad37-61ac54a9c966 admin admin] The token cache is being invalidate because project 523ff95216084fee850c441f2b9023f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:03:55.478206 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5ee84459-85d0-4084-ad37-61ac54a9c966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:55.480795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5ee84459-85d0-4084-ad37-61ac54a9c966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:03:55.489004 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1209/2418] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:03:55 2022] DELETE /identity/v3/projects/523ff95216084fee850c441f2b9023f5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:04:04.855245 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=12 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:05.472592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:15.070785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a66fc-0d65-4ab3-9cbe-73f4d988993f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:04:15.071220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a66fc-0d65-4ab3-9cbe-73f4d988993f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:04:15.071336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a66fc-0d65-4ab3-9cbe-73f4d988993f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:04:15.096486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d12a66fc-0d65-4ab3-9cbe-73f4d988993f None None] MFA Rules not processed for user `4fc55e3a9107489a9b24385ac5379ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:04:15.097873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d12a66fc-0d65-4ab3-9cbe-73f4d988993f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:04:15.161842 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1210/2419] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jun 7 22:04:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:04:15.177147 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee84459-85d0-4084-ad37-61ac54a9c966 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:04:15.178605 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5ee84459-85d0-4084-ad37-61ac54a9c966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:04:15.253762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee84459-85d0-4084-ad37-61ac54a9c966 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:04:15.258807 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d635f-9aed-417d-ac00-dd73bbe5d14a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b69c708fbc470aae3e3954e21a1e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:04:15.259452 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d635f-9aed-417d-ac00-dd73bbe5d14a service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:04:15.259736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d635f-9aed-417d-ac00-dd73bbe5d14a service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:04:15.260014 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d635f-9aed-417d-ac00-dd73bbe5d14a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:04:15.268064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d635f-9aed-417d-ac00-dd73bbe5d14a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:04:15.269666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d635f-9aed-417d-ac00-dd73bbe5d14a service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:04:15.277614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1210/2420] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 7 22:04:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 22:04:19.611998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604699c2-c721-40b5-84af-34a86ec206bf None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:04:19.612443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604699c2-c721-40b5-84af-34a86ec206bf None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:04:19.612591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604699c2-c721-40b5-84af-34a86ec206bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:04:19.630650 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-604699c2-c721-40b5-84af-34a86ec206bf None None] MFA Rules not processed for user `6324975b68f44a06a964bd96aa0664f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:04:19.631749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-604699c2-c721-40b5-84af-34a86ec206bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:04:19.684990 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1211/2421] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:04:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:04:25.274472 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=32 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:29.678568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=53 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:30.668689 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d635f-9aed-417d-ac00-dd73bbe5d14a service swift] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:04:30.670146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f99d635f-9aed-417d-ac00-dd73bbe5d14a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:04:30.768470 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d635f-9aed-417d-ac00-dd73bbe5d14a service swift] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:04:30.773606 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fea077-3cdb-476b-9d23-a30e6814cece service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90facf92f97d435dbe8a001759a8fe0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:04:30.774287 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fea077-3cdb-476b-9d23-a30e6814cece service placement] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:04:30.774569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fea077-3cdb-476b-9d23-a30e6814cece service placement] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:04:30.774844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fea077-3cdb-476b-9d23-a30e6814cece service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:04:30.776765 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-84fea077-3cdb-476b-9d23-a30e6814cece service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:04:30.789099 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fea077-3cdb-476b-9d23-a30e6814cece service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:04:30.790721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fea077-3cdb-476b-9d23-a30e6814cece service placement] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:04:30.802781 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1211/2422] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:04:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:04:34.117227 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054439c-7140-4e74-8de0-a6ebc8dbf061 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:04:34.117762 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054439c-7140-4e74-8de0-a6ebc8dbf061 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:04:34.118101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054439c-7140-4e74-8de0-a6ebc8dbf061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:04:34.136551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e054439c-7140-4e74-8de0-a6ebc8dbf061 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:04:34.137775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e054439c-7140-4e74-8de0-a6ebc8dbf061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:04:34.198160 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1212/2423] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Jun 7 22:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:04:34.212893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fea077-3cdb-476b-9d23-a30e6814cece service placement] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:04:34.214295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-84fea077-3cdb-476b-9d23-a30e6814cece service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:04:34.320714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fea077-3cdb-476b-9d23-a30e6814cece service placement] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:04:34.326168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e11a6-2332-4d1c-a8c1-82633949e3ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:04:34.326799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e11a6-2332-4d1c-a8c1-82633949e3ed service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:04:34.327074 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e11a6-2332-4d1c-a8c1-82633949e3ed service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:04:34.327346 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e11a6-2332-4d1c-a8c1-82633949e3ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:04:34.336253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e11a6-2332-4d1c-a8c1-82633949e3ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:04:34.337808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e11a6-2332-4d1c-a8c1-82633949e3ed service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:04:34.347470 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1212/2424] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:04:38.523165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622bc6a-1cbe-4754-8ea8-1aa297a1f823 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:04:38.523694 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622bc6a-1cbe-4754-8ea8-1aa297a1f823 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:04:38.524415 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622bc6a-1cbe-4754-8ea8-1aa297a1f823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:04:38.547273 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-2622bc6a-1cbe-4754-8ea8-1aa297a1f823 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:04:38.549292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2622bc6a-1cbe-4754-8ea8-1aa297a1f823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:04:38.557967 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1213/2425] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Jun 7 22:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:04:38.577349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e11a6-2332-4d1c-a8c1-82633949e3ed service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:04:38.594891 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e11a6-2332-4d1c-a8c1-82633949e3ed service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:04:38.605204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb273e2-7040-4b36-804e-8e9b748c9b50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:04:38.605914 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb273e2-7040-4b36-804e-8e9b748c9b50 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:04:38.606224 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb273e2-7040-4b36-804e-8e9b748c9b50 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:04:38.606688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb273e2-7040-4b36-804e-8e9b748c9b50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:04:38.618417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb273e2-7040-4b36-804e-8e9b748c9b50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:04:38.620589 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb273e2-7040-4b36-804e-8e9b748c9b50 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:04:38.638217 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1213/2426] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:04:40.425083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471b76d-e35c-4f9b-9aab-85a3a205329e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:04:40.425553 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471b76d-e35c-4f9b-9aab-85a3a205329e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:04:40.425743 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471b76d-e35c-4f9b-9aab-85a3a205329e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:04:40.449332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1471b76d-e35c-4f9b-9aab-85a3a205329e None None] MFA Rules not processed for user `bd1a33ca9f5144c69a66affd662bb9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:04:40.450589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1471b76d-e35c-4f9b-9aab-85a3a205329e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:04:40.514288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1214/2427] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:04:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:04:42.584218 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87a1a-e45b-450b-b4ad-c3d7de110f82 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:04:42.584762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87a1a-e45b-450b-b4ad-c3d7de110f82 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:04:42.585008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87a1a-e45b-450b-b4ad-c3d7de110f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:04:42.603616 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0bb87a1a-e45b-450b-b4ad-c3d7de110f82 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:04:42.604825 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0bb87a1a-e45b-450b-b4ad-c3d7de110f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:04:42.613789 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1214/2428] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Jun 7 22:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:04:42.630873 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471b76d-e35c-4f9b-9aab-85a3a205329e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:04:42.632829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1471b76d-e35c-4f9b-9aab-85a3a205329e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:04:42.649120 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471b76d-e35c-4f9b-9aab-85a3a205329e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:04:42.654550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f48a22-3985-4af0-9b6c-c40a1257606e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:04:42.655196 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f48a22-3985-4af0-9b6c-c40a1257606e service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:04:42.655483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f48a22-3985-4af0-9b6c-c40a1257606e service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:04:42.655762 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f48a22-3985-4af0-9b6c-c40a1257606e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:04:42.665303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f48a22-3985-4af0-9b6c-c40a1257606e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:04:42.666956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f48a22-3985-4af0-9b6c-c40a1257606e service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:04:42.677470 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1215/2429] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:04:45.746360 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066057c0-a097-4aff-9297-8d0d3c5bf952 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:04:45.746773 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066057c0-a097-4aff-9297-8d0d3c5bf952 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:04:45.747051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066057c0-a097-4aff-9297-8d0d3c5bf952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:04:45.765015 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-066057c0-a097-4aff-9297-8d0d3c5bf952 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:04:45.766738 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-066057c0-a097-4aff-9297-8d0d3c5bf952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:04:45.774792 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1215/2430] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Jun 7 22:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:04:45.797672 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f48a22-3985-4af0-9b6c-c40a1257606e service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:04:45.809245 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f48a22-3985-4af0-9b6c-c40a1257606e service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:04:45.814768 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5a17a-a127-4281-a174-2574d39ef371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:04:45.815427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5a17a-a127-4281-a174-2574d39ef371 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:04:45.815705 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5a17a-a127-4281-a174-2574d39ef371 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:04:45.815977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5a17a-a127-4281-a174-2574d39ef371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:04:45.824434 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5a17a-a127-4281-a174-2574d39ef371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:04:45.826102 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5a17a-a127-4281-a174-2574d39ef371 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:04:45.836495 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1216/2431] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:04:48.898471 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39f409-becc-4f14-91b8-11ce6a477000 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:04:48.898974 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39f409-becc-4f14-91b8-11ce6a477000 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:04:48.899075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39f409-becc-4f14-91b8-11ce6a477000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:04:48.917212 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-aa39f409-becc-4f14-91b8-11ce6a477000 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:04:48.918435 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-aa39f409-becc-4f14-91b8-11ce6a477000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:04:48.926865 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1216/2432] 10.222.0.42 () {58 vars in 1016 bytes} [Tue Jun 7 22:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:04:48.945423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5a17a-a127-4281-a174-2574d39ef371 service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:04:48.956348 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5a17a-a127-4281-a174-2574d39ef371 service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:04:48.961902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8cd56-04f8-4991-af69-00dd4e375004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:04:48.962554 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8cd56-04f8-4991-af69-00dd4e375004 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:04:48.962834 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8cd56-04f8-4991-af69-00dd4e375004 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:04:48.963104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8cd56-04f8-4991-af69-00dd4e375004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:04:48.972188 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8cd56-04f8-4991-af69-00dd4e375004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:04:48.973766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8cd56-04f8-4991-af69-00dd4e375004 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:04:48.983892 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1217/2433] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:04:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:04:58.912146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:04:58.979243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=73 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:00.923235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e340a-e412-44e1-b4c7-53721920c1ca None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:05:00.923754 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e340a-e412-44e1-b4c7-53721920c1ca None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:05:00.923868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e340a-e412-44e1-b4c7-53721920c1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:05:00.940957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a50e340a-e412-44e1-b4c7-53721920c1ca None None] MFA Rules not processed for user `4ba5f51282f548cbbcf0dcaf8fbb4cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:05:00.942155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a50e340a-e412-44e1-b4c7-53721920c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:05:00.994625 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1217/2434] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:05:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:05:09.295633 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cff02-1285-4aa6-b32b-9e68de64e49a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:05:09.296136 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cff02-1285-4aa6-b32b-9e68de64e49a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:05:09.296242 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cff02-1285-4aa6-b32b-9e68de64e49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:05:09.313808 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f46cff02-1285-4aa6-b32b-9e68de64e49a None None] MFA Rules not processed for user `08868c65e4824034a998df7398daac9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:05:09.315033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f46cff02-1285-4aa6-b32b-9e68de64e49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:05:09.369642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1218/2435] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:05:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:05:10.988044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=25 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:19.362777 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=25 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:20.649214 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e340a-e412-44e1-b4c7-53721920c1ca None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:05:20.651112 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a50e340a-e412-44e1-b4c7-53721920c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:05:20.665152 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e340a-e412-44e1-b4c7-53721920c1ca None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:05:20.669775 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788ddc6-5330-43a8-a014-a017b8ca8d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:05:20.670725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788ddc6-5330-43a8-a014-a017b8ca8d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:05:20.671002 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788ddc6-5330-43a8-a014-a017b8ca8d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:05:20.671268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788ddc6-5330-43a8-a014-a017b8ca8d9e admin admin] PATH_INFO: `/v3/users/6324975b68f44a06a964bd96aa0664f0` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:05:20.672514 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788ddc6-5330-43a8-a014-a017b8ca8d9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6324975b68f44a06a964bd96aa0664f0)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:05:20.674433 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788ddc6-5330-43a8-a014-a017b8ca8d9e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:05:20.725143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5788ddc6-5330-43a8-a014-a017b8ca8d9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6324975b68f44a06a964bd96aa0664f0'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:05:20.732356 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5788ddc6-5330-43a8-a014-a017b8ca8d9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6324975b68f44a06a964bd96aa0664f0'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:05:20.733055 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5788ddc6-5330-43a8-a014-a017b8ca8d9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6324975b68f44a06a964bd96aa0664f0'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:05:20.741054 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5788ddc6-5330-43a8-a014-a017b8ca8d9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6324975b68f44a06a964bd96aa0664f0'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:05:20.741821 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5788ddc6-5330-43a8-a014-a017b8ca8d9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6324975b68f44a06a964bd96aa0664f0'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:05:20.759192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1218/2436] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:05:20 2022] DELETE /identity/v3/users/6324975b68f44a06a964bd96aa0664f0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:05:20.933153 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cff02-1285-4aa6-b32b-9e68de64e49a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:05:20.944673 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cff02-1285-4aa6-b32b-9e68de64e49a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:05:21.014681 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634fd43-1d37-4284-8d3a-c850ab73cd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:05:21.016249 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634fd43-1d37-4284-8d3a-c850ab73cd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:05:21.016532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634fd43-1d37-4284-8d3a-c850ab73cd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:05:21.016806 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634fd43-1d37-4284-8d3a-c850ab73cd5b admin admin] PATH_INFO: `/v3/projects/e21763482c564c5d865102b74d6c8025` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:05:21.018016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634fd43-1d37-4284-8d3a-c850ab73cd5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e21763482c564c5d865102b74d6c8025)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:05:21.019918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634fd43-1d37-4284-8d3a-c850ab73cd5b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:05:21.067939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1634fd43-1d37-4284-8d3a-c850ab73cd5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e21763482c564c5d865102b74d6c8025', 'request_id': 'req-1634fd43-1d37-4284-8d3a-c850ab73cd5b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:05:21.074074 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1634fd43-1d37-4284-8d3a-c850ab73cd5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e21763482c564c5d865102b74d6c8025', 'request_id': 'req-1634fd43-1d37-4284-8d3a-c850ab73cd5b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:05:21.080225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1634fd43-1d37-4284-8d3a-c850ab73cd5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e21763482c564c5d865102b74d6c8025', 'request_id': 'req-1634fd43-1d37-4284-8d3a-c850ab73cd5b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:05:21.093569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1634fd43-1d37-4284-8d3a-c850ab73cd5b admin admin] The token cache is being invalidate because project e21763482c564c5d865102b74d6c8025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:05:21.093854 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1634fd43-1d37-4284-8d3a-c850ab73cd5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:05:21.094526 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1634fd43-1d37-4284-8d3a-c850ab73cd5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:05:21.096280 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1219/2437] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:05:20 2022] DELETE /identity/v3/projects/e21763482c564c5d865102b74d6c8025 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:05:30.755586 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:31.090210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:05:52.064102 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac7e79-778a-4398-903b-9efd58975086 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:05:52.064605 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac7e79-778a-4398-903b-9efd58975086 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:05:52.064701 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac7e79-778a-4398-903b-9efd58975086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:05:52.082021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-10ac7e79-778a-4398-903b-9efd58975086 None None] MFA Rules not processed for user `bd1a33ca9f5144c69a66affd662bb9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:05:52.083209 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-10ac7e79-778a-4398-903b-9efd58975086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:05:52.137016 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1219/2438] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:05:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:06:02.130414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=25 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:06.954116 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634fd43-1d37-4284-8d3a-c850ab73cd5b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:06.956180 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1634fd43-1d37-4284-8d3a-c850ab73cd5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:07.033349 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634fd43-1d37-4284-8d3a-c850ab73cd5b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:07.037914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255079a-1449-43f7-aedb-80816a307d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:07.038813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255079a-1449-43f7-aedb-80816a307d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:07.039098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255079a-1449-43f7-aedb-80816a307d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:07.039374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255079a-1449-43f7-aedb-80816a307d83 admin admin] PATH_INFO: `/v3/users/4ba5f51282f548cbbcf0dcaf8fbb4cc2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:07.040574 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255079a-1449-43f7-aedb-80816a307d83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba5f51282f548cbbcf0dcaf8fbb4cc2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:07.042550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255079a-1449-43f7-aedb-80816a307d83 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:07.091232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c255079a-1449-43f7-aedb-80816a307d83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba5f51282f548cbbcf0dcaf8fbb4cc2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:06:07.098183 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c255079a-1449-43f7-aedb-80816a307d83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba5f51282f548cbbcf0dcaf8fbb4cc2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:06:07.105732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c255079a-1449-43f7-aedb-80816a307d83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba5f51282f548cbbcf0dcaf8fbb4cc2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:06:07.106359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c255079a-1449-43f7-aedb-80816a307d83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba5f51282f548cbbcf0dcaf8fbb4cc2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:06:07.106988 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c255079a-1449-43f7-aedb-80816a307d83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba5f51282f548cbbcf0dcaf8fbb4cc2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:06:07.125013 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1220/2439] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:06:06 2022] DELETE /identity/v3/users/4ba5f51282f548cbbcf0dcaf8fbb4cc2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:06:07.385054 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac7e79-778a-4398-903b-9efd58975086 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:07.409177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac7e79-778a-4398-903b-9efd58975086 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:07.469791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5b140-0b8f-4e89-9dc7-ede4f4efd425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:07.470688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5b140-0b8f-4e89-9dc7-ede4f4efd425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:07.470969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5b140-0b8f-4e89-9dc7-ede4f4efd425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:07.471239 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5b140-0b8f-4e89-9dc7-ede4f4efd425 admin admin] PATH_INFO: `/v3/projects/310a82e2f2f8433c85fa73437b7b24da` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:07.472408 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5b140-0b8f-4e89-9dc7-ede4f4efd425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=310a82e2f2f8433c85fa73437b7b24da)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:07.474335 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5b140-0b8f-4e89-9dc7-ede4f4efd425 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:07.524289 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-93d5b140-0b8f-4e89-9dc7-ede4f4efd425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310a82e2f2f8433c85fa73437b7b24da', 'request_id': 'req-93d5b140-0b8f-4e89-9dc7-ede4f4efd425'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:06:07.529723 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-93d5b140-0b8f-4e89-9dc7-ede4f4efd425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310a82e2f2f8433c85fa73437b7b24da', 'request_id': 'req-93d5b140-0b8f-4e89-9dc7-ede4f4efd425'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:06:07.535997 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-93d5b140-0b8f-4e89-9dc7-ede4f4efd425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310a82e2f2f8433c85fa73437b7b24da', 'request_id': 'req-93d5b140-0b8f-4e89-9dc7-ede4f4efd425'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:06:07.549658 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-93d5b140-0b8f-4e89-9dc7-ede4f4efd425 admin admin] The token cache is being invalidate because project 310a82e2f2f8433c85fa73437b7b24da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:06:07.549963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-93d5b140-0b8f-4e89-9dc7-ede4f4efd425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:06:07.550611 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-93d5b140-0b8f-4e89-9dc7-ede4f4efd425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:06:07.552181 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1220/2440] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:06:07 2022] DELETE /identity/v3/projects/310a82e2f2f8433c85fa73437b7b24da => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:06:07.557300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61aa1a7-5901-469b-894f-18d683946841 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:07.557625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61aa1a7-5901-469b-894f-18d683946841 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:07.557877 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61aa1a7-5901-469b-894f-18d683946841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:07.577572 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e61aa1a7-5901-469b-894f-18d683946841 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:06:07.578998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e61aa1a7-5901-469b-894f-18d683946841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:07.647308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1221/2441] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:06:07.655928 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f082b2-c0d1-4f01-be52-4b35627c4a39 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:07.656217 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f082b2-c0d1-4f01-be52-4b35627c4a39 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:07.656503 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f082b2-c0d1-4f01-be52-4b35627c4a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:07.678942 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-23f082b2-c0d1-4f01-be52-4b35627c4a39 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:06:07.680125 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-23f082b2-c0d1-4f01-be52-4b35627c4a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:07.693973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1221/2442] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:06:07.696378 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61aa1a7-5901-469b-894f-18d683946841 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:07.708493 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61aa1a7-5901-469b-894f-18d683946841 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:07.714480 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8238b-842d-4cf8-8908-615dfff68fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:07.715427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8238b-842d-4cf8-8908-615dfff68fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:07.715917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8238b-842d-4cf8-8908-615dfff68fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:07.716394 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8238b-842d-4cf8-8908-615dfff68fe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:07.717905 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8238b-842d-4cf8-8908-615dfff68fe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:06:07.726346 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8238b-842d-4cf8-8908-615dfff68fe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:07.728052 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8238b-842d-4cf8-8908-615dfff68fe3 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:07.752821 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1222/2443] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:06:07.756881 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f082b2-c0d1-4f01-be52-4b35627c4a39 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:07.768714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f082b2-c0d1-4f01-be52-4b35627c4a39 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:07.774616 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784af05f-90c3-4ece-9d35-b78bcfc8b9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:07.776146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784af05f-90c3-4ece-9d35-b78bcfc8b9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:07.776369 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784af05f-90c3-4ece-9d35-b78bcfc8b9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:07.776662 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784af05f-90c3-4ece-9d35-b78bcfc8b9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:07.777665 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784af05f-90c3-4ece-9d35-b78bcfc8b9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:07.782207 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784af05f-90c3-4ece-9d35-b78bcfc8b9f1 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:07.819318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8238b-842d-4cf8-8908-615dfff68fe3 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:07.823626 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1222/2444] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:06:07 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:06:07.843968 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8238b-842d-4cf8-8908-615dfff68fe3 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:07.848917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:07.936600 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e9a5b-6a53-4326-813e-cf46d85ee047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:07.937293 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e9a5b-6a53-4326-813e-cf46d85ee047 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:07.937575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e9a5b-6a53-4326-813e-cf46d85ee047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:07.937850 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e9a5b-6a53-4326-813e-cf46d85ee047 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:07.938950 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e9a5b-6a53-4326-813e-cf46d85ee047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:07.940953 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e9a5b-6a53-4326-813e-cf46d85ee047 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:07.970094 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1223/2445] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:06:07 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:06:07.972068 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784af05f-90c3-4ece-9d35-b78bcfc8b9f1 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:07.983550 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784af05f-90c3-4ece-9d35-b78bcfc8b9f1 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:07.989686 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cdc77-b31c-4b45-a71c-f053f25e39b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:07.990377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cdc77-b31c-4b45-a71c-f053f25e39b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:07.990665 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cdc77-b31c-4b45-a71c-f053f25e39b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:07.991819 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cdc77-b31c-4b45-a71c-f053f25e39b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:07.992311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cdc77-b31c-4b45-a71c-f053f25e39b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:07.994800 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cdc77-b31c-4b45-a71c-f053f25e39b6 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:08.009829 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1223/2446] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:06:08.011236 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e9a5b-6a53-4326-813e-cf46d85ee047 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:08.025300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e9a5b-6a53-4326-813e-cf46d85ee047 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:08.030935 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf50a54-d11c-4790-a3f3-33e21b6c883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:08.031765 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf50a54-d11c-4790-a3f3-33e21b6c883c admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:08.032038 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf50a54-d11c-4790-a3f3-33e21b6c883c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:08.032374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf50a54-d11c-4790-a3f3-33e21b6c883c admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:08.033230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf50a54-d11c-4790-a3f3-33e21b6c883c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:08.035065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf50a54-d11c-4790-a3f3-33e21b6c883c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:08.050011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1224/2447] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:06:08.051865 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cdc77-b31c-4b45-a71c-f053f25e39b6 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:08.069110 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cdc77-b31c-4b45-a71c-f053f25e39b6 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:08.075316 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029bae5-82f2-41f2-83a5-54dbf64cbb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:08.077250 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029bae5-82f2-41f2-83a5-54dbf64cbb8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:08.077613 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029bae5-82f2-41f2-83a5-54dbf64cbb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:08.077985 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029bae5-82f2-41f2-83a5-54dbf64cbb8f admin admin] PATH_INFO: `/v3/projects/4f11371bf2124125badc1c503af5f760/users/47b214a23ec74f58904fe6d82deb8bb6/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:08.100640 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029bae5-82f2-41f2-83a5-54dbf64cbb8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f11371bf2124125badc1c503af5f760, user_id=47b214a23ec74f58904fe6d82deb8bb6, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:08.103359 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029bae5-82f2-41f2-83a5-54dbf64cbb8f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:08.120585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1224/2448] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:06:08 2022] PUT /identity/v3/projects/4f11371bf2124125badc1c503af5f760/users/47b214a23ec74f58904fe6d82deb8bb6/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:06:08.126411 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08174988-2f8c-4f39-9ae9-a77118ed22e0 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:08.126947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08174988-2f8c-4f39-9ae9-a77118ed22e0 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:08.127292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08174988-2f8c-4f39-9ae9-a77118ed22e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:08.147622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-08174988-2f8c-4f39-9ae9-a77118ed22e0 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:06:08.149532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-08174988-2f8c-4f39-9ae9-a77118ed22e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:08.214524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1225/2449] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:06:08.224626 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029bae5-82f2-41f2-83a5-54dbf64cbb8f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:08.226364 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f029bae5-82f2-41f2-83a5-54dbf64cbb8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:08.260859 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:08.289848 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029bae5-82f2-41f2-83a5-54dbf64cbb8f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:08.293475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc639d11-8bd4-4cd9-be20-35bc58224d13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:08.294158 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc639d11-8bd4-4cd9-be20-35bc58224d13 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:08.294443 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc639d11-8bd4-4cd9-be20-35bc58224d13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:08.294716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc639d11-8bd4-4cd9-be20-35bc58224d13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:08.305215 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc639d11-8bd4-4cd9-be20-35bc58224d13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:08.306808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc639d11-8bd4-4cd9-be20-35bc58224d13 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:08.318289 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1225/2450] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:06:12.393634 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bb229-1f4a-4d5f-854e-dcdfd5972d3b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:12.394241 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bb229-1f4a-4d5f-854e-dcdfd5972d3b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:12.394241 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bb229-1f4a-4d5f-854e-dcdfd5972d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:12.421666 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-a22bb229-1f4a-4d5f-854e-dcdfd5972d3b None None] MFA Rules not processed for user `47b214a23ec74f58904fe6d82deb8bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:06:12.422926 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a22bb229-1f4a-4d5f-854e-dcdfd5972d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:12.496314 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1226/2451] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:06:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:06:12.511051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc639d11-8bd4-4cd9-be20-35bc58224d13 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:12.512686 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-cc639d11-8bd4-4cd9-be20-35bc58224d13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:12.587400 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc639d11-8bd4-4cd9-be20-35bc58224d13 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:12.592864 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960ad77-2c3f-4cae-8ce6-ee158f6ac4a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:12.593536 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960ad77-2c3f-4cae-8ce6-ee158f6ac4a9 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:12.593823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960ad77-2c3f-4cae-8ce6-ee158f6ac4a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:12.594200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960ad77-2c3f-4cae-8ce6-ee158f6ac4a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:12.602378 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960ad77-2c3f-4cae-8ce6-ee158f6ac4a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:12.604000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960ad77-2c3f-4cae-8ce6-ee158f6ac4a9 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:12.614698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1226/2452] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:06:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:06:13.979196 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055882b1-edcb-4d59-9b3d-68b738b2596d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:13.979723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055882b1-edcb-4d59-9b3d-68b738b2596d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:13.979859 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055882b1-edcb-4d59-9b3d-68b738b2596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:13.998511 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-055882b1-edcb-4d59-9b3d-68b738b2596d None None] MFA Rules not processed for user `47b214a23ec74f58904fe6d82deb8bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:06:13.999704 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-055882b1-edcb-4d59-9b3d-68b738b2596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:14.006961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1227/2453] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:06:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:06:22.610182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=48 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:23.993114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:26.842561 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be9e67-e27d-4d2e-b78d-461005878183 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:26.843014 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be9e67-e27d-4d2e-b78d-461005878183 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:26.843195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be9e67-e27d-4d2e-b78d-461005878183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:26.892982 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-93be9e67-e27d-4d2e-b78d-461005878183 None None] MFA Rules not processed for user `4fc55e3a9107489a9b24385ac5379ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:06:26.894119 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-93be9e67-e27d-4d2e-b78d-461005878183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:26.963142 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1227/2454] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 7 22:06:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:06:27.011654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055882b1-edcb-4d59-9b3d-68b738b2596d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:27.013117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-055882b1-edcb-4d59-9b3d-68b738b2596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:27.102323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055882b1-edcb-4d59-9b3d-68b738b2596d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:27.107278 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79764d-28d2-4162-a3a3-1dcfadd63d8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b69c708fbc470aae3e3954e21a1e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:27.108444 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79764d-28d2-4162-a3a3-1dcfadd63d8c service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:27.108724 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79764d-28d2-4162-a3a3-1dcfadd63d8c service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:27.108998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79764d-28d2-4162-a3a3-1dcfadd63d8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:27.117275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79764d-28d2-4162-a3a3-1dcfadd63d8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:27.118868 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79764d-28d2-4162-a3a3-1dcfadd63d8c service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:27.127222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1228/2455] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 7 22:06:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 07 22:06:27.222816 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be9e67-e27d-4d2e-b78d-461005878183 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:27.232903 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be9e67-e27d-4d2e-b78d-461005878183 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:27.238523 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85f54d-f151-4bd5-b259-72e6f0d2797a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:27.239191 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85f54d-f151-4bd5-b259-72e6f0d2797a service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:27.239482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85f54d-f151-4bd5-b259-72e6f0d2797a service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:27.239757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85f54d-f151-4bd5-b259-72e6f0d2797a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:27.243370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ed85f54d-f151-4bd5-b259-72e6f0d2797a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:27.257582 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85f54d-f151-4bd5-b259-72e6f0d2797a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:27.259166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85f54d-f151-4bd5-b259-72e6f0d2797a service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:27.271614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1228/2456] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:06:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:06:28.491454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79764d-28d2-4162-a3a3-1dcfadd63d8c service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:28.504275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79764d-28d2-4162-a3a3-1dcfadd63d8c service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:28.509457 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1428c-9990-49c5-8b07-5fdb3bba54cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:28.510528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1428c-9990-49c5-8b07-5fdb3bba54cc service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:28.511123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1428c-9990-49c5-8b07-5fdb3bba54cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:28.511709 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1428c-9990-49c5-8b07-5fdb3bba54cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:28.513639 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bdd1428c-9990-49c5-8b07-5fdb3bba54cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:28.530516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1428c-9990-49c5-8b07-5fdb3bba54cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:28.532382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1428c-9990-49c5-8b07-5fdb3bba54cc service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:28.546039 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1229/2457] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:06:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:06:37.265887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=46 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:38.539912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=47 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:40.185326 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85f54d-f151-4bd5-b259-72e6f0d2797a service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:40.195954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85f54d-f151-4bd5-b259-72e6f0d2797a service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:40.200064 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a6de9-44b3-4561-9482-7acc3cafb598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:40.200698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a6de9-44b3-4561-9482-7acc3cafb598 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:40.200976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a6de9-44b3-4561-9482-7acc3cafb598 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:40.201250 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a6de9-44b3-4561-9482-7acc3cafb598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:40.203554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ce3a6de9-44b3-4561-9482-7acc3cafb598 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:40.212897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a6de9-44b3-4561-9482-7acc3cafb598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:40.214325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a6de9-44b3-4561-9482-7acc3cafb598 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:40.222707 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1229/2458] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:06:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:06:40.497074 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1428c-9990-49c5-8b07-5fdb3bba54cc service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:40.498576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bdd1428c-9990-49c5-8b07-5fdb3bba54cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:40.568019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1428c-9990-49c5-8b07-5fdb3bba54cc service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:40.573237 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fe2f6-d135-4116-a2c6-922df211dd2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90facf92f97d435dbe8a001759a8fe0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:40.573883 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fe2f6-d135-4116-a2c6-922df211dd2d service placement] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:40.574221 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fe2f6-d135-4116-a2c6-922df211dd2d service placement] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:40.574498 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fe2f6-d135-4116-a2c6-922df211dd2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:40.576270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6f9fe2f6-d135-4116-a2c6-922df211dd2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:40.588161 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fe2f6-d135-4116-a2c6-922df211dd2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:40.589678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fe2f6-d135-4116-a2c6-922df211dd2d service placement] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:40.599477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1230/2459] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:06:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:06:41.340740 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a6de9-44b3-4561-9482-7acc3cafb598 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:41.349845 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a6de9-44b3-4561-9482-7acc3cafb598 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:41.353472 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf8bee-a4e9-457f-a5b3-9d4e29ee4e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:41.354131 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf8bee-a4e9-457f-a5b3-9d4e29ee4e98 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:41.354409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf8bee-a4e9-457f-a5b3-9d4e29ee4e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:41.354680 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf8bee-a4e9-457f-a5b3-9d4e29ee4e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:41.356414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-cbdf8bee-a4e9-457f-a5b3-9d4e29ee4e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:41.366367 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf8bee-a4e9-457f-a5b3-9d4e29ee4e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:41.367781 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf8bee-a4e9-457f-a5b3-9d4e29ee4e98 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:41.375722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1230/2460] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:06:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:06:42.207308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aafb1f-7637-4c0d-b244-d6ea77d7eb64 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:42.207801 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aafb1f-7637-4c0d-b244-d6ea77d7eb64 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:42.207914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aafb1f-7637-4c0d-b244-d6ea77d7eb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:42.226043 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-89aafb1f-7637-4c0d-b244-d6ea77d7eb64 None None] MFA Rules not processed for user `4fc55e3a9107489a9b24385ac5379ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:06:42.227265 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-89aafb1f-7637-4c0d-b244-d6ea77d7eb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:42.236169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1231/2461] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 7 22:06:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:06:42.247767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf8bee-a4e9-457f-a5b3-9d4e29ee4e98 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:42.259571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf8bee-a4e9-457f-a5b3-9d4e29ee4e98 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:42.264465 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab665dc-c491-48be-b4ed-272393c71922 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b69c708fbc470aae3e3954e21a1e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:42.265088 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab665dc-c491-48be-b4ed-272393c71922 service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:42.265370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab665dc-c491-48be-b4ed-272393c71922 service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:42.265646 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab665dc-c491-48be-b4ed-272393c71922 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:42.273563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab665dc-c491-48be-b4ed-272393c71922 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:42.275151 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab665dc-c491-48be-b4ed-272393c71922 service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:42.283762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1231/2462] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 7 22:06:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 22:06:42.693559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aafb1f-7637-4c0d-b244-d6ea77d7eb64 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:42.695360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-89aafb1f-7637-4c0d-b244-d6ea77d7eb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:42.712423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aafb1f-7637-4c0d-b244-d6ea77d7eb64 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:42.719349 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd76637-e309-429c-8e6b-b92e406791e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:42.720010 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd76637-e309-429c-8e6b-b92e406791e1 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:42.720300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd76637-e309-429c-8e6b-b92e406791e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:42.720575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd76637-e309-429c-8e6b-b92e406791e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:42.722397 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8bd76637-e309-429c-8e6b-b92e406791e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:42.781527 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd76637-e309-429c-8e6b-b92e406791e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:42.783080 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd76637-e309-429c-8e6b-b92e406791e1 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:42.792187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1232/2463] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:06:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:06:45.450151 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab665dc-c491-48be-b4ed-272393c71922 service swift] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:06:45.451597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8ab665dc-c491-48be-b4ed-272393c71922 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:45.552012 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab665dc-c491-48be-b4ed-272393c71922 service swift] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:06:45.556492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c2aa1-717d-4149-a109-b6d2a6cd363a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:06:45.557176 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c2aa1-717d-4149-a109-b6d2a6cd363a service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:06:45.557463 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c2aa1-717d-4149-a109-b6d2a6cd363a service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:06:45.557769 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c2aa1-717d-4149-a109-b6d2a6cd363a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:06:45.560300 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c19c2aa1-717d-4149-a109-b6d2a6cd363a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:06:45.624858 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c2aa1-717d-4149-a109-b6d2a6cd363a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:06:45.626338 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c2aa1-717d-4149-a109-b6d2a6cd363a service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:06:45.635328 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1232/2464] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:06:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:06:52.787912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=63 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:06:55.631065 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=75 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:00.003610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53e533-4c48-4b05-a943-aa969b595440 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:00.004073 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53e533-4c48-4b05-a943-aa969b595440 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:00.004354 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53e533-4c48-4b05-a943-aa969b595440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:00.022825 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3c53e533-4c48-4b05-a943-aa969b595440 None None] MFA Rules not processed for user `4fc55e3a9107489a9b24385ac5379ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:00.024146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3c53e533-4c48-4b05-a943-aa969b595440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:00.031821 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1233/2465] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jun 7 22:07:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:00.046271 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c2aa1-717d-4149-a109-b6d2a6cd363a service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:00.057039 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c2aa1-717d-4149-a109-b6d2a6cd363a service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:00.062545 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419cd89-2e8e-43b1-a6d2-4ab4ef38289a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b69c708fbc470aae3e3954e21a1e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:00.063239 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419cd89-2e8e-43b1-a6d2-4ab4ef38289a service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:00.063524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419cd89-2e8e-43b1-a6d2-4ab4ef38289a service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:00.063800 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419cd89-2e8e-43b1-a6d2-4ab4ef38289a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:00.072065 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419cd89-2e8e-43b1-a6d2-4ab4ef38289a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:00.073810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419cd89-2e8e-43b1-a6d2-4ab4ef38289a service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:00.082703 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1233/2466] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 7 22:07:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 07 22:07:06.167212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53e533-4c48-4b05-a943-aa969b595440 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:06.168613 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3c53e533-4c48-4b05-a943-aa969b595440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:06.180417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53e533-4c48-4b05-a943-aa969b595440 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:06.183911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd8982-d10b-4e60-955a-e9a4c23ec7f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:06.184541 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd8982-d10b-4e60-955a-e9a4c23ec7f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:06.184824 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd8982-d10b-4e60-955a-e9a4c23ec7f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:06.185099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd8982-d10b-4e60-955a-e9a4c23ec7f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:06.187488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fadd8982-d10b-4e60-955a-e9a4c23ec7f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:06.200038 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd8982-d10b-4e60-955a-e9a4c23ec7f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:06.201494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd8982-d10b-4e60-955a-e9a4c23ec7f0 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:06.211236 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1234/2467] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:09.341497 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419cd89-2e8e-43b1-a6d2-4ab4ef38289a service swift] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:09.343432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c419cd89-2e8e-43b1-a6d2-4ab4ef38289a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:09.358423 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419cd89-2e8e-43b1-a6d2-4ab4ef38289a service swift] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:09.363374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17a200-87ff-412a-944b-c378ca8cc588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:09.364255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17a200-87ff-412a-944b-c378ca8cc588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:09.364538 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17a200-87ff-412a-944b-c378ca8cc588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:09.364808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17a200-87ff-412a-944b-c378ca8cc588 admin admin] PATH_INFO: `/v3/users/bd1a33ca9f5144c69a66affd662bb9a6` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:09.366219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17a200-87ff-412a-944b-c378ca8cc588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd1a33ca9f5144c69a66affd662bb9a6)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:09.368320 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17a200-87ff-412a-944b-c378ca8cc588 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:09.416838 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7c17a200-87ff-412a-944b-c378ca8cc588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd1a33ca9f5144c69a66affd662bb9a6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:09.426162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7c17a200-87ff-412a-944b-c378ca8cc588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd1a33ca9f5144c69a66affd662bb9a6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:09.426309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7c17a200-87ff-412a-944b-c378ca8cc588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd1a33ca9f5144c69a66affd662bb9a6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:09.434286 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7c17a200-87ff-412a-944b-c378ca8cc588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd1a33ca9f5144c69a66affd662bb9a6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:09.434903 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7c17a200-87ff-412a-944b-c378ca8cc588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd1a33ca9f5144c69a66affd662bb9a6'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:09.453070 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1234/2468] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:07:09 2022] DELETE /identity/v3/users/bd1a33ca9f5144c69a66affd662bb9a6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:07:09.622488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd8982-d10b-4e60-955a-e9a4c23ec7f0 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:09.634574 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd8982-d10b-4e60-955a-e9a4c23ec7f0 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:09.694558 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b595f8-950b-4170-8177-3010955ce46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:09.695372 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b595f8-950b-4170-8177-3010955ce46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:09.695675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b595f8-950b-4170-8177-3010955ce46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:09.695964 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b595f8-950b-4170-8177-3010955ce46a admin admin] PATH_INFO: `/v3/projects/ef81ce5d770a4ff094208bb63fc4a18b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:09.697144 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b595f8-950b-4170-8177-3010955ce46a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef81ce5d770a4ff094208bb63fc4a18b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:09.699215 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b595f8-950b-4170-8177-3010955ce46a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:09.747403 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f2b595f8-950b-4170-8177-3010955ce46a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef81ce5d770a4ff094208bb63fc4a18b', 'request_id': 'req-f2b595f8-950b-4170-8177-3010955ce46a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:09.753737 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f2b595f8-950b-4170-8177-3010955ce46a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef81ce5d770a4ff094208bb63fc4a18b', 'request_id': 'req-f2b595f8-950b-4170-8177-3010955ce46a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:09.760247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f2b595f8-950b-4170-8177-3010955ce46a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef81ce5d770a4ff094208bb63fc4a18b', 'request_id': 'req-f2b595f8-950b-4170-8177-3010955ce46a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:09.775090 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f2b595f8-950b-4170-8177-3010955ce46a admin admin] The token cache is being invalidate because project ef81ce5d770a4ff094208bb63fc4a18b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:07:09.775377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f2b595f8-950b-4170-8177-3010955ce46a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:09.775999 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f2b595f8-950b-4170-8177-3010955ce46a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:09.777648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1235/2469] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:07:09 2022] DELETE /identity/v3/projects/ef81ce5d770a4ff094208bb63fc4a18b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:09.783135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3c303-331f-414b-8624-e343a6899bd7 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:09.783432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3c303-331f-414b-8624-e343a6899bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:09.783717 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3c303-331f-414b-8624-e343a6899bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:09.803507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-35e3c303-331f-414b-8624-e343a6899bd7 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:09.804719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-35e3c303-331f-414b-8624-e343a6899bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:09.868999 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1235/2470] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:09.876769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546bee4-888e-4c81-b4be-f44ab0bf8dd5 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:09.877059 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546bee4-888e-4c81-b4be-f44ab0bf8dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:09.877337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546bee4-888e-4c81-b4be-f44ab0bf8dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:09.896462 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4546bee4-888e-4c81-b4be-f44ab0bf8dd5 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:09.897649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4546bee4-888e-4c81-b4be-f44ab0bf8dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:09.906662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1236/2471] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:09.910590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3c303-331f-414b-8624-e343a6899bd7 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:09.921098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3c303-331f-414b-8624-e343a6899bd7 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:09.927108 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d696bc6-0996-4a84-b5e1-f6cfbb431859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:09.927762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d696bc6-0996-4a84-b5e1-f6cfbb431859 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:09.928041 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d696bc6-0996-4a84-b5e1-f6cfbb431859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:09.928314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d696bc6-0996-4a84-b5e1-f6cfbb431859 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:09.929041 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d696bc6-0996-4a84-b5e1-f6cfbb431859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:07:09.929345 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d696bc6-0996-4a84-b5e1-f6cfbb431859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:09.931004 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d696bc6-0996-4a84-b5e1-f6cfbb431859 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:09.943487 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1236/2472] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:07:09.947841 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546bee4-888e-4c81-b4be-f44ab0bf8dd5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:09.957783 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546bee4-888e-4c81-b4be-f44ab0bf8dd5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:09.962449 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611b727-58ae-451d-bebd-ffd6cb9bdd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:09.963093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611b727-58ae-451d-bebd-ffd6cb9bdd25 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:09.963381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611b727-58ae-451d-bebd-ffd6cb9bdd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:09.963656 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611b727-58ae-451d-bebd-ffd6cb9bdd25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:09.964354 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611b727-58ae-451d-bebd-ffd6cb9bdd25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:09.966292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611b727-58ae-451d-bebd-ffd6cb9bdd25 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:09.991357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1237/2473] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:07:09 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:09.995618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d696bc6-0996-4a84-b5e1-f6cfbb431859 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:10.006081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d696bc6-0996-4a84-b5e1-f6cfbb431859 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:10.048785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:10.063301 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c6a26-67e6-4ecc-9d37-b02bfa6be132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:10.063993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c6a26-67e6-4ecc-9d37-b02bfa6be132 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:10.064275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c6a26-67e6-4ecc-9d37-b02bfa6be132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:10.064549 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c6a26-67e6-4ecc-9d37-b02bfa6be132 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:10.065247 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c6a26-67e6-4ecc-9d37-b02bfa6be132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:10.067226 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c6a26-67e6-4ecc-9d37-b02bfa6be132 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:10.087827 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1237/2474] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:07:09 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:07:10.091893 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611b727-58ae-451d-bebd-ffd6cb9bdd25 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:10.102067 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611b727-58ae-451d-bebd-ffd6cb9bdd25 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:10.106675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5888ac-50ef-4dab-a6b4-7c496912215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:10.107325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5888ac-50ef-4dab-a6b4-7c496912215a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:10.107607 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5888ac-50ef-4dab-a6b4-7c496912215a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:10.107888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5888ac-50ef-4dab-a6b4-7c496912215a admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:10.108605 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5888ac-50ef-4dab-a6b4-7c496912215a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:10.110483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5888ac-50ef-4dab-a6b4-7c496912215a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:10.121780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1238/2475] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:10.126300 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c6a26-67e6-4ecc-9d37-b02bfa6be132 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:10.136163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c6a26-67e6-4ecc-9d37-b02bfa6be132 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:10.140813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f79fd-b778-4de3-abee-b04842bad9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:10.141459 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f79fd-b778-4de3-abee-b04842bad9ab admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:10.141741 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f79fd-b778-4de3-abee-b04842bad9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:10.142045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f79fd-b778-4de3-abee-b04842bad9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:10.142762 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f79fd-b778-4de3-abee-b04842bad9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:10.144383 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f79fd-b778-4de3-abee-b04842bad9ab admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:10.154715 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1238/2476] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:10.158937 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5888ac-50ef-4dab-a6b4-7c496912215a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:10.168891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5888ac-50ef-4dab-a6b4-7c496912215a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:10.174075 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56c857-37a1-487f-81ce-9dad474287e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:10.174948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56c857-37a1-487f-81ce-9dad474287e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:10.175228 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56c857-37a1-487f-81ce-9dad474287e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:10.175502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56c857-37a1-487f-81ce-9dad474287e1 admin admin] PATH_INFO: `/v3/projects/783bca046879494bbb57ac6d2ce788f1/users/cb7a2e38642f4c8c9a56e69cf58df413/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:10.189826 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56c857-37a1-487f-81ce-9dad474287e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=783bca046879494bbb57ac6d2ce788f1, user_id=cb7a2e38642f4c8c9a56e69cf58df413, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:10.192510 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56c857-37a1-487f-81ce-9dad474287e1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:10.205125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1239/2477] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:10 2022] PUT /identity/v3/projects/783bca046879494bbb57ac6d2ce788f1/users/cb7a2e38642f4c8c9a56e69cf58df413/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:10.215029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7d2b9-356a-4a42-9740-f29647868b85 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:10.215349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7d2b9-356a-4a42-9740-f29647868b85 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:10.215628 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7d2b9-356a-4a42-9740-f29647868b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:10.242926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f4b7d2b9-356a-4a42-9740-f29647868b85 None None] MFA Rules not processed for user `cb7a2e38642f4c8c9a56e69cf58df413`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:10.244121 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f4b7d2b9-356a-4a42-9740-f29647868b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:10.306835 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1239/2478] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:10.311398 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56c857-37a1-487f-81ce-9dad474287e1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:10.320365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:10.378289 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56c857-37a1-487f-81ce-9dad474287e1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:10.383680 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faee3af-b605-4a3b-ae13-4d81b0f48e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:10.384347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faee3af-b605-4a3b-ae13-4d81b0f48e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:10.384637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faee3af-b605-4a3b-ae13-4d81b0f48e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:10.384909 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faee3af-b605-4a3b-ae13-4d81b0f48e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:10.385613 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faee3af-b605-4a3b-ae13-4d81b0f48e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:10.387560 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faee3af-b605-4a3b-ae13-4d81b0f48e11 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:10.417981 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1240/2479] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:07:10 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:10.421530 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7d2b9-356a-4a42-9740-f29647868b85 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:10.432522 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7d2b9-356a-4a42-9740-f29647868b85 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:10.496298 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2503f-630f-408f-a8c5-99ac7812503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:10.496977 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2503f-630f-408f-a8c5-99ac7812503b admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:10.497260 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2503f-630f-408f-a8c5-99ac7812503b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:10.497625 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2503f-630f-408f-a8c5-99ac7812503b admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:10.498303 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2503f-630f-408f-a8c5-99ac7812503b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:10.500294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2503f-630f-408f-a8c5-99ac7812503b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:10.521888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1240/2480] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:07:10 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:10.525852 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faee3af-b605-4a3b-ae13-4d81b0f48e11 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:10.537374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faee3af-b605-4a3b-ae13-4d81b0f48e11 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:10.542680 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d38b7-36b7-46c5-aa96-e17b47467a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:10.543379 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d38b7-36b7-46c5-aa96-e17b47467a68 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:10.543828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d38b7-36b7-46c5-aa96-e17b47467a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:10.544096 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d38b7-36b7-46c5-aa96-e17b47467a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:10.544991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d38b7-36b7-46c5-aa96-e17b47467a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:10.546997 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d38b7-36b7-46c5-aa96-e17b47467a68 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:10.558434 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1241/2481] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:10.563509 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2503f-630f-408f-a8c5-99ac7812503b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:10.584152 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2503f-630f-408f-a8c5-99ac7812503b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:10.588749 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0a431-4d11-4151-997f-deb594016e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:10.589616 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0a431-4d11-4151-997f-deb594016e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:10.589906 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0a431-4d11-4151-997f-deb594016e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:10.590285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0a431-4d11-4151-997f-deb594016e0e admin admin] PATH_INFO: `/v3/projects/6151f9141ee4438fa8dc9ca5f58d63df/users/e2141e9e88214d51945eb0591d45cc21/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:10.607208 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0a431-4d11-4151-997f-deb594016e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6151f9141ee4438fa8dc9ca5f58d63df, user_id=e2141e9e88214d51945eb0591d45cc21, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:10.610032 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0a431-4d11-4151-997f-deb594016e0e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:10.631764 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1241/2482] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:10 2022] PUT /identity/v3/projects/6151f9141ee4438fa8dc9ca5f58d63df/users/e2141e9e88214d51945eb0591d45cc21/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:10.632104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d38b7-36b7-46c5-aa96-e17b47467a68 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:10.643660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d38b7-36b7-46c5-aa96-e17b47467a68 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:10.704396 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02169f2-5dfa-4f97-9707-2daf2e1e3bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:10.705059 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02169f2-5dfa-4f97-9707-2daf2e1e3bfb admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:10.705345 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02169f2-5dfa-4f97-9707-2daf2e1e3bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:10.705618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02169f2-5dfa-4f97-9707-2daf2e1e3bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:10.706375 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02169f2-5dfa-4f97-9707-2daf2e1e3bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:10.707971 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02169f2-5dfa-4f97-9707-2daf2e1e3bfb admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:10.717771 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1242/2483] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:07:10.722195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0a431-4d11-4151-997f-deb594016e0e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:10.732901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0a431-4d11-4151-997f-deb594016e0e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:10.737800 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2df91-fc5f-4f18-838d-04d801980d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:10.738708 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2df91-fc5f-4f18-838d-04d801980d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:10.738988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2df91-fc5f-4f18-838d-04d801980d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:10.739263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2df91-fc5f-4f18-838d-04d801980d59 admin admin] PATH_INFO: `/v3/projects/6151f9141ee4438fa8dc9ca5f58d63df/users/e2141e9e88214d51945eb0591d45cc21/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:10.741224 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2df91-fc5f-4f18-838d-04d801980d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6151f9141ee4438fa8dc9ca5f58d63df, user_id=e2141e9e88214d51945eb0591d45cc21, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:10.743962 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2df91-fc5f-4f18-838d-04d801980d59 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:10.754657 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1242/2484] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:10 2022] PUT /identity/v3/projects/6151f9141ee4438fa8dc9ca5f58d63df/users/e2141e9e88214d51945eb0591d45cc21/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:10.766142 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcdb01-0c97-4084-adcd-c7dd85b97493 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:10.766435 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcdb01-0c97-4084-adcd-c7dd85b97493 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:10.766822 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcdb01-0c97-4084-adcd-c7dd85b97493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:10.792723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d1fcdb01-0c97-4084-adcd-c7dd85b97493 None None] MFA Rules not processed for user `e2141e9e88214d51945eb0591d45cc21`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:10.793952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d1fcdb01-0c97-4084-adcd-c7dd85b97493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:10.864024 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1243/2485] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:10 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:10.876121 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2df91-fc5f-4f18-838d-04d801980d59 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:10.877881 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-65a2df91-fc5f-4f18-838d-04d801980d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:10.887675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:10.937481 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2df91-fc5f-4f18-838d-04d801980d59 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:10.941229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e8e9a-ef6f-4299-87f4-0a94c88a28a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:10.941861 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e8e9a-ef6f-4299-87f4-0a94c88a28a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:10.942161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e8e9a-ef6f-4299-87f4-0a94c88a28a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:10.942438 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e8e9a-ef6f-4299-87f4-0a94c88a28a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:10.952266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e8e9a-ef6f-4299-87f4-0a94c88a28a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:10.953679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e8e9a-ef6f-4299-87f4-0a94c88a28a3 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:10.962975 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1243/2486] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:10 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:12.287576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcdb01-0c97-4084-adcd-c7dd85b97493 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:12.291708 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:12.349964 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcdb01-0c97-4084-adcd-c7dd85b97493 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:12.354482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807bbd2-71e0-43fc-9d6f-89762ce2f583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:12.355351 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807bbd2-71e0-43fc-9d6f-89762ce2f583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:12.355627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807bbd2-71e0-43fc-9d6f-89762ce2f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:12.355903 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807bbd2-71e0-43fc-9d6f-89762ce2f583 admin admin] PATH_INFO: `/v3/users/cb7a2e38642f4c8c9a56e69cf58df413` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:12.357076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807bbd2-71e0-43fc-9d6f-89762ce2f583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb7a2e38642f4c8c9a56e69cf58df413)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:12.359072 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807bbd2-71e0-43fc-9d6f-89762ce2f583 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:12.405344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e807bbd2-71e0-43fc-9d6f-89762ce2f583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb7a2e38642f4c8c9a56e69cf58df413'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:12.412122 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e807bbd2-71e0-43fc-9d6f-89762ce2f583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb7a2e38642f4c8c9a56e69cf58df413'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:12.419054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e807bbd2-71e0-43fc-9d6f-89762ce2f583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb7a2e38642f4c8c9a56e69cf58df413'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:12.419721 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e807bbd2-71e0-43fc-9d6f-89762ce2f583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb7a2e38642f4c8c9a56e69cf58df413'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:12.420340 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e807bbd2-71e0-43fc-9d6f-89762ce2f583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb7a2e38642f4c8c9a56e69cf58df413'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:12.438043 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1244/2487] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:07:12 2022] DELETE /identity/v3/users/cb7a2e38642f4c8c9a56e69cf58df413 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:12.442561 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b75f9-4e20-437d-a368-63b3e74e84a8 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:12.443024 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b75f9-4e20-437d-a368-63b3e74e84a8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:12.443137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b75f9-4e20-437d-a368-63b3e74e84a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:12.460433 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-1d4b75f9-4e20-437d-a368-63b3e74e84a8 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:12.461634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1d4b75f9-4e20-437d-a368-63b3e74e84a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:12.518932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1244/2488] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:12.528392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807bbd2-71e0-43fc-9d6f-89762ce2f583 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:12.529816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e807bbd2-71e0-43fc-9d6f-89762ce2f583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:12.588061 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807bbd2-71e0-43fc-9d6f-89762ce2f583 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:12.592035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8a929-5468-4f07-9d70-e3dc52130c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:12.592684 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8a929-5468-4f07-9d70-e3dc52130c3f service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:12.592973 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8a929-5468-4f07-9d70-e3dc52130c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:12.593236 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8a929-5468-4f07-9d70-e3dc52130c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:12.604619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8a929-5468-4f07-9d70-e3dc52130c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:12.606409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8a929-5468-4f07-9d70-e3dc52130c3f service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:12.620236 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1245/2489] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:13.162694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b75f9-4e20-437d-a368-63b3e74e84a8 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:13.164106 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-1d4b75f9-4e20-437d-a368-63b3e74e84a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:13.179764 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b75f9-4e20-437d-a368-63b3e74e84a8 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:13.184800 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e994c68-e41f-4eb6-a559-7003d1b74e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:13.185783 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e994c68-e41f-4eb6-a559-7003d1b74e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:13.186249 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e994c68-e41f-4eb6-a559-7003d1b74e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:13.186719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e994c68-e41f-4eb6-a559-7003d1b74e09 admin admin] PATH_INFO: `/v3/projects/783bca046879494bbb57ac6d2ce788f1` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:13.188165 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e994c68-e41f-4eb6-a559-7003d1b74e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=783bca046879494bbb57ac6d2ce788f1)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:13.192153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e994c68-e41f-4eb6-a559-7003d1b74e09 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:13.243576 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5e994c68-e41f-4eb6-a559-7003d1b74e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '783bca046879494bbb57ac6d2ce788f1', 'request_id': 'req-5e994c68-e41f-4eb6-a559-7003d1b74e09'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:13.249337 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5e994c68-e41f-4eb6-a559-7003d1b74e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '783bca046879494bbb57ac6d2ce788f1', 'request_id': 'req-5e994c68-e41f-4eb6-a559-7003d1b74e09'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:13.256595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5e994c68-e41f-4eb6-a559-7003d1b74e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '783bca046879494bbb57ac6d2ce788f1', 'request_id': 'req-5e994c68-e41f-4eb6-a559-7003d1b74e09'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:13.270725 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5e994c68-e41f-4eb6-a559-7003d1b74e09 admin admin] The token cache is being invalidate because project 783bca046879494bbb57ac6d2ce788f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:07:13.270858 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5e994c68-e41f-4eb6-a559-7003d1b74e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:13.271522 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-5e994c68-e41f-4eb6-a559-7003d1b74e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:13.273292 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1245/2490] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:07:13 2022] DELETE /identity/v3/projects/783bca046879494bbb57ac6d2ce788f1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:13.277329 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8a929-5468-4f07-9d70-e3dc52130c3f service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:13.288585 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8a929-5468-4f07-9d70-e3dc52130c3f service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:13.310155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:13.352029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4cdca-0ad0-4026-836a-60b977e8c0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:13.353188 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4cdca-0ad0-4026-836a-60b977e8c0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:13.353475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4cdca-0ad0-4026-836a-60b977e8c0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:13.353752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4cdca-0ad0-4026-836a-60b977e8c0a5 admin admin] PATH_INFO: `/v3/users/e2141e9e88214d51945eb0591d45cc21` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:13.355579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4cdca-0ad0-4026-836a-60b977e8c0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2141e9e88214d51945eb0591d45cc21)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:13.360404 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4cdca-0ad0-4026-836a-60b977e8c0a5 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:13.411848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-33c4cdca-0ad0-4026-836a-60b977e8c0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2141e9e88214d51945eb0591d45cc21'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:13.418910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-33c4cdca-0ad0-4026-836a-60b977e8c0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2141e9e88214d51945eb0591d45cc21'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:13.427353 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-33c4cdca-0ad0-4026-836a-60b977e8c0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2141e9e88214d51945eb0591d45cc21'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:13.428020 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-33c4cdca-0ad0-4026-836a-60b977e8c0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2141e9e88214d51945eb0591d45cc21'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:13.428630 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-33c4cdca-0ad0-4026-836a-60b977e8c0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2141e9e88214d51945eb0591d45cc21'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:13.450038 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1246/2491] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:07:13 2022] DELETE /identity/v3/users/e2141e9e88214d51945eb0591d45cc21 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:13.711807 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e994c68-e41f-4eb6-a559-7003d1b74e09 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:13.713396 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5e994c68-e41f-4eb6-a559-7003d1b74e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:13.728194 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e994c68-e41f-4eb6-a559-7003d1b74e09 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:13.761446 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:13.790436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bd2e0-7c85-4c7c-a494-74cd0dbf61d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:13.791250 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bd2e0-7c85-4c7c-a494-74cd0dbf61d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:13.791528 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bd2e0-7c85-4c7c-a494-74cd0dbf61d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:13.791802 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bd2e0-7c85-4c7c-a494-74cd0dbf61d2 admin admin] PATH_INFO: `/v3/projects/6151f9141ee4438fa8dc9ca5f58d63df` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:13.792982 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bd2e0-7c85-4c7c-a494-74cd0dbf61d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6151f9141ee4438fa8dc9ca5f58d63df)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:13.795006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bd2e0-7c85-4c7c-a494-74cd0dbf61d2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:13.840990 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c9bd2e0-7c85-4c7c-a494-74cd0dbf61d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6151f9141ee4438fa8dc9ca5f58d63df', 'request_id': 'req-2c9bd2e0-7c85-4c7c-a494-74cd0dbf61d2'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:13.846655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c9bd2e0-7c85-4c7c-a494-74cd0dbf61d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6151f9141ee4438fa8dc9ca5f58d63df', 'request_id': 'req-2c9bd2e0-7c85-4c7c-a494-74cd0dbf61d2'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:13.852704 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c9bd2e0-7c85-4c7c-a494-74cd0dbf61d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6151f9141ee4438fa8dc9ca5f58d63df', 'request_id': 'req-2c9bd2e0-7c85-4c7c-a494-74cd0dbf61d2'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:13.866028 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c9bd2e0-7c85-4c7c-a494-74cd0dbf61d2 admin admin] The token cache is being invalidate because project 6151f9141ee4438fa8dc9ca5f58d63df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:07:13.866313 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c9bd2e0-7c85-4c7c-a494-74cd0dbf61d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:13.866931 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c9bd2e0-7c85-4c7c-a494-74cd0dbf61d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:13.868461 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1246/2492] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:07:13 2022] DELETE /identity/v3/projects/6151f9141ee4438fa8dc9ca5f58d63df => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:13.873905 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39473042-2a72-4869-876e-aa8b9ddf45ee None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:13.874226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39473042-2a72-4869-876e-aa8b9ddf45ee None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:13.874507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39473042-2a72-4869-876e-aa8b9ddf45ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:13.894089 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-39473042-2a72-4869-876e-aa8b9ddf45ee None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:13.895277 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-39473042-2a72-4869-876e-aa8b9ddf45ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:13.953301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1247/2493] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:07:13.961744 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab326fd-420d-48ab-9912-9a876998b747 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:13.962115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab326fd-420d-48ab-9912-9a876998b747 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:13.962391 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab326fd-420d-48ab-9912-9a876998b747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:13.982820 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-7ab326fd-420d-48ab-9912-9a876998b747 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:13.984018 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7ab326fd-420d-48ab-9912-9a876998b747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:13.992462 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1247/2494] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:13.996568 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39473042-2a72-4869-876e-aa8b9ddf45ee None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:14.006160 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39473042-2a72-4869-876e-aa8b9ddf45ee None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:14.010633 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee1a88-6b95-4fc3-af24-8a21eb8c9358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:14.011270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee1a88-6b95-4fc3-af24-8a21eb8c9358 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:14.011549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee1a88-6b95-4fc3-af24-8a21eb8c9358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:14.011822 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee1a88-6b95-4fc3-af24-8a21eb8c9358 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:14.012533 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee1a88-6b95-4fc3-af24-8a21eb8c9358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:07:14.012836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee1a88-6b95-4fc3-af24-8a21eb8c9358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:14.014476 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee1a88-6b95-4fc3-af24-8a21eb8c9358 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:14.025728 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1248/2495] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:07:14.030744 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab326fd-420d-48ab-9912-9a876998b747 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:14.039969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab326fd-420d-48ab-9912-9a876998b747 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:14.045197 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453ca38-0368-4101-bb6a-c465854ef28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:14.045820 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453ca38-0368-4101-bb6a-c465854ef28e admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:14.046136 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453ca38-0368-4101-bb6a-c465854ef28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:14.046451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453ca38-0368-4101-bb6a-c465854ef28e admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:14.047153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453ca38-0368-4101-bb6a-c465854ef28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:14.049061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453ca38-0368-4101-bb6a-c465854ef28e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:14.073221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1248/2496] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:07:14 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:07:14.078280 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee1a88-6b95-4fc3-af24-8a21eb8c9358 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:14.088069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee1a88-6b95-4fc3-af24-8a21eb8c9358 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:14.116365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:14.146835 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0fa98-8f03-43d5-b1f5-1f8ad99feeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:14.147496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0fa98-8f03-43d5-b1f5-1f8ad99feeca admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:14.147774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0fa98-8f03-43d5-b1f5-1f8ad99feeca admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:14.148043 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0fa98-8f03-43d5-b1f5-1f8ad99feeca admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:14.148719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0fa98-8f03-43d5-b1f5-1f8ad99feeca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:14.150650 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0fa98-8f03-43d5-b1f5-1f8ad99feeca admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:14.169885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1249/2497] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:07:14 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:14.174138 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453ca38-0368-4101-bb6a-c465854ef28e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:14.184374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453ca38-0368-4101-bb6a-c465854ef28e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:14.189019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be0ef3-598b-456f-b73c-da6477baebb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:14.189664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0ef3-598b-456f-b73c-da6477baebb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:14.189976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0ef3-598b-456f-b73c-da6477baebb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:14.190257 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0ef3-598b-456f-b73c-da6477baebb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:14.190987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be0ef3-598b-456f-b73c-da6477baebb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:14.192586 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be0ef3-598b-456f-b73c-da6477baebb7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:14.203963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1249/2498] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:14.207836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0fa98-8f03-43d5-b1f5-1f8ad99feeca admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:14.218220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0fa98-8f03-43d5-b1f5-1f8ad99feeca admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:14.222782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7294907-8394-4817-b0e1-cfb48da840cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:14.223423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7294907-8394-4817-b0e1-cfb48da840cd admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:14.223704 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7294907-8394-4817-b0e1-cfb48da840cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:14.223979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7294907-8394-4817-b0e1-cfb48da840cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:14.224693 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7294907-8394-4817-b0e1-cfb48da840cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:14.226359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7294907-8394-4817-b0e1-cfb48da840cd admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:14.237441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1250/2499] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:14.241436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be0ef3-598b-456f-b73c-da6477baebb7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:14.251444 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be0ef3-598b-456f-b73c-da6477baebb7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:14.256290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfe8f7-2938-48c6-8aad-68475cc0f58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:14.257146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe8f7-2938-48c6-8aad-68475cc0f58e admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:14.257426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe8f7-2938-48c6-8aad-68475cc0f58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:14.257715 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe8f7-2938-48c6-8aad-68475cc0f58e admin admin] PATH_INFO: `/v3/projects/2b704a45b68b4645b21b22f0cecc80db/users/57ffeecfe02b4165bc4e53c568a3ebdb/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:14.272378 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfe8f7-2938-48c6-8aad-68475cc0f58e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b704a45b68b4645b21b22f0cecc80db, user_id=57ffeecfe02b4165bc4e53c568a3ebdb, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:14.275055 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfe8f7-2938-48c6-8aad-68475cc0f58e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:14.288071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1250/2500] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:14 2022] PUT /identity/v3/projects/2b704a45b68b4645b21b22f0cecc80db/users/57ffeecfe02b4165bc4e53c568a3ebdb/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:14.299211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3dfa8-a9c3-4506-9698-d2ee642016d5 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:14.299688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3dfa8-a9c3-4506-9698-d2ee642016d5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:14.299688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3dfa8-a9c3-4506-9698-d2ee642016d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:14.325479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c5e3dfa8-a9c3-4506-9698-d2ee642016d5 None None] MFA Rules not processed for user `57ffeecfe02b4165bc4e53c568a3ebdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:14.327446 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c5e3dfa8-a9c3-4506-9698-d2ee642016d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:14.392008 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1251/2501] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:07:14.396412 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfe8f7-2938-48c6-8aad-68475cc0f58e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:14.456929 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfe8f7-2938-48c6-8aad-68475cc0f58e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:14.461640 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e08390-e81e-4dae-a62b-57a9d65602cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:14.462334 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e08390-e81e-4dae-a62b-57a9d65602cd admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:14.462622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e08390-e81e-4dae-a62b-57a9d65602cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:14.462901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e08390-e81e-4dae-a62b-57a9d65602cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:14.463591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e08390-e81e-4dae-a62b-57a9d65602cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:14.465501 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e08390-e81e-4dae-a62b-57a9d65602cd admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:14.468952 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:14.492957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1251/2502] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:07:14 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:14.497007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3dfa8-a9c3-4506-9698-d2ee642016d5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:14.508250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3dfa8-a9c3-4506-9698-d2ee642016d5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:14.565211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1423220-d157-49c6-aa3c-52328bffca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:14.566057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1423220-d157-49c6-aa3c-52328bffca16 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:14.566324 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1423220-d157-49c6-aa3c-52328bffca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:14.566602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1423220-d157-49c6-aa3c-52328bffca16 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:14.567336 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1423220-d157-49c6-aa3c-52328bffca16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:14.569300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1423220-d157-49c6-aa3c-52328bffca16 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:14.592224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1252/2503] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:07:14 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:14.596098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e08390-e81e-4dae-a62b-57a9d65602cd admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:14.606718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e08390-e81e-4dae-a62b-57a9d65602cd admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:14.612399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e512e6-97c9-40dc-b977-33c78e262f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:14.613178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e512e6-97c9-40dc-b977-33c78e262f84 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:14.613324 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e512e6-97c9-40dc-b977-33c78e262f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:14.613633 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e512e6-97c9-40dc-b977-33c78e262f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:14.614410 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e512e6-97c9-40dc-b977-33c78e262f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:14.616039 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e512e6-97c9-40dc-b977-33c78e262f84 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:14.627563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1252/2504] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:14.632082 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1423220-d157-49c6-aa3c-52328bffca16 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:14.642244 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1423220-d157-49c6-aa3c-52328bffca16 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:14.646964 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac969e-dc17-41b8-8aa5-03667d9cfe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:14.647863 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac969e-dc17-41b8-8aa5-03667d9cfe56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:14.648141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac969e-dc17-41b8-8aa5-03667d9cfe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:14.648414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac969e-dc17-41b8-8aa5-03667d9cfe56 admin admin] PATH_INFO: `/v3/projects/117d65299dd8451c94f7f2b0b4558e84/users/7c00611effce4c8684f5dc30effee00f/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:14.663816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac969e-dc17-41b8-8aa5-03667d9cfe56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=117d65299dd8451c94f7f2b0b4558e84, user_id=7c00611effce4c8684f5dc30effee00f, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:14.666613 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac969e-dc17-41b8-8aa5-03667d9cfe56 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:14.679845 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1253/2505] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:14 2022] PUT /identity/v3/projects/117d65299dd8451c94f7f2b0b4558e84/users/7c00611effce4c8684f5dc30effee00f/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:14.683812 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e512e6-97c9-40dc-b977-33c78e262f84 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:14.693759 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e512e6-97c9-40dc-b977-33c78e262f84 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:14.749069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbc382-14ba-47c7-8656-c66c7d3243a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:14.749722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbc382-14ba-47c7-8656-c66c7d3243a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:14.750033 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbc382-14ba-47c7-8656-c66c7d3243a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:14.750307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbc382-14ba-47c7-8656-c66c7d3243a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:14.751025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dbc382-14ba-47c7-8656-c66c7d3243a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:14.752605 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dbc382-14ba-47c7-8656-c66c7d3243a3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:14.762341 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1253/2506] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:14.766653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac969e-dc17-41b8-8aa5-03667d9cfe56 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:14.775339 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:14.781010 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac969e-dc17-41b8-8aa5-03667d9cfe56 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:14.786611 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b306cf1-c3a2-4583-b367-d9aa385486fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:14.787488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b306cf1-c3a2-4583-b367-d9aa385486fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:14.787768 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b306cf1-c3a2-4583-b367-d9aa385486fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:14.788045 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b306cf1-c3a2-4583-b367-d9aa385486fd admin admin] PATH_INFO: `/v3/projects/117d65299dd8451c94f7f2b0b4558e84/users/7c00611effce4c8684f5dc30effee00f/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:14.790033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b306cf1-c3a2-4583-b367-d9aa385486fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=117d65299dd8451c94f7f2b0b4558e84, user_id=7c00611effce4c8684f5dc30effee00f, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:14.792709 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b306cf1-c3a2-4583-b367-d9aa385486fd admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:14.803483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1254/2507] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:14 2022] PUT /identity/v3/projects/117d65299dd8451c94f7f2b0b4558e84/users/7c00611effce4c8684f5dc30effee00f/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:14.813430 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4395a-85f4-4d28-ac10-9ab10d308ad8 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:14.813721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4395a-85f4-4d28-ac10-9ab10d308ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:14.814038 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4395a-85f4-4d28-ac10-9ab10d308ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:14.840340 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d4d4395a-85f4-4d28-ac10-9ab10d308ad8 None None] MFA Rules not processed for user `7c00611effce4c8684f5dc30effee00f`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:14.842031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d4d4395a-85f4-4d28-ac10-9ab10d308ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:14.909411 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1254/2508] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:14.920838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b306cf1-c3a2-4583-b367-d9aa385486fd admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:14.922561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7b306cf1-c3a2-4583-b367-d9aa385486fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:14.978271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b306cf1-c3a2-4583-b367-d9aa385486fd admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:14.981856 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e184f47-e962-469e-a1f8-82fedb62dac7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:14.982555 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e184f47-e962-469e-a1f8-82fedb62dac7 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:14.982838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e184f47-e962-469e-a1f8-82fedb62dac7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:14.983113 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e184f47-e962-469e-a1f8-82fedb62dac7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:14.992238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e184f47-e962-469e-a1f8-82fedb62dac7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:14.993661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e184f47-e962-469e-a1f8-82fedb62dac7 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:15.002973 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1255/2509] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:15.065308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4395a-85f4-4d28-ac10-9ab10d308ad8 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:15.122093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:15.129664 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4395a-85f4-4d28-ac10-9ab10d308ad8 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:15.134510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fbbb9-74a4-46d4-9647-9a84afde3f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:15.135388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fbbb9-74a4-46d4-9647-9a84afde3f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:15.135672 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fbbb9-74a4-46d4-9647-9a84afde3f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:15.135965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fbbb9-74a4-46d4-9647-9a84afde3f2f admin admin] PATH_INFO: `/v3/users/57ffeecfe02b4165bc4e53c568a3ebdb` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:15.137183 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fbbb9-74a4-46d4-9647-9a84afde3f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ffeecfe02b4165bc4e53c568a3ebdb)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:15.139128 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fbbb9-74a4-46d4-9647-9a84afde3f2f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:15.184574 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6c8fbbb9-74a4-46d4-9647-9a84afde3f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ffeecfe02b4165bc4e53c568a3ebdb'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:15.191420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6c8fbbb9-74a4-46d4-9647-9a84afde3f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ffeecfe02b4165bc4e53c568a3ebdb'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:15.192074 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6c8fbbb9-74a4-46d4-9647-9a84afde3f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ffeecfe02b4165bc4e53c568a3ebdb'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:15.199628 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6c8fbbb9-74a4-46d4-9647-9a84afde3f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ffeecfe02b4165bc4e53c568a3ebdb'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:15.200485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-6c8fbbb9-74a4-46d4-9647-9a84afde3f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ffeecfe02b4165bc4e53c568a3ebdb'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:15.218162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1255/2510] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:07:15 2022] DELETE /identity/v3/users/57ffeecfe02b4165bc4e53c568a3ebdb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:15.222790 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5813f-75f9-41e4-9ba0-4186b384768c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:15.223082 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5813f-75f9-41e4-9ba0-4186b384768c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:15.223359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5813f-75f9-41e4-9ba0-4186b384768c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:15.241321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7ca5813f-75f9-41e4-9ba0-4186b384768c None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:15.242550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7ca5813f-75f9-41e4-9ba0-4186b384768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:15.299683 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1256/2511] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:15.309287 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fbbb9-74a4-46d4-9647-9a84afde3f2f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:15.311211 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6c8fbbb9-74a4-46d4-9647-9a84afde3f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:15.370046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fbbb9-74a4-46d4-9647-9a84afde3f2f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:15.376440 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa81a1-ae92-44a6-a1fa-2e7289121947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:15.377285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa81a1-ae92-44a6-a1fa-2e7289121947 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:15.377573 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa81a1-ae92-44a6-a1fa-2e7289121947 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:15.377851 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa81a1-ae92-44a6-a1fa-2e7289121947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:15.387327 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa81a1-ae92-44a6-a1fa-2e7289121947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:15.389356 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa81a1-ae92-44a6-a1fa-2e7289121947 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:15.398760 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1256/2512] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:15.668637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5813f-75f9-41e4-9ba0-4186b384768c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:15.670720 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7ca5813f-75f9-41e4-9ba0-4186b384768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:15.682836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5813f-75f9-41e4-9ba0-4186b384768c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:15.689126 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e4255-843c-4cc6-84c2-064394c09fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:15.690030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e4255-843c-4cc6-84c2-064394c09fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:15.690311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e4255-843c-4cc6-84c2-064394c09fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:15.690583 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e4255-843c-4cc6-84c2-064394c09fb9 admin admin] PATH_INFO: `/v3/projects/2b704a45b68b4645b21b22f0cecc80db` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:15.691772 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e4255-843c-4cc6-84c2-064394c09fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b704a45b68b4645b21b22f0cecc80db)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:15.693698 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e4255-843c-4cc6-84c2-064394c09fb9 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:15.743008 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5d2e4255-843c-4cc6-84c2-064394c09fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b704a45b68b4645b21b22f0cecc80db', 'request_id': 'req-5d2e4255-843c-4cc6-84c2-064394c09fb9'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:15.749745 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5d2e4255-843c-4cc6-84c2-064394c09fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b704a45b68b4645b21b22f0cecc80db', 'request_id': 'req-5d2e4255-843c-4cc6-84c2-064394c09fb9'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:15.755676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5d2e4255-843c-4cc6-84c2-064394c09fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b704a45b68b4645b21b22f0cecc80db', 'request_id': 'req-5d2e4255-843c-4cc6-84c2-064394c09fb9'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:15.769103 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5d2e4255-843c-4cc6-84c2-064394c09fb9 admin admin] The token cache is being invalidate because project 2b704a45b68b4645b21b22f0cecc80db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:07:15.769398 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5d2e4255-843c-4cc6-84c2-064394c09fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:15.770055 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5d2e4255-843c-4cc6-84c2-064394c09fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:15.771655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1257/2513] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:07:15 2022] DELETE /identity/v3/projects/2b704a45b68b4645b21b22f0cecc80db => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:15.775724 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa81a1-ae92-44a6-a1fa-2e7289121947 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:15.785679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa81a1-ae92-44a6-a1fa-2e7289121947 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:15.841142 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41826b-2703-4a72-9a5a-f5d94833b4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:15.842065 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41826b-2703-4a72-9a5a-f5d94833b4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:15.842364 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41826b-2703-4a72-9a5a-f5d94833b4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:15.842618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41826b-2703-4a72-9a5a-f5d94833b4cf admin admin] PATH_INFO: `/v3/users/7c00611effce4c8684f5dc30effee00f` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:15.843790 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41826b-2703-4a72-9a5a-f5d94833b4cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c00611effce4c8684f5dc30effee00f)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:15.845684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41826b-2703-4a72-9a5a-f5d94833b4cf admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:15.866363 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:15.891318 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0e41826b-2703-4a72-9a5a-f5d94833b4cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c00611effce4c8684f5dc30effee00f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:15.897992 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0e41826b-2703-4a72-9a5a-f5d94833b4cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c00611effce4c8684f5dc30effee00f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:15.898648 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0e41826b-2703-4a72-9a5a-f5d94833b4cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c00611effce4c8684f5dc30effee00f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:15.906179 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0e41826b-2703-4a72-9a5a-f5d94833b4cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c00611effce4c8684f5dc30effee00f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:15.906793 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0e41826b-2703-4a72-9a5a-f5d94833b4cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c00611effce4c8684f5dc30effee00f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:15.924137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1257/2514] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:07:15 2022] DELETE /identity/v3/users/7c00611effce4c8684f5dc30effee00f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:16.187344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e4255-843c-4cc6-84c2-064394c09fb9 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:16.188838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5d2e4255-843c-4cc6-84c2-064394c09fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:16.202332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e4255-843c-4cc6-84c2-064394c09fb9 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:16.215844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:16.262846 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e58b2-2f1d-42e7-8ec1-51cd6f530e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:16.263729 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e58b2-2f1d-42e7-8ec1-51cd6f530e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:16.264009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e58b2-2f1d-42e7-8ec1-51cd6f530e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:16.264282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e58b2-2f1d-42e7-8ec1-51cd6f530e29 admin admin] PATH_INFO: `/v3/projects/117d65299dd8451c94f7f2b0b4558e84` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:16.265470 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e58b2-2f1d-42e7-8ec1-51cd6f530e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=117d65299dd8451c94f7f2b0b4558e84)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:16.267416 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e58b2-2f1d-42e7-8ec1-51cd6f530e29 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:16.314468 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b47e58b2-2f1d-42e7-8ec1-51cd6f530e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '117d65299dd8451c94f7f2b0b4558e84', 'request_id': 'req-b47e58b2-2f1d-42e7-8ec1-51cd6f530e29'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:16.320502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b47e58b2-2f1d-42e7-8ec1-51cd6f530e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '117d65299dd8451c94f7f2b0b4558e84', 'request_id': 'req-b47e58b2-2f1d-42e7-8ec1-51cd6f530e29'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:16.326531 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b47e58b2-2f1d-42e7-8ec1-51cd6f530e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '117d65299dd8451c94f7f2b0b4558e84', 'request_id': 'req-b47e58b2-2f1d-42e7-8ec1-51cd6f530e29'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:16.338657 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b47e58b2-2f1d-42e7-8ec1-51cd6f530e29 admin admin] The token cache is being invalidate because project 117d65299dd8451c94f7f2b0b4558e84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:07:16.338941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b47e58b2-2f1d-42e7-8ec1-51cd6f530e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:16.339553 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b47e58b2-2f1d-42e7-8ec1-51cd6f530e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:16.341105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1258/2515] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:07:16 2022] DELETE /identity/v3/projects/117d65299dd8451c94f7f2b0b4558e84 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:16.346474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d50146-3217-4196-a47e-8fac232e5e77 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:16.346758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d50146-3217-4196-a47e-8fac232e5e77 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:16.347031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d50146-3217-4196-a47e-8fac232e5e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:16.365700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e6d50146-3217-4196-a47e-8fac232e5e77 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:16.366945 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e6d50146-3217-4196-a47e-8fac232e5e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:16.425021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1258/2516] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:16.432763 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511a297-37bc-4455-bf4d-a31f54595c3f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:16.432994 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511a297-37bc-4455-bf4d-a31f54595c3f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:16.433275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511a297-37bc-4455-bf4d-a31f54595c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:16.452315 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d511a297-37bc-4455-bf4d-a31f54595c3f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:16.453517 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d511a297-37bc-4455-bf4d-a31f54595c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:16.461550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1259/2517] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:16.465753 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d50146-3217-4196-a47e-8fac232e5e77 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:16.476057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d50146-3217-4196-a47e-8fac232e5e77 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:16.480718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af71995-aaae-40a2-8f7e-77b873165f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:16.481370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af71995-aaae-40a2-8f7e-77b873165f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:16.481657 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af71995-aaae-40a2-8f7e-77b873165f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:16.481952 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af71995-aaae-40a2-8f7e-77b873165f71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:16.483183 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af71995-aaae-40a2-8f7e-77b873165f71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:07:16.483491 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af71995-aaae-40a2-8f7e-77b873165f71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:16.485353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af71995-aaae-40a2-8f7e-77b873165f71 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:16.496915 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1259/2518] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:07:16.501523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511a297-37bc-4455-bf4d-a31f54595c3f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:16.510711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511a297-37bc-4455-bf4d-a31f54595c3f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:16.515402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c03df-3f96-45e2-9e15-b065e71ec8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:16.516042 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c03df-3f96-45e2-9e15-b065e71ec8bc admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:16.516327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c03df-3f96-45e2-9e15-b065e71ec8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:16.516604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c03df-3f96-45e2-9e15-b065e71ec8bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:16.517301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c03df-3f96-45e2-9e15-b065e71ec8bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:16.519251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c03df-3f96-45e2-9e15-b065e71ec8bc admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:16.544223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1260/2519] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:07:16 2022] POST /identity/v3/projects => generated 391 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:16.548874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af71995-aaae-40a2-8f7e-77b873165f71 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:16.558969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af71995-aaae-40a2-8f7e-77b873165f71 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:16.621205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7548e-abdf-4c66-b471-2086363b58a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:16.621869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7548e-abdf-4c66-b471-2086363b58a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:16.622185 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7548e-abdf-4c66-b471-2086363b58a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:16.622465 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7548e-abdf-4c66-b471-2086363b58a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:16.623710 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7548e-abdf-4c66-b471-2086363b58a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:16.625630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7548e-abdf-4c66-b471-2086363b58a3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:16.645909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1260/2520] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:07:16 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:16.649987 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c03df-3f96-45e2-9e15-b065e71ec8bc admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:16.661034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c03df-3f96-45e2-9e15-b065e71ec8bc admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:16.665640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd86f3-67e3-4d4d-b568-2ccf34cea027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:16.666358 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd86f3-67e3-4d4d-b568-2ccf34cea027 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:16.666626 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd86f3-67e3-4d4d-b568-2ccf34cea027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:16.666902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd86f3-67e3-4d4d-b568-2ccf34cea027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:16.667677 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd86f3-67e3-4d4d-b568-2ccf34cea027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:16.669283 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd86f3-67e3-4d4d-b568-2ccf34cea027 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:16.679776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1261/2521] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:16.684172 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7548e-abdf-4c66-b471-2086363b58a3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:16.694586 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7548e-abdf-4c66-b471-2086363b58a3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:16.699267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c6183-4016-4a26-99ed-145ad5f79c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:16.699918 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c6183-4016-4a26-99ed-145ad5f79c54 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:16.700204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c6183-4016-4a26-99ed-145ad5f79c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:16.700485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c6183-4016-4a26-99ed-145ad5f79c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:16.702093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c6183-4016-4a26-99ed-145ad5f79c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:16.703694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c6183-4016-4a26-99ed-145ad5f79c54 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:16.713474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1261/2522] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:16.717980 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd86f3-67e3-4d4d-b568-2ccf34cea027 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:16.728028 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd86f3-67e3-4d4d-b568-2ccf34cea027 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:16.732754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad51b6-30e6-404e-bbfe-5ef4fbc8a639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:16.733635 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad51b6-30e6-404e-bbfe-5ef4fbc8a639 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:16.733918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad51b6-30e6-404e-bbfe-5ef4fbc8a639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:16.734222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad51b6-30e6-404e-bbfe-5ef4fbc8a639 admin admin] PATH_INFO: `/v3/projects/d254ee469b9c491b9e2fa3bf0d1f3d18/users/1fac2a0d72e04b47bb9f99589e89bf32/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:16.749416 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad51b6-30e6-404e-bbfe-5ef4fbc8a639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d254ee469b9c491b9e2fa3bf0d1f3d18, user_id=1fac2a0d72e04b47bb9f99589e89bf32, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:16.752123 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad51b6-30e6-404e-bbfe-5ef4fbc8a639 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:16.765287 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1262/2523] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:16 2022] PUT /identity/v3/projects/d254ee469b9c491b9e2fa3bf0d1f3d18/users/1fac2a0d72e04b47bb9f99589e89bf32/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:16.776675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7a6d7-9499-4aa8-856f-8aa1ffb6d934 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:16.777151 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7a6d7-9499-4aa8-856f-8aa1ffb6d934 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:16.777270 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7a6d7-9499-4aa8-856f-8aa1ffb6d934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:16.783021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:16.806580 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b1c7a6d7-9499-4aa8-856f-8aa1ffb6d934 None None] MFA Rules not processed for user `1fac2a0d72e04b47bb9f99589e89bf32`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:16.807791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b1c7a6d7-9499-4aa8-856f-8aa1ffb6d934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:16.874354 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1262/2524] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:16.878844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad51b6-30e6-404e-bbfe-5ef4fbc8a639 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:16.926399 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:16.945375 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad51b6-30e6-404e-bbfe-5ef4fbc8a639 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:16.950045 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f63c0-75df-4c29-8b7b-ab8838ee7c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:16.950798 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f63c0-75df-4c29-8b7b-ab8838ee7c78 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:16.951577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f63c0-75df-4c29-8b7b-ab8838ee7c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:16.951849 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f63c0-75df-4c29-8b7b-ab8838ee7c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:16.952533 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f63c0-75df-4c29-8b7b-ab8838ee7c78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:16.954457 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f63c0-75df-4c29-8b7b-ab8838ee7c78 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:16.980011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1263/2525] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:07:16 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:16.983973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7a6d7-9499-4aa8-856f-8aa1ffb6d934 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:16.994858 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7a6d7-9499-4aa8-856f-8aa1ffb6d934 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:17.050278 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbca372-782d-4bea-b9ff-6425ba6babb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:17.050941 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca372-782d-4bea-b9ff-6425ba6babb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:17.051223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca372-782d-4bea-b9ff-6425ba6babb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:17.051499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca372-782d-4bea-b9ff-6425ba6babb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:17.052182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbca372-782d-4bea-b9ff-6425ba6babb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:17.054118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbca372-782d-4bea-b9ff-6425ba6babb4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:17.073840 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1263/2526] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:07:16 2022] POST /identity/v3/users => generated 302 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:17.077881 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f63c0-75df-4c29-8b7b-ab8838ee7c78 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:17.088125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f63c0-75df-4c29-8b7b-ab8838ee7c78 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:17.092625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec782e-a992-42ac-9463-a206f8f2e5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:17.093269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec782e-a992-42ac-9463-a206f8f2e5af admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:17.093557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec782e-a992-42ac-9463-a206f8f2e5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:17.094030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec782e-a992-42ac-9463-a206f8f2e5af admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:17.094746 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec782e-a992-42ac-9463-a206f8f2e5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:17.096350 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec782e-a992-42ac-9463-a206f8f2e5af admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:17.106649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1264/2527] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:17.111414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbca372-782d-4bea-b9ff-6425ba6babb4 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:17.121268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbca372-782d-4bea-b9ff-6425ba6babb4 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:17.126517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35f782-4b73-4d01-923a-422f826d13a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:17.127386 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35f782-4b73-4d01-923a-422f826d13a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:17.127668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35f782-4b73-4d01-923a-422f826d13a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:17.127962 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35f782-4b73-4d01-923a-422f826d13a7 admin admin] PATH_INFO: `/v3/projects/46322b071e994602908a10c1b0fb3d5b/users/92fddd24db5b41a983b87423f8dec0d5/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:17.142441 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35f782-4b73-4d01-923a-422f826d13a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46322b071e994602908a10c1b0fb3d5b, user_id=92fddd24db5b41a983b87423f8dec0d5, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:17.145296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35f782-4b73-4d01-923a-422f826d13a7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:17.157723 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1264/2528] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:17 2022] PUT /identity/v3/projects/46322b071e994602908a10c1b0fb3d5b/users/92fddd24db5b41a983b87423f8dec0d5/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:17.161572 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec782e-a992-42ac-9463-a206f8f2e5af admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:17.171932 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec782e-a992-42ac-9463-a206f8f2e5af admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:17.227110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2dc4b9-ee49-4516-a840-27fc9e1c9f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:17.227692 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dc4b9-ee49-4516-a840-27fc9e1c9f9c admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:17.227971 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dc4b9-ee49-4516-a840-27fc9e1c9f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:17.228241 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dc4b9-ee49-4516-a840-27fc9e1c9f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:17.228948 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2dc4b9-ee49-4516-a840-27fc9e1c9f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:17.230601 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2dc4b9-ee49-4516-a840-27fc9e1c9f9c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:17.240987 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1265/2529] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:17.245517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35f782-4b73-4d01-923a-422f826d13a7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:17.256055 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35f782-4b73-4d01-923a-422f826d13a7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:17.261108 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8abe2-4646-464a-89f3-ffb4eb4d9101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:17.262046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8abe2-4646-464a-89f3-ffb4eb4d9101 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:17.262332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8abe2-4646-464a-89f3-ffb4eb4d9101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:17.262609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8abe2-4646-464a-89f3-ffb4eb4d9101 admin admin] PATH_INFO: `/v3/projects/46322b071e994602908a10c1b0fb3d5b/users/92fddd24db5b41a983b87423f8dec0d5/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:17.265060 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8abe2-4646-464a-89f3-ffb4eb4d9101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46322b071e994602908a10c1b0fb3d5b, user_id=92fddd24db5b41a983b87423f8dec0d5, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:17.267759 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8abe2-4646-464a-89f3-ffb4eb4d9101 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:17.277884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1265/2530] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:17 2022] PUT /identity/v3/projects/46322b071e994602908a10c1b0fb3d5b/users/92fddd24db5b41a983b87423f8dec0d5/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:17.288515 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56136b7e-12dd-49d4-9cb3-528c6995c63f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:17.288807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56136b7e-12dd-49d4-9cb3-528c6995c63f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:17.289085 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56136b7e-12dd-49d4-9cb3-528c6995c63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:17.315654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-56136b7e-12dd-49d4-9cb3-528c6995c63f None None] MFA Rules not processed for user `92fddd24db5b41a983b87423f8dec0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:17.316857 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-56136b7e-12dd-49d4-9cb3-528c6995c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:17.390668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1266/2531] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:17.401286 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8abe2-4646-464a-89f3-ffb4eb4d9101 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:17.403029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-13d8abe2-4646-464a-89f3-ffb4eb4d9101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:17.449530 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:17.460536 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8abe2-4646-464a-89f3-ffb4eb4d9101 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:17.464100 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec719d-bbbe-47e3-9872-a0fcb180c00e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:17.464728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec719d-bbbe-47e3-9872-a0fcb180c00e service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:17.465007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec719d-bbbe-47e3-9872-a0fcb180c00e service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:17.465285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec719d-bbbe-47e3-9872-a0fcb180c00e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:17.474629 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec719d-bbbe-47e3-9872-a0fcb180c00e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:17.476039 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec719d-bbbe-47e3-9872-a0fcb180c00e service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:17.486189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1266/2532] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:17.533127 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56136b7e-12dd-49d4-9cb3-528c6995c63f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:17.534559 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-56136b7e-12dd-49d4-9cb3-528c6995c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:17.546861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56136b7e-12dd-49d4-9cb3-528c6995c63f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:17.550407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebd6cf-a46d-48c0-8502-aa7414b11a26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:17.551035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebd6cf-a46d-48c0-8502-aa7414b11a26 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:17.551317 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebd6cf-a46d-48c0-8502-aa7414b11a26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:17.551588 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebd6cf-a46d-48c0-8502-aa7414b11a26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:17.588533 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:17.608584 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebd6cf-a46d-48c0-8502-aa7414b11a26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:17.610318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebd6cf-a46d-48c0-8502-aa7414b11a26 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:17.619231 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1267/2533] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:20.833409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec719d-bbbe-47e3-9872-a0fcb180c00e service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:20.895029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec719d-bbbe-47e3-9872-a0fcb180c00e service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:20.899463 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3491a9c-d915-4be4-b024-e84101b78051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:20.900305 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3491a9c-d915-4be4-b024-e84101b78051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:20.900586 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3491a9c-d915-4be4-b024-e84101b78051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:20.900856 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3491a9c-d915-4be4-b024-e84101b78051 admin admin] PATH_INFO: `/v3/users/1fac2a0d72e04b47bb9f99589e89bf32` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:20.902041 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3491a9c-d915-4be4-b024-e84101b78051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fac2a0d72e04b47bb9f99589e89bf32)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:20.904502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3491a9c-d915-4be4-b024-e84101b78051 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:20.948180 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b3491a9c-d915-4be4-b024-e84101b78051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fac2a0d72e04b47bb9f99589e89bf32'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:20.955382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b3491a9c-d915-4be4-b024-e84101b78051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fac2a0d72e04b47bb9f99589e89bf32'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:20.956030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b3491a9c-d915-4be4-b024-e84101b78051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fac2a0d72e04b47bb9f99589e89bf32'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:20.962955 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b3491a9c-d915-4be4-b024-e84101b78051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fac2a0d72e04b47bb9f99589e89bf32'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:20.963603 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b3491a9c-d915-4be4-b024-e84101b78051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fac2a0d72e04b47bb9f99589e89bf32'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:20.980827 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1267/2534] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:07:20 2022] DELETE /identity/v3/users/1fac2a0d72e04b47bb9f99589e89bf32 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:20.985572 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4c81a-f097-4765-b345-3247fe989f91 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:20.986135 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4c81a-f097-4765-b345-3247fe989f91 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:20.986234 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4c81a-f097-4765-b345-3247fe989f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:21.002744 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-2dd4c81a-f097-4765-b345-3247fe989f91 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:21.003932 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2dd4c81a-f097-4765-b345-3247fe989f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:21.061119 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1268/2535] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:21.070705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3491a9c-d915-4be4-b024-e84101b78051 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:21.072107 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b3491a9c-d915-4be4-b024-e84101b78051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:21.127723 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3491a9c-d915-4be4-b024-e84101b78051 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:21.131358 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08405a41-352e-4e80-91ac-cfcc01cf24d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:21.131988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405a41-352e-4e80-91ac-cfcc01cf24d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:21.132271 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405a41-352e-4e80-91ac-cfcc01cf24d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:21.132547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405a41-352e-4e80-91ac-cfcc01cf24d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:21.142022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08405a41-352e-4e80-91ac-cfcc01cf24d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:21.143440 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08405a41-352e-4e80-91ac-cfcc01cf24d1 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:21.152697 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1268/2536] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:21.427877 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4c81a-f097-4765-b345-3247fe989f91 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:21.429315 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2dd4c81a-f097-4765-b345-3247fe989f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:21.441890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4c81a-f097-4765-b345-3247fe989f91 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:21.446648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:21.447512 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:21.447795 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:21.448076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9 admin admin] PATH_INFO: `/v3/projects/d254ee469b9c491b9e2fa3bf0d1f3d18` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:21.449379 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d254ee469b9c491b9e2fa3bf0d1f3d18)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:21.451979 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:21.506887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd254ee469b9c491b9e2fa3bf0d1f3d18', 'request_id': 'req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:21.514440 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd254ee469b9c491b9e2fa3bf0d1f3d18', 'request_id': 'req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:21.520077 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd254ee469b9c491b9e2fa3bf0d1f3d18', 'request_id': 'req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:21.533254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9 admin admin] The token cache is being invalidate because project d254ee469b9c491b9e2fa3bf0d1f3d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:07:21.533631 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:21.534385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:21.536114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1269/2537] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:07:21 2022] DELETE /identity/v3/projects/d254ee469b9c491b9e2fa3bf0d1f3d18 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:21.540801 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08405a41-352e-4e80-91ac-cfcc01cf24d1 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:21.550986 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08405a41-352e-4e80-91ac-cfcc01cf24d1 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:21.556115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:21.612280 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa086b7e-7c90-4e82-b4cd-375bbc563802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:21.613114 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa086b7e-7c90-4e82-b4cd-375bbc563802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:21.613467 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa086b7e-7c90-4e82-b4cd-375bbc563802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:21.613811 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa086b7e-7c90-4e82-b4cd-375bbc563802 admin admin] PATH_INFO: `/v3/users/92fddd24db5b41a983b87423f8dec0d5` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:21.615185 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa086b7e-7c90-4e82-b4cd-375bbc563802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92fddd24db5b41a983b87423f8dec0d5)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:21.617176 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa086b7e-7c90-4e82-b4cd-375bbc563802 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:21.665206 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fa086b7e-7c90-4e82-b4cd-375bbc563802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92fddd24db5b41a983b87423f8dec0d5'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:21.672044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fa086b7e-7c90-4e82-b4cd-375bbc563802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92fddd24db5b41a983b87423f8dec0d5'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:21.672691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fa086b7e-7c90-4e82-b4cd-375bbc563802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92fddd24db5b41a983b87423f8dec0d5'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:21.680059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fa086b7e-7c90-4e82-b4cd-375bbc563802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92fddd24db5b41a983b87423f8dec0d5'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:21.680673 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fa086b7e-7c90-4e82-b4cd-375bbc563802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92fddd24db5b41a983b87423f8dec0d5'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:21.697487 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1269/2538] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:07:21 2022] DELETE /identity/v3/users/92fddd24db5b41a983b87423f8dec0d5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:21.965036 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:21.966549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:21.979643 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c5c4f-17eb-4d76-8ed6-41e2c902bfd9 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:22.036376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fe051-0806-42fe-9ecf-d3129f71c978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:22.037224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fe051-0806-42fe-9ecf-d3129f71c978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:22.037502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fe051-0806-42fe-9ecf-d3129f71c978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:22.037769 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fe051-0806-42fe-9ecf-d3129f71c978 admin admin] PATH_INFO: `/v3/projects/46322b071e994602908a10c1b0fb3d5b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:22.038957 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fe051-0806-42fe-9ecf-d3129f71c978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46322b071e994602908a10c1b0fb3d5b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:22.040904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fe051-0806-42fe-9ecf-d3129f71c978 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:22.043048 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:22.087898 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-725fe051-0806-42fe-9ecf-d3129f71c978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46322b071e994602908a10c1b0fb3d5b', 'request_id': 'req-725fe051-0806-42fe-9ecf-d3129f71c978'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:22.093735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-725fe051-0806-42fe-9ecf-d3129f71c978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46322b071e994602908a10c1b0fb3d5b', 'request_id': 'req-725fe051-0806-42fe-9ecf-d3129f71c978'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:22.099205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-725fe051-0806-42fe-9ecf-d3129f71c978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46322b071e994602908a10c1b0fb3d5b', 'request_id': 'req-725fe051-0806-42fe-9ecf-d3129f71c978'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:22.111201 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-725fe051-0806-42fe-9ecf-d3129f71c978 admin admin] The token cache is being invalidate because project 46322b071e994602908a10c1b0fb3d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:07:22.111480 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-725fe051-0806-42fe-9ecf-d3129f71c978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:22.112092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-725fe051-0806-42fe-9ecf-d3129f71c978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:22.113595 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1270/2539] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:07:21 2022] DELETE /identity/v3/projects/46322b071e994602908a10c1b0fb3d5b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:22.118466 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ff884-7abc-4790-b091-f503fc8af251 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:22.118945 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ff884-7abc-4790-b091-f503fc8af251 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:22.119037 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ff884-7abc-4790-b091-f503fc8af251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:22.137214 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-fa4ff884-7abc-4790-b091-f503fc8af251 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:22.138994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fa4ff884-7abc-4790-b091-f503fc8af251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:22.195846 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1270/2540] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:22.204210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351adcb1-3614-45c4-b509-3598423da0e3 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:22.204500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351adcb1-3614-45c4-b509-3598423da0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:22.204776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351adcb1-3614-45c4-b509-3598423da0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:22.222409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-351adcb1-3614-45c4-b509-3598423da0e3 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:22.223578 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-351adcb1-3614-45c4-b509-3598423da0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:22.231266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1271/2541] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:22.235558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ff884-7abc-4790-b091-f503fc8af251 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:22.245258 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ff884-7abc-4790-b091-f503fc8af251 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:22.250455 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae8f4-4970-4995-b5d3-a1f360f2046b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:22.251098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae8f4-4970-4995-b5d3-a1f360f2046b admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:22.251386 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae8f4-4970-4995-b5d3-a1f360f2046b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:22.251667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae8f4-4970-4995-b5d3-a1f360f2046b admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:22.252389 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ae8f4-4970-4995-b5d3-a1f360f2046b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:07:22.252700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ae8f4-4970-4995-b5d3-a1f360f2046b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:22.254341 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ae8f4-4970-4995-b5d3-a1f360f2046b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:22.266631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1271/2542] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 22:07:22.271045 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351adcb1-3614-45c4-b509-3598423da0e3 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:22.280655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351adcb1-3614-45c4-b509-3598423da0e3 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:22.285240 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e54f3-9983-441c-b737-46cef0c3a455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:22.285872 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e54f3-9983-441c-b737-46cef0c3a455 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:22.286277 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e54f3-9983-441c-b737-46cef0c3a455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:22.286552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e54f3-9983-441c-b737-46cef0c3a455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:22.287235 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e54f3-9983-441c-b737-46cef0c3a455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:22.289111 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e54f3-9983-441c-b737-46cef0c3a455 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:22.313708 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1272/2543] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:07:22 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:22.317648 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae8f4-4970-4995-b5d3-a1f360f2046b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:22.327943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae8f4-4970-4995-b5d3-a1f360f2046b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:22.339206 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:22.386005 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34645371-9df6-4300-a432-8a7942f3ae65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:22.386678 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34645371-9df6-4300-a432-8a7942f3ae65 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:22.386964 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34645371-9df6-4300-a432-8a7942f3ae65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:22.387245 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34645371-9df6-4300-a432-8a7942f3ae65 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:22.387934 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34645371-9df6-4300-a432-8a7942f3ae65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:22.390381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34645371-9df6-4300-a432-8a7942f3ae65 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:22.410145 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1272/2544] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:07:22 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:22.414192 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e54f3-9983-441c-b737-46cef0c3a455 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:22.424379 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e54f3-9983-441c-b737-46cef0c3a455 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:22.429033 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c9b7d-fad5-4205-b99c-5a6777c5a58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:22.429713 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c9b7d-fad5-4205-b99c-5a6777c5a58a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:22.430034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c9b7d-fad5-4205-b99c-5a6777c5a58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:22.430314 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c9b7d-fad5-4205-b99c-5a6777c5a58a admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:22.431039 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c9b7d-fad5-4205-b99c-5a6777c5a58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:22.432626 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c9b7d-fad5-4205-b99c-5a6777c5a58a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:22.442970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1273/2545] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:22.446897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34645371-9df6-4300-a432-8a7942f3ae65 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:22.457140 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34645371-9df6-4300-a432-8a7942f3ae65 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:22.461863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e48f0-6d64-4d2a-9f37-e2464e87a1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:22.462535 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e48f0-6d64-4d2a-9f37-e2464e87a1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:22.462824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e48f0-6d64-4d2a-9f37-e2464e87a1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:22.463102 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e48f0-6d64-4d2a-9f37-e2464e87a1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:22.463824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e48f0-6d64-4d2a-9f37-e2464e87a1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:22.465404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e48f0-6d64-4d2a-9f37-e2464e87a1c0 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:22.475239 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1273/2546] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:22.479068 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c9b7d-fad5-4205-b99c-5a6777c5a58a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:22.489591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c9b7d-fad5-4205-b99c-5a6777c5a58a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:22.494223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3c306-7110-445d-a5f0-65398a4d833a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:22.495089 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3c306-7110-445d-a5f0-65398a4d833a admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:22.495373 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3c306-7110-445d-a5f0-65398a4d833a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:22.495651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3c306-7110-445d-a5f0-65398a4d833a admin admin] PATH_INFO: `/v3/projects/4ff80d51a1ae4750bedffca12028a5f0/users/1dd419c6a5e140648a306012277431eb/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:22.510238 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3c306-7110-445d-a5f0-65398a4d833a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff80d51a1ae4750bedffca12028a5f0, user_id=1dd419c6a5e140648a306012277431eb, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:22.512874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3c306-7110-445d-a5f0-65398a4d833a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:22.525814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1274/2547] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:22 2022] PUT /identity/v3/projects/4ff80d51a1ae4750bedffca12028a5f0/users/1dd419c6a5e140648a306012277431eb/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:22.536822 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75a511-ba36-42dd-984c-94e8ff5c0169 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:22.537116 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75a511-ba36-42dd-984c-94e8ff5c0169 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:22.537398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75a511-ba36-42dd-984c-94e8ff5c0169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:22.564175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8a75a511-ba36-42dd-984c-94e8ff5c0169 None None] MFA Rules not processed for user `1dd419c6a5e140648a306012277431eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:22.565324 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8a75a511-ba36-42dd-984c-94e8ff5c0169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:22.627966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1274/2548] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:22.632332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3c306-7110-445d-a5f0-65398a4d833a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:22.695378 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3c306-7110-445d-a5f0-65398a4d833a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:22.700128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8e80f-b867-43b8-b024-ed3f32a103ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:22.700828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8e80f-b867-43b8-b024-ed3f32a103ae admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:22.701108 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8e80f-b867-43b8-b024-ed3f32a103ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:22.701380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8e80f-b867-43b8-b024-ed3f32a103ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:22.702088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8e80f-b867-43b8-b024-ed3f32a103ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:22.703985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8e80f-b867-43b8-b024-ed3f32a103ae admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:22.730528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1275/2549] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:07:22 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:22.735504 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75a511-ba36-42dd-984c-94e8ff5c0169 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:22.746318 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75a511-ba36-42dd-984c-94e8ff5c0169 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:22.804632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f6fff-99b5-42ec-97ea-bde87d14b24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:22.805307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f6fff-99b5-42ec-97ea-bde87d14b24c admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:22.805594 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f6fff-99b5-42ec-97ea-bde87d14b24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:22.805875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f6fff-99b5-42ec-97ea-bde87d14b24c admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:22.806595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f6fff-99b5-42ec-97ea-bde87d14b24c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:22.808553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f6fff-99b5-42ec-97ea-bde87d14b24c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:22.828182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1275/2550] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:07:22 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:22.832165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8e80f-b867-43b8-b024-ed3f32a103ae admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:22.843192 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8e80f-b867-43b8-b024-ed3f32a103ae admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:22.847925 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d4fde-1bde-4ca5-9f4e-84b56b97d63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:22.848576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d4fde-1bde-4ca5-9f4e-84b56b97d63a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:22.848861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d4fde-1bde-4ca5-9f4e-84b56b97d63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:22.849137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d4fde-1bde-4ca5-9f4e-84b56b97d63a admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:22.849850 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d4fde-1bde-4ca5-9f4e-84b56b97d63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:22.851472 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d4fde-1bde-4ca5-9f4e-84b56b97d63a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:22.862786 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1276/2551] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:22.866927 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f6fff-99b5-42ec-97ea-bde87d14b24c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:22.876993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f6fff-99b5-42ec-97ea-bde87d14b24c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:22.881568 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf0ecb-fb3b-4452-b7f3-a1616d1a34ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:22.882474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf0ecb-fb3b-4452-b7f3-a1616d1a34ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:22.882767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf0ecb-fb3b-4452-b7f3-a1616d1a34ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:22.883045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf0ecb-fb3b-4452-b7f3-a1616d1a34ab admin admin] PATH_INFO: `/v3/projects/8ced873363bc44dabeae4393624f4d08/users/f2dd92dd99e74756beb0d1a179037c5f/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:22.894444 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:22.899375 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf0ecb-fb3b-4452-b7f3-a1616d1a34ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ced873363bc44dabeae4393624f4d08, user_id=f2dd92dd99e74756beb0d1a179037c5f, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:22.902755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf0ecb-fb3b-4452-b7f3-a1616d1a34ab admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:22.915927 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1276/2552] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:22 2022] PUT /identity/v3/projects/8ced873363bc44dabeae4393624f4d08/users/f2dd92dd99e74756beb0d1a179037c5f/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:22.920444 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d4fde-1bde-4ca5-9f4e-84b56b97d63a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:22.925649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:22.932023 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d4fde-1bde-4ca5-9f4e-84b56b97d63a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:22.991692 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0999ca-1fe1-4194-b08a-b40e7caa181b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:22.992419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0999ca-1fe1-4194-b08a-b40e7caa181b admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:22.992752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0999ca-1fe1-4194-b08a-b40e7caa181b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:22.993042 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0999ca-1fe1-4194-b08a-b40e7caa181b admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:22.993991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0999ca-1fe1-4194-b08a-b40e7caa181b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:22.995882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0999ca-1fe1-4194-b08a-b40e7caa181b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:23.007300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1277/2553] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:23.011543 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf0ecb-fb3b-4452-b7f3-a1616d1a34ab admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:23.022298 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf0ecb-fb3b-4452-b7f3-a1616d1a34ab admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:23.026887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a73a1-fa96-4831-b778-1283d5639c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:23.027764 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a73a1-fa96-4831-b778-1283d5639c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:23.028052 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a73a1-fa96-4831-b778-1283d5639c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:23.028333 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a73a1-fa96-4831-b778-1283d5639c77 admin admin] PATH_INFO: `/v3/projects/8ced873363bc44dabeae4393624f4d08/users/f2dd92dd99e74756beb0d1a179037c5f/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:23.030339 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a73a1-fa96-4831-b778-1283d5639c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ced873363bc44dabeae4393624f4d08, user_id=f2dd92dd99e74756beb0d1a179037c5f, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:23.032977 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a73a1-fa96-4831-b778-1283d5639c77 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:23.043495 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1277/2554] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:23 2022] PUT /identity/v3/projects/8ced873363bc44dabeae4393624f4d08/users/f2dd92dd99e74756beb0d1a179037c5f/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:23.054314 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a5bb2-e50e-4803-9dcf-6d15f841075a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:23.054807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a5bb2-e50e-4803-9dcf-6d15f841075a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:23.054902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a5bb2-e50e-4803-9dcf-6d15f841075a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:23.081105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d15a5bb2-e50e-4803-9dcf-6d15f841075a None None] MFA Rules not processed for user `f2dd92dd99e74756beb0d1a179037c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:23.082269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d15a5bb2-e50e-4803-9dcf-6d15f841075a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:23.155023 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1278/2555] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:23.165746 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a73a1-fa96-4831-b778-1283d5639c77 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:23.167502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-706a73a1-fa96-4831-b778-1283d5639c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:23.225481 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a73a1-fa96-4831-b778-1283d5639c77 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:23.229167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770aafd-47a1-48ab-a163-8fe834f350e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:23.229794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770aafd-47a1-48ab-a163-8fe834f350e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:23.230101 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770aafd-47a1-48ab-a163-8fe834f350e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:23.230375 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770aafd-47a1-48ab-a163-8fe834f350e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:23.239868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770aafd-47a1-48ab-a163-8fe834f350e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:23.241270 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770aafd-47a1-48ab-a163-8fe834f350e1 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:23.251001 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1278/2556] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:23.806697 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a5bb2-e50e-4803-9dcf-6d15f841075a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:23.871306 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a5bb2-e50e-4803-9dcf-6d15f841075a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:23.875842 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0aa77e-6173-4351-a386-c904afa189b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:23.876723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0aa77e-6173-4351-a386-c904afa189b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:23.877001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0aa77e-6173-4351-a386-c904afa189b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:23.877274 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0aa77e-6173-4351-a386-c904afa189b4 admin admin] PATH_INFO: `/v3/users/1dd419c6a5e140648a306012277431eb` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:23.878628 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0aa77e-6173-4351-a386-c904afa189b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dd419c6a5e140648a306012277431eb)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:23.880475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0aa77e-6173-4351-a386-c904afa189b4 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:23.909974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:23.928054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9a0aa77e-6173-4351-a386-c904afa189b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dd419c6a5e140648a306012277431eb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:23.934957 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9a0aa77e-6173-4351-a386-c904afa189b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dd419c6a5e140648a306012277431eb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:23.943548 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9a0aa77e-6173-4351-a386-c904afa189b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dd419c6a5e140648a306012277431eb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:23.944280 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9a0aa77e-6173-4351-a386-c904afa189b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dd419c6a5e140648a306012277431eb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:23.944878 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9a0aa77e-6173-4351-a386-c904afa189b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dd419c6a5e140648a306012277431eb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:23.963106 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1279/2557] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:07:23 2022] DELETE /identity/v3/users/1dd419c6a5e140648a306012277431eb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:23.968865 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d332998-083c-400d-a62c-7109343c7fa2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:23.969159 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d332998-083c-400d-a62c-7109343c7fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:23.969465 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d332998-083c-400d-a62c-7109343c7fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:23.987660 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0d332998-083c-400d-a62c-7109343c7fa2 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:23.988842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0d332998-083c-400d-a62c-7109343c7fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:24.046336 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1279/2558] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:24.056112 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0aa77e-6173-4351-a386-c904afa189b4 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:24.057504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9a0aa77e-6173-4351-a386-c904afa189b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:24.125066 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0aa77e-6173-4351-a386-c904afa189b4 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:24.129196 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1bf95-19f4-42d4-b570-a237a06b68b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:24.129805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1bf95-19f4-42d4-b570-a237a06b68b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:24.130132 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1bf95-19f4-42d4-b570-a237a06b68b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:24.130420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1bf95-19f4-42d4-b570-a237a06b68b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:24.144179 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1bf95-19f4-42d4-b570-a237a06b68b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:24.145640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1bf95-19f4-42d4-b570-a237a06b68b2 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:24.156582 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1280/2559] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:24.436478 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d332998-083c-400d-a62c-7109343c7fa2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:24.438832 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0d332998-083c-400d-a62c-7109343c7fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:24.452380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d332998-083c-400d-a62c-7109343c7fa2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:24.456982 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6d09e-f64f-4389-b808-a2d12fd7cdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:24.457848 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6d09e-f64f-4389-b808-a2d12fd7cdae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:24.458161 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6d09e-f64f-4389-b808-a2d12fd7cdae admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:24.458436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6d09e-f64f-4389-b808-a2d12fd7cdae admin admin] PATH_INFO: `/v3/projects/4ff80d51a1ae4750bedffca12028a5f0` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:24.459634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6d09e-f64f-4389-b808-a2d12fd7cdae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ff80d51a1ae4750bedffca12028a5f0)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:24.461555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6d09e-f64f-4389-b808-a2d12fd7cdae admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:24.510830 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-50e6d09e-f64f-4389-b808-a2d12fd7cdae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ff80d51a1ae4750bedffca12028a5f0', 'request_id': 'req-50e6d09e-f64f-4389-b808-a2d12fd7cdae'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:24.516901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-50e6d09e-f64f-4389-b808-a2d12fd7cdae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ff80d51a1ae4750bedffca12028a5f0', 'request_id': 'req-50e6d09e-f64f-4389-b808-a2d12fd7cdae'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:24.523239 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-50e6d09e-f64f-4389-b808-a2d12fd7cdae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ff80d51a1ae4750bedffca12028a5f0', 'request_id': 'req-50e6d09e-f64f-4389-b808-a2d12fd7cdae'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:24.536309 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-50e6d09e-f64f-4389-b808-a2d12fd7cdae admin admin] The token cache is being invalidate because project 4ff80d51a1ae4750bedffca12028a5f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:07:24.536595 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-50e6d09e-f64f-4389-b808-a2d12fd7cdae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:24.537219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-50e6d09e-f64f-4389-b808-a2d12fd7cdae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:24.539352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1280/2560] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:07:24 2022] DELETE /identity/v3/projects/4ff80d51a1ae4750bedffca12028a5f0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:24.543377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1bf95-19f4-42d4-b570-a237a06b68b2 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:24.553567 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1bf95-19f4-42d4-b570-a237a06b68b2 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:24.611758 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9e47a-e6a1-4530-8a0c-71ff13186d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:24.612627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9e47a-e6a1-4530-8a0c-71ff13186d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:24.612909 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9e47a-e6a1-4530-8a0c-71ff13186d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:24.613182 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9e47a-e6a1-4530-8a0c-71ff13186d18 admin admin] PATH_INFO: `/v3/users/f2dd92dd99e74756beb0d1a179037c5f` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:24.614415 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9e47a-e6a1-4530-8a0c-71ff13186d18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2dd92dd99e74756beb0d1a179037c5f)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:24.616381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9e47a-e6a1-4530-8a0c-71ff13186d18 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:24.664067 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2ad9e47a-e6a1-4530-8a0c-71ff13186d18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2dd92dd99e74756beb0d1a179037c5f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:24.665360 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:24.673088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2ad9e47a-e6a1-4530-8a0c-71ff13186d18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2dd92dd99e74756beb0d1a179037c5f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:24.682009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2ad9e47a-e6a1-4530-8a0c-71ff13186d18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2dd92dd99e74756beb0d1a179037c5f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:24.682678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2ad9e47a-e6a1-4530-8a0c-71ff13186d18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2dd92dd99e74756beb0d1a179037c5f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:24.683330 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2ad9e47a-e6a1-4530-8a0c-71ff13186d18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2dd92dd99e74756beb0d1a179037c5f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:24.701466 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1281/2561] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:07:24 2022] DELETE /identity/v3/users/f2dd92dd99e74756beb0d1a179037c5f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:24.978135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6d09e-f64f-4389-b808-a2d12fd7cdae admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:24.979755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-50e6d09e-f64f-4389-b808-a2d12fd7cdae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:24.988533 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:24.995168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6d09e-f64f-4389-b808-a2d12fd7cdae admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:25.052505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6289b-466d-4670-b4bd-d83314a01829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:25.053364 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6289b-466d-4670-b4bd-d83314a01829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:25.053653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6289b-466d-4670-b4bd-d83314a01829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:25.053946 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6289b-466d-4670-b4bd-d83314a01829 admin admin] PATH_INFO: `/v3/projects/8ced873363bc44dabeae4393624f4d08` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:25.055142 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6289b-466d-4670-b4bd-d83314a01829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ced873363bc44dabeae4393624f4d08)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:25.057049 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6289b-466d-4670-b4bd-d83314a01829 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:25.101410 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-eae6289b-466d-4670-b4bd-d83314a01829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ced873363bc44dabeae4393624f4d08', 'request_id': 'req-eae6289b-466d-4670-b4bd-d83314a01829'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:25.107470 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-eae6289b-466d-4670-b4bd-d83314a01829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ced873363bc44dabeae4393624f4d08', 'request_id': 'req-eae6289b-466d-4670-b4bd-d83314a01829'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:25.113766 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-eae6289b-466d-4670-b4bd-d83314a01829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ced873363bc44dabeae4393624f4d08', 'request_id': 'req-eae6289b-466d-4670-b4bd-d83314a01829'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:25.125729 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-eae6289b-466d-4670-b4bd-d83314a01829 admin admin] The token cache is being invalidate because project 8ced873363bc44dabeae4393624f4d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:07:25.126057 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-eae6289b-466d-4670-b4bd-d83314a01829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:25.126678 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-eae6289b-466d-4670-b4bd-d83314a01829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:25.128213 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1281/2562] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:07:24 2022] DELETE /identity/v3/projects/8ced873363bc44dabeae4393624f4d08 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:25.133025 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc704c7-958b-486b-96f8-714e97362997 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:25.133497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc704c7-958b-486b-96f8-714e97362997 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:25.133604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc704c7-958b-486b-96f8-714e97362997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:25.151530 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4bc704c7-958b-486b-96f8-714e97362997 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:25.152722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4bc704c7-958b-486b-96f8-714e97362997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:25.211146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1282/2563] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:25.220263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfc924-421f-490b-ad06-d464665944c8 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:25.220553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfc924-421f-490b-ad06-d464665944c8 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:25.220830 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfc924-421f-490b-ad06-d464665944c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:25.240653 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c6dfc924-421f-490b-ad06-d464665944c8 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:25.241954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c6dfc924-421f-490b-ad06-d464665944c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:25.249983 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1282/2564] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:25.254251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc704c7-958b-486b-96f8-714e97362997 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:25.263915 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc704c7-958b-486b-96f8-714e97362997 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:25.268528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1acb0c-a6dc-4690-b92a-ca0747f4b9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:25.269170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1acb0c-a6dc-4690-b92a-ca0747f4b9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:25.269452 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1acb0c-a6dc-4690-b92a-ca0747f4b9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:25.269727 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1acb0c-a6dc-4690-b92a-ca0747f4b9a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:25.270484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1acb0c-a6dc-4690-b92a-ca0747f4b9a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:07:25.270789 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1acb0c-a6dc-4690-b92a-ca0747f4b9a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:25.272376 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1acb0c-a6dc-4690-b92a-ca0747f4b9a0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:25.284282 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1283/2565] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:07:25.288370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfc924-421f-490b-ad06-d464665944c8 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:25.298290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfc924-421f-490b-ad06-d464665944c8 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:25.302885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5f94b-8bc3-4faa-a376-3746700c80b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:25.303522 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5f94b-8bc3-4faa-a376-3746700c80b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:25.303804 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5f94b-8bc3-4faa-a376-3746700c80b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:25.304079 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5f94b-8bc3-4faa-a376-3746700c80b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:25.304772 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5f94b-8bc3-4faa-a376-3746700c80b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:25.306703 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5f94b-8bc3-4faa-a376-3746700c80b7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:25.335696 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1283/2566] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:07:25 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:25.336730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1acb0c-a6dc-4690-b92a-ca0747f4b9a0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:25.347448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1acb0c-a6dc-4690-b92a-ca0747f4b9a0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:25.409740 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991398b-5b12-4fbd-9d18-a9ad0bd1b562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:25.410359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991398b-5b12-4fbd-9d18-a9ad0bd1b562 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:25.410640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991398b-5b12-4fbd-9d18-a9ad0bd1b562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:25.410913 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991398b-5b12-4fbd-9d18-a9ad0bd1b562 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:25.411593 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991398b-5b12-4fbd-9d18-a9ad0bd1b562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:25.413532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991398b-5b12-4fbd-9d18-a9ad0bd1b562 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:25.433630 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1284/2567] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:07:25 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:25.437861 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5f94b-8bc3-4faa-a376-3746700c80b7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:25.448407 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5f94b-8bc3-4faa-a376-3746700c80b7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:25.453469 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbd23e-884c-4405-a8e9-aab2bf2b61ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:25.454154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd23e-884c-4405-a8e9-aab2bf2b61ea admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:25.454437 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd23e-884c-4405-a8e9-aab2bf2b61ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:25.454714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd23e-884c-4405-a8e9-aab2bf2b61ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:25.455473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbd23e-884c-4405-a8e9-aab2bf2b61ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:25.457066 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbd23e-884c-4405-a8e9-aab2bf2b61ea admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:25.468427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1284/2568] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:25.472113 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991398b-5b12-4fbd-9d18-a9ad0bd1b562 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:25.482088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991398b-5b12-4fbd-9d18-a9ad0bd1b562 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:25.486961 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b96a1-7cfc-465e-92f3-50b47f018a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:25.487619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b96a1-7cfc-465e-92f3-50b47f018a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:25.487899 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b96a1-7cfc-465e-92f3-50b47f018a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:25.488175 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b96a1-7cfc-465e-92f3-50b47f018a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:25.488896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b96a1-7cfc-465e-92f3-50b47f018a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:25.490522 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b96a1-7cfc-465e-92f3-50b47f018a8f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:25.500527 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1285/2569] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:25.504551 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbd23e-884c-4405-a8e9-aab2bf2b61ea admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:25.514880 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbd23e-884c-4405-a8e9-aab2bf2b61ea admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:25.519408 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82168d93-ebd8-43e9-af33-35c167beac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:25.520273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82168d93-ebd8-43e9-af33-35c167beac77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:25.520558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82168d93-ebd8-43e9-af33-35c167beac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:25.520834 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82168d93-ebd8-43e9-af33-35c167beac77 admin admin] PATH_INFO: `/v3/projects/0561594e8d3b41d489b525d88eefe4f3/users/d81e9cb188394190b73b426398c612dd/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:25.535537 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82168d93-ebd8-43e9-af33-35c167beac77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0561594e8d3b41d489b525d88eefe4f3, user_id=d81e9cb188394190b73b426398c612dd, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:25.538204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82168d93-ebd8-43e9-af33-35c167beac77 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:25.550638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1285/2570] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:25 2022] PUT /identity/v3/projects/0561594e8d3b41d489b525d88eefe4f3/users/d81e9cb188394190b73b426398c612dd/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:07:25.560669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ad88d-43db-4e04-a3aa-736a85f792da None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:25.560966 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ad88d-43db-4e04-a3aa-736a85f792da None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:25.561248 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ad88d-43db-4e04-a3aa-736a85f792da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:25.587906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3d8ad88d-43db-4e04-a3aa-736a85f792da None None] MFA Rules not processed for user `d81e9cb188394190b73b426398c612dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:25.589114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3d8ad88d-43db-4e04-a3aa-736a85f792da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:25.607521 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:25.655068 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1286/2571] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:25.659539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82168d93-ebd8-43e9-af33-35c167beac77 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:25.690369 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:25.722624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82168d93-ebd8-43e9-af33-35c167beac77 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:25.727434 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb807e7-d9a4-44f7-acf6-7d99c91a5963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:25.728173 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb807e7-d9a4-44f7-acf6-7d99c91a5963 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:25.728457 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb807e7-d9a4-44f7-acf6-7d99c91a5963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:25.728735 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb807e7-d9a4-44f7-acf6-7d99c91a5963 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:25.729436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb807e7-d9a4-44f7-acf6-7d99c91a5963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:25.731527 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb807e7-d9a4-44f7-acf6-7d99c91a5963 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:25.758391 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1286/2572] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:07:25 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:25.762188 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ad88d-43db-4e04-a3aa-736a85f792da None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:25.773828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ad88d-43db-4e04-a3aa-736a85f792da None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:25.831234 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00359aa0-d4c4-47f8-9c61-493e68ccaa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:25.831884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00359aa0-d4c4-47f8-9c61-493e68ccaa8a admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:25.832164 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00359aa0-d4c4-47f8-9c61-493e68ccaa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:25.832438 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00359aa0-d4c4-47f8-9c61-493e68ccaa8a admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:25.833127 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00359aa0-d4c4-47f8-9c61-493e68ccaa8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:25.835084 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00359aa0-d4c4-47f8-9c61-493e68ccaa8a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:25.853783 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1287/2573] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:07:25 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:25.857866 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb807e7-d9a4-44f7-acf6-7d99c91a5963 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:25.868363 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb807e7-d9a4-44f7-acf6-7d99c91a5963 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:25.873415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f67a9f-2584-40f3-970c-ea44b4a89acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:25.874067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f67a9f-2584-40f3-970c-ea44b4a89acd admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:25.874349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f67a9f-2584-40f3-970c-ea44b4a89acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:25.874622 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f67a9f-2584-40f3-970c-ea44b4a89acd admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:25.875362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f67a9f-2584-40f3-970c-ea44b4a89acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:25.876934 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f67a9f-2584-40f3-970c-ea44b4a89acd admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:25.887585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1287/2574] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:25.891981 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00359aa0-d4c4-47f8-9c61-493e68ccaa8a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:25.901797 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00359aa0-d4c4-47f8-9c61-493e68ccaa8a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:25.906374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4794082-b5bd-44ce-93e6-573845d2036a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:25.907014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4794082-b5bd-44ce-93e6-573845d2036a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:25.907297 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4794082-b5bd-44ce-93e6-573845d2036a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:25.907571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4794082-b5bd-44ce-93e6-573845d2036a admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:25.908288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4794082-b5bd-44ce-93e6-573845d2036a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:25.909877 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4794082-b5bd-44ce-93e6-573845d2036a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:25.919673 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1288/2575] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:25.923474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f67a9f-2584-40f3-970c-ea44b4a89acd admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:25.933287 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f67a9f-2584-40f3-970c-ea44b4a89acd admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:25.939870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f61c19-855c-4bd2-914b-b4a0a7875634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:25.940809 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f61c19-855c-4bd2-914b-b4a0a7875634 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:25.941153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f61c19-855c-4bd2-914b-b4a0a7875634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:25.941457 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f61c19-855c-4bd2-914b-b4a0a7875634 admin admin] PATH_INFO: `/v3/projects/d04f2e95a92349308fa41763d27f2f4d/users/8ffa4613342941c8a61c11d48e87f32d/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:25.956436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f61c19-855c-4bd2-914b-b4a0a7875634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04f2e95a92349308fa41763d27f2f4d, user_id=8ffa4613342941c8a61c11d48e87f32d, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:25.959082 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f61c19-855c-4bd2-914b-b4a0a7875634 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:25.972737 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1288/2576] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:25 2022] PUT /identity/v3/projects/d04f2e95a92349308fa41763d27f2f4d/users/8ffa4613342941c8a61c11d48e87f32d/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:07:25.982867 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca87c31-3b6d-40ed-8037-43b510ed9683 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:25.983161 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca87c31-3b6d-40ed-8037-43b510ed9683 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:25.983442 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca87c31-3b6d-40ed-8037-43b510ed9683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:26.009773 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-cca87c31-3b6d-40ed-8037-43b510ed9683 None None] MFA Rules not processed for user `8ffa4613342941c8a61c11d48e87f32d`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:26.011001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-cca87c31-3b6d-40ed-8037-43b510ed9683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:26.074779 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1289/2577] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:07:26.079202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f61c19-855c-4bd2-914b-b4a0a7875634 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:26.140505 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f61c19-855c-4bd2-914b-b4a0a7875634 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:26.145198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65845d7d-1bfd-49e2-9dba-06c27d2589d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:26.146008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65845d7d-1bfd-49e2-9dba-06c27d2589d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:26.146251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65845d7d-1bfd-49e2-9dba-06c27d2589d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:26.146529 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65845d7d-1bfd-49e2-9dba-06c27d2589d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:26.147219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65845d7d-1bfd-49e2-9dba-06c27d2589d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:26.149109 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65845d7d-1bfd-49e2-9dba-06c27d2589d3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:26.174040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1289/2578] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:07:26 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:26.177972 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca87c31-3b6d-40ed-8037-43b510ed9683 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:26.189192 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca87c31-3b6d-40ed-8037-43b510ed9683 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:26.214718 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:26.246330 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913a4a1-703a-4d05-b9ae-9b7f0ec8d92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:26.246917 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913a4a1-703a-4d05-b9ae-9b7f0ec8d92e admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:26.247195 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913a4a1-703a-4d05-b9ae-9b7f0ec8d92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:26.247465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913a4a1-703a-4d05-b9ae-9b7f0ec8d92e admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:26.248686 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913a4a1-703a-4d05-b9ae-9b7f0ec8d92e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:26.250605 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913a4a1-703a-4d05-b9ae-9b7f0ec8d92e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:26.269486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1290/2579] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:07:26 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:26.273669 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65845d7d-1bfd-49e2-9dba-06c27d2589d3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:26.283847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65845d7d-1bfd-49e2-9dba-06c27d2589d3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:26.288494 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ae296-3439-4c7c-9146-89200e5b0301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:26.289141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ae296-3439-4c7c-9146-89200e5b0301 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:26.289424 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ae296-3439-4c7c-9146-89200e5b0301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:26.289700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ae296-3439-4c7c-9146-89200e5b0301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:26.290462 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ae296-3439-4c7c-9146-89200e5b0301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:26.292041 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ae296-3439-4c7c-9146-89200e5b0301 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:26.302835 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1290/2580] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:26.306826 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913a4a1-703a-4d05-b9ae-9b7f0ec8d92e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:26.317180 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913a4a1-703a-4d05-b9ae-9b7f0ec8d92e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:26.321641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f82114-aab7-40a8-8126-481e5be1c825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:26.322528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f82114-aab7-40a8-8126-481e5be1c825 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:26.322809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f82114-aab7-40a8-8126-481e5be1c825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:26.323082 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f82114-aab7-40a8-8126-481e5be1c825 admin admin] PATH_INFO: `/v3/projects/8cf705c18bc84b8896a7124773ac238a/users/ceeb811fc4804fcb93d9952891166266/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:26.337285 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f82114-aab7-40a8-8126-481e5be1c825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cf705c18bc84b8896a7124773ac238a, user_id=ceeb811fc4804fcb93d9952891166266, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:26.339955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f82114-aab7-40a8-8126-481e5be1c825 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:26.356099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1291/2581] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:26 2022] PUT /identity/v3/projects/8cf705c18bc84b8896a7124773ac238a/users/ceeb811fc4804fcb93d9952891166266/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:26.360785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ae296-3439-4c7c-9146-89200e5b0301 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:26.370836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ae296-3439-4c7c-9146-89200e5b0301 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:26.417977 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:26.427718 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad3b17-aac4-41c9-a2f7-d9537b3b705f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:26.428377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad3b17-aac4-41c9-a2f7-d9537b3b705f admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:26.428658 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad3b17-aac4-41c9-a2f7-d9537b3b705f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:26.428934 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad3b17-aac4-41c9-a2f7-d9537b3b705f admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:26.429651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad3b17-aac4-41c9-a2f7-d9537b3b705f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:26.431266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad3b17-aac4-41c9-a2f7-d9537b3b705f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:26.440785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1291/2582] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:26.444902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f82114-aab7-40a8-8126-481e5be1c825 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:26.455308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f82114-aab7-40a8-8126-481e5be1c825 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:26.460054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6011e-9c57-4981-8e0a-980cc4bb481f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:26.460928 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6011e-9c57-4981-8e0a-980cc4bb481f admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:26.461214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6011e-9c57-4981-8e0a-980cc4bb481f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:26.461488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6011e-9c57-4981-8e0a-980cc4bb481f admin admin] PATH_INFO: `/v3/projects/8cf705c18bc84b8896a7124773ac238a/users/ceeb811fc4804fcb93d9952891166266/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:26.463464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6011e-9c57-4981-8e0a-980cc4bb481f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cf705c18bc84b8896a7124773ac238a, user_id=ceeb811fc4804fcb93d9952891166266, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:26.466137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6011e-9c57-4981-8e0a-980cc4bb481f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:26.476802 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1292/2583] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:26 2022] PUT /identity/v3/projects/8cf705c18bc84b8896a7124773ac238a/users/ceeb811fc4804fcb93d9952891166266/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:07:26.543580 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9e4e0-29b7-4a1f-85c0-54780168175c None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:26.543872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9e4e0-29b7-4a1f-85c0-54780168175c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:26.544153 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9e4e0-29b7-4a1f-85c0-54780168175c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:26.577308 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e9b9e4e0-29b7-4a1f-85c0-54780168175c None None] MFA Rules not processed for user `ceeb811fc4804fcb93d9952891166266`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:26.578587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e9b9e4e0-29b7-4a1f-85c0-54780168175c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:26.646565 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1292/2584] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:26.658984 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6011e-9c57-4981-8e0a-980cc4bb481f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:26.660891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bbd6011e-9c57-4981-8e0a-980cc4bb481f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:26.719301 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6011e-9c57-4981-8e0a-980cc4bb481f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:26.722932 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61cccf-fed0-4760-a53f-468e10e71413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:26.723566 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61cccf-fed0-4760-a53f-468e10e71413 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:26.723845 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61cccf-fed0-4760-a53f-468e10e71413 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:26.724115 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61cccf-fed0-4760-a53f-468e10e71413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:26.779735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61cccf-fed0-4760-a53f-468e10e71413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:26.781108 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61cccf-fed0-4760-a53f-468e10e71413 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:26.790224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1293/2585] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:28.259240 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9e4e0-29b7-4a1f-85c0-54780168175c None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:28.260637 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e9b9e4e0-29b7-4a1f-85c0-54780168175c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:28.273374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9e4e0-29b7-4a1f-85c0-54780168175c None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:28.276901 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc88e5-8c1c-4e9e-b684-a3c15f5f1e38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:28.277533 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc88e5-8c1c-4e9e-b684-a3c15f5f1e38 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:28.277816 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc88e5-8c1c-4e9e-b684-a3c15f5f1e38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:28.278133 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc88e5-8c1c-4e9e-b684-a3c15f5f1e38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:28.333689 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc88e5-8c1c-4e9e-b684-a3c15f5f1e38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:28.335105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc88e5-8c1c-4e9e-b684-a3c15f5f1e38 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:28.343925 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1293/2586] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:07:28.844924 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61cccf-fed0-4760-a53f-468e10e71413 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:28.853555 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61cccf-fed0-4760-a53f-468e10e71413 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:28.857315 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4007f-a062-4502-9a0d-9bf1a8dae03b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:28.858493 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4007f-a062-4502-9a0d-9bf1a8dae03b service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:28.858804 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4007f-a062-4502-9a0d-9bf1a8dae03b service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:28.859078 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4007f-a062-4502-9a0d-9bf1a8dae03b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:28.868104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4007f-a062-4502-9a0d-9bf1a8dae03b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:28.869558 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4007f-a062-4502-9a0d-9bf1a8dae03b service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:28.879011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1294/2587] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:32.714882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc88e5-8c1c-4e9e-b684-a3c15f5f1e38 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:32.776481 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc88e5-8c1c-4e9e-b684-a3c15f5f1e38 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:32.781000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ff22a-960c-451d-a9cf-e7092f5e77ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:32.781866 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ff22a-960c-451d-a9cf-e7092f5e77ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:32.782180 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ff22a-960c-451d-a9cf-e7092f5e77ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:32.782455 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ff22a-960c-451d-a9cf-e7092f5e77ff admin admin] PATH_INFO: `/v3/users/d81e9cb188394190b73b426398c612dd` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:32.783627 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ff22a-960c-451d-a9cf-e7092f5e77ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=d81e9cb188394190b73b426398c612dd)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:32.785524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ff22a-960c-451d-a9cf-e7092f5e77ff admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:32.799208 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:32.831210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c5ff22a-960c-451d-a9cf-e7092f5e77ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd81e9cb188394190b73b426398c612dd'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:32.838067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c5ff22a-960c-451d-a9cf-e7092f5e77ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd81e9cb188394190b73b426398c612dd'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:32.838719 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c5ff22a-960c-451d-a9cf-e7092f5e77ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd81e9cb188394190b73b426398c612dd'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:32.845643 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c5ff22a-960c-451d-a9cf-e7092f5e77ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd81e9cb188394190b73b426398c612dd'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:32.846304 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2c5ff22a-960c-451d-a9cf-e7092f5e77ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd81e9cb188394190b73b426398c612dd'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:32.863846 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1294/2588] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:07:32 2022] DELETE /identity/v3/users/d81e9cb188394190b73b426398c612dd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:32.868469 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd32605-544b-4389-8290-6daa665bee3f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:32.868953 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd32605-544b-4389-8290-6daa665bee3f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:32.869069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd32605-544b-4389-8290-6daa665bee3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:32.886764 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0cd32605-544b-4389-8290-6daa665bee3f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:32.887952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0cd32605-544b-4389-8290-6daa665bee3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:32.903966 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:32.946515 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1295/2589] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:32.955997 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ff22a-960c-451d-a9cf-e7092f5e77ff admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:32.957554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2c5ff22a-960c-451d-a9cf-e7092f5e77ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:33.015994 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ff22a-960c-451d-a9cf-e7092f5e77ff admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:33.019635 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bda90-bd82-45f0-adf8-eec680aff46d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:33.020275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bda90-bd82-45f0-adf8-eec680aff46d service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:33.020553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bda90-bd82-45f0-adf8-eec680aff46d service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:33.020827 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bda90-bd82-45f0-adf8-eec680aff46d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:33.029704 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1bda90-bd82-45f0-adf8-eec680aff46d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:33.031171 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1bda90-bd82-45f0-adf8-eec680aff46d service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:33.040619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1295/2590] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:33.311065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd32605-544b-4389-8290-6daa665bee3f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:33.312585 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0cd32605-544b-4389-8290-6daa665bee3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:33.333778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd32605-544b-4389-8290-6daa665bee3f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:33.339050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff245738-5b56-4eba-8086-1f6f01f538d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:33.339925 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff245738-5b56-4eba-8086-1f6f01f538d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:33.340203 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff245738-5b56-4eba-8086-1f6f01f538d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:33.340473 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff245738-5b56-4eba-8086-1f6f01f538d8 admin admin] PATH_INFO: `/v3/projects/0561594e8d3b41d489b525d88eefe4f3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:33.341670 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff245738-5b56-4eba-8086-1f6f01f538d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0561594e8d3b41d489b525d88eefe4f3)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:33.344164 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff245738-5b56-4eba-8086-1f6f01f538d8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:33.391063 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ff245738-5b56-4eba-8086-1f6f01f538d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0561594e8d3b41d489b525d88eefe4f3', 'request_id': 'req-ff245738-5b56-4eba-8086-1f6f01f538d8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:33.397232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ff245738-5b56-4eba-8086-1f6f01f538d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0561594e8d3b41d489b525d88eefe4f3', 'request_id': 'req-ff245738-5b56-4eba-8086-1f6f01f538d8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:33.402955 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ff245738-5b56-4eba-8086-1f6f01f538d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0561594e8d3b41d489b525d88eefe4f3', 'request_id': 'req-ff245738-5b56-4eba-8086-1f6f01f538d8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:33.415778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ff245738-5b56-4eba-8086-1f6f01f538d8 admin admin] The token cache is being invalidate because project 0561594e8d3b41d489b525d88eefe4f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:07:33.416061 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ff245738-5b56-4eba-8086-1f6f01f538d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:33.416688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ff245738-5b56-4eba-8086-1f6f01f538d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:33.418254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1296/2591] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:07:33 2022] DELETE /identity/v3/projects/0561594e8d3b41d489b525d88eefe4f3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:33.422756 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bda90-bd82-45f0-adf8-eec680aff46d service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:33.437540 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bda90-bd82-45f0-adf8-eec680aff46d service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:33.497457 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9c76e-2652-4e03-97a8-b35cc7b6e677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:33.498369 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9c76e-2652-4e03-97a8-b35cc7b6e677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:33.498654 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9c76e-2652-4e03-97a8-b35cc7b6e677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:33.498954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9c76e-2652-4e03-97a8-b35cc7b6e677 admin admin] PATH_INFO: `/v3/users/8ffa4613342941c8a61c11d48e87f32d` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:33.500149 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9c76e-2652-4e03-97a8-b35cc7b6e677 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ffa4613342941c8a61c11d48e87f32d)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:33.502093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9c76e-2652-4e03-97a8-b35cc7b6e677 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:33.540046 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:33.550177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2af9c76e-2652-4e03-97a8-b35cc7b6e677 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ffa4613342941c8a61c11d48e87f32d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:33.557388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2af9c76e-2652-4e03-97a8-b35cc7b6e677 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ffa4613342941c8a61c11d48e87f32d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:33.558133 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2af9c76e-2652-4e03-97a8-b35cc7b6e677 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ffa4613342941c8a61c11d48e87f32d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:33.565322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2af9c76e-2652-4e03-97a8-b35cc7b6e677 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ffa4613342941c8a61c11d48e87f32d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:33.565960 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-2af9c76e-2652-4e03-97a8-b35cc7b6e677 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ffa4613342941c8a61c11d48e87f32d'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:33.584019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1296/2592] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:07:33 2022] DELETE /identity/v3/users/8ffa4613342941c8a61c11d48e87f32d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:33.852432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff245738-5b56-4eba-8086-1f6f01f538d8 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:33.855125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ff245738-5b56-4eba-8086-1f6f01f538d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:33.881247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff245738-5b56-4eba-8086-1f6f01f538d8 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:33.945483 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2464c8d-4bad-4e21-b8c8-c02849e075ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:33.947032 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2464c8d-4bad-4e21-b8c8-c02849e075ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:33.947032 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2464c8d-4bad-4e21-b8c8-c02849e075ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:33.947746 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2464c8d-4bad-4e21-b8c8-c02849e075ad admin admin] PATH_INFO: `/v3/projects/d04f2e95a92349308fa41763d27f2f4d` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:33.949222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2464c8d-4bad-4e21-b8c8-c02849e075ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04f2e95a92349308fa41763d27f2f4d)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:33.951334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2464c8d-4bad-4e21-b8c8-c02849e075ad admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:34.002019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:34.003475 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c2464c8d-4bad-4e21-b8c8-c02849e075ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04f2e95a92349308fa41763d27f2f4d', 'request_id': 'req-c2464c8d-4bad-4e21-b8c8-c02849e075ad'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:34.012380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c2464c8d-4bad-4e21-b8c8-c02849e075ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04f2e95a92349308fa41763d27f2f4d', 'request_id': 'req-c2464c8d-4bad-4e21-b8c8-c02849e075ad'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:34.018806 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c2464c8d-4bad-4e21-b8c8-c02849e075ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04f2e95a92349308fa41763d27f2f4d', 'request_id': 'req-c2464c8d-4bad-4e21-b8c8-c02849e075ad'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:34.031530 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c2464c8d-4bad-4e21-b8c8-c02849e075ad admin admin] The token cache is being invalidate because project d04f2e95a92349308fa41763d27f2f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:07:34.031812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c2464c8d-4bad-4e21-b8c8-c02849e075ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:34.032434 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c2464c8d-4bad-4e21-b8c8-c02849e075ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:34.034224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1297/2593] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:07:33 2022] DELETE /identity/v3/projects/d04f2e95a92349308fa41763d27f2f4d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:34.038260 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9c76e-2652-4e03-97a8-b35cc7b6e677 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:34.039668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2af9c76e-2652-4e03-97a8-b35cc7b6e677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:34.052583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9c76e-2652-4e03-97a8-b35cc7b6e677 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:34.115756 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420f8db-c5aa-412d-ab53-129395887f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:34.116635 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420f8db-c5aa-412d-ab53-129395887f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:34.116916 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420f8db-c5aa-412d-ab53-129395887f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:34.117190 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420f8db-c5aa-412d-ab53-129395887f1e admin admin] PATH_INFO: `/v3/users/ceeb811fc4804fcb93d9952891166266` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:34.118430 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420f8db-c5aa-412d-ab53-129395887f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceeb811fc4804fcb93d9952891166266)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:34.120337 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420f8db-c5aa-412d-ab53-129395887f1e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:34.175417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7420f8db-c5aa-412d-ab53-129395887f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceeb811fc4804fcb93d9952891166266'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:34.182546 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7420f8db-c5aa-412d-ab53-129395887f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceeb811fc4804fcb93d9952891166266'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:34.183236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7420f8db-c5aa-412d-ab53-129395887f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceeb811fc4804fcb93d9952891166266'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:34.190833 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7420f8db-c5aa-412d-ab53-129395887f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceeb811fc4804fcb93d9952891166266'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:34.191523 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-7420f8db-c5aa-412d-ab53-129395887f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceeb811fc4804fcb93d9952891166266'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:34.213417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1297/2594] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:07:34 2022] DELETE /identity/v3/users/ceeb811fc4804fcb93d9952891166266 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:34.489766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2464c8d-4bad-4e21-b8c8-c02849e075ad admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:34.491269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c2464c8d-4bad-4e21-b8c8-c02849e075ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:34.507385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2464c8d-4bad-4e21-b8c8-c02849e075ad admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:34.563985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb434f-04b6-446d-9d6b-abf872fc5e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:34.564844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb434f-04b6-446d-9d6b-abf872fc5e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:34.565131 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb434f-04b6-446d-9d6b-abf872fc5e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:34.565412 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb434f-04b6-446d-9d6b-abf872fc5e31 admin admin] PATH_INFO: `/v3/projects/8cf705c18bc84b8896a7124773ac238a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:34.566597 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb434f-04b6-446d-9d6b-abf872fc5e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cf705c18bc84b8896a7124773ac238a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:34.568498 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb434f-04b6-446d-9d6b-abf872fc5e31 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:34.613813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-68fb434f-04b6-446d-9d6b-abf872fc5e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cf705c18bc84b8896a7124773ac238a', 'request_id': 'req-68fb434f-04b6-446d-9d6b-abf872fc5e31'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:34.619764 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-68fb434f-04b6-446d-9d6b-abf872fc5e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cf705c18bc84b8896a7124773ac238a', 'request_id': 'req-68fb434f-04b6-446d-9d6b-abf872fc5e31'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:34.625881 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-68fb434f-04b6-446d-9d6b-abf872fc5e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cf705c18bc84b8896a7124773ac238a', 'request_id': 'req-68fb434f-04b6-446d-9d6b-abf872fc5e31'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:34.638735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-68fb434f-04b6-446d-9d6b-abf872fc5e31 admin admin] The token cache is being invalidate because project 8cf705c18bc84b8896a7124773ac238a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:07:34.639148 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-68fb434f-04b6-446d-9d6b-abf872fc5e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:34.639936 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-68fb434f-04b6-446d-9d6b-abf872fc5e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:34.641663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1298/2595] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:07:34 2022] DELETE /identity/v3/projects/8cf705c18bc84b8896a7124773ac238a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:34.648454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfa597-b1db-4396-916f-751c744fb37f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:34.648823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfa597-b1db-4396-916f-751c744fb37f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:34.649103 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfa597-b1db-4396-916f-751c744fb37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:34.667435 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-34dfa597-b1db-4396-916f-751c744fb37f None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:34.668613 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-34dfa597-b1db-4396-916f-751c744fb37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:34.696707 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:34.727749 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1298/2596] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:34.736427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7bbb1-ad3d-4522-b45f-88be2773ad0a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:34.736655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7bbb1-ad3d-4522-b45f-88be2773ad0a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:34.736928 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7bbb1-ad3d-4522-b45f-88be2773ad0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:34.754801 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f4b7bbb1-ad3d-4522-b45f-88be2773ad0a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:34.755995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f4b7bbb1-ad3d-4522-b45f-88be2773ad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:34.763797 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1299/2597] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:34.767944 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfa597-b1db-4396-916f-751c744fb37f None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:34.777514 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfa597-b1db-4396-916f-751c744fb37f None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:34.782556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97543fa8-f0ef-4eaf-81a8-47a31ca0327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:34.783194 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97543fa8-f0ef-4eaf-81a8-47a31ca0327b admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:34.783473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97543fa8-f0ef-4eaf-81a8-47a31ca0327b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:34.783744 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97543fa8-f0ef-4eaf-81a8-47a31ca0327b admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:34.784462 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97543fa8-f0ef-4eaf-81a8-47a31ca0327b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:07:34.784763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97543fa8-f0ef-4eaf-81a8-47a31ca0327b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:34.786380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97543fa8-f0ef-4eaf-81a8-47a31ca0327b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:34.798185 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1299/2598] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:07:34.802318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7bbb1-ad3d-4522-b45f-88be2773ad0a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:34.811454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7bbb1-ad3d-4522-b45f-88be2773ad0a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:34.816099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d568d8-612b-45b6-9006-942b935845a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:34.816763 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d568d8-612b-45b6-9006-942b935845a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:34.817044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d568d8-612b-45b6-9006-942b935845a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:34.817316 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d568d8-612b-45b6-9006-942b935845a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:34.818064 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d568d8-612b-45b6-9006-942b935845a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:34.819937 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d568d8-612b-45b6-9006-942b935845a1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:34.845009 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1300/2599] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:07:34 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:34.849026 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97543fa8-f0ef-4eaf-81a8-47a31ca0327b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:34.859608 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97543fa8-f0ef-4eaf-81a8-47a31ca0327b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:34.914384 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334ef98-67a0-410c-bcff-eec474aaf635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:34.915039 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334ef98-67a0-410c-bcff-eec474aaf635 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:34.915319 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334ef98-67a0-410c-bcff-eec474aaf635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:34.915592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334ef98-67a0-410c-bcff-eec474aaf635 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:34.916284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334ef98-67a0-410c-bcff-eec474aaf635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:34.918209 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334ef98-67a0-410c-bcff-eec474aaf635 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:34.938375 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1300/2600] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:07:34 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:07:34.942814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d568d8-612b-45b6-9006-942b935845a1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:34.952922 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d568d8-612b-45b6-9006-942b935845a1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:34.957419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0eca1-d06a-4da4-afac-18d048e2859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:34.958097 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0eca1-d06a-4da4-afac-18d048e2859c admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:34.958377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0eca1-d06a-4da4-afac-18d048e2859c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:34.958644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0eca1-d06a-4da4-afac-18d048e2859c admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:34.959362 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0eca1-d06a-4da4-afac-18d048e2859c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:34.960931 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0eca1-d06a-4da4-afac-18d048e2859c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:34.971561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1301/2601] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:34.975397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334ef98-67a0-410c-bcff-eec474aaf635 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:34.986047 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334ef98-67a0-410c-bcff-eec474aaf635 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:34.990565 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d2ced-7dfd-467b-baec-fc2e605a67ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:34.991143 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d2ced-7dfd-467b-baec-fc2e605a67ef admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:34.991424 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d2ced-7dfd-467b-baec-fc2e605a67ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:34.991698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d2ced-7dfd-467b-baec-fc2e605a67ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:34.992415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d2ced-7dfd-467b-baec-fc2e605a67ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:34.994162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d2ced-7dfd-467b-baec-fc2e605a67ef admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:35.003848 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1301/2602] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:35.007636 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0eca1-d06a-4da4-afac-18d048e2859c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:35.017678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0eca1-d06a-4da4-afac-18d048e2859c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:35.022156 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8688d86-6780-496f-89cb-6b4a19b2225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:35.023040 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8688d86-6780-496f-89cb-6b4a19b2225b admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:35.023317 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8688d86-6780-496f-89cb-6b4a19b2225b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:35.023583 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8688d86-6780-496f-89cb-6b4a19b2225b admin admin] PATH_INFO: `/v3/projects/b1ce9e56e13745e3b69e08b620b5335d/users/41c11f8edbd648869963db0f1846cbf9/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:35.038134 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8688d86-6780-496f-89cb-6b4a19b2225b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ce9e56e13745e3b69e08b620b5335d, user_id=41c11f8edbd648869963db0f1846cbf9, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:35.040731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8688d86-6780-496f-89cb-6b4a19b2225b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:35.052937 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1302/2603] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:35 2022] PUT /identity/v3/projects/b1ce9e56e13745e3b69e08b620b5335d/users/41c11f8edbd648869963db0f1846cbf9/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:35.057795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ad31a-1bac-4253-a2aa-63dadc1cea31 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:35.058271 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ad31a-1bac-4253-a2aa-63dadc1cea31 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:35.058407 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ad31a-1bac-4253-a2aa-63dadc1cea31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:35.075698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-e48ad31a-1bac-4253-a2aa-63dadc1cea31 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:35.076876 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e48ad31a-1bac-4253-a2aa-63dadc1cea31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:35.135588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1302/2604] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:07:35.145779 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8688d86-6780-496f-89cb-6b4a19b2225b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:35.147567 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e8688d86-6780-496f-89cb-6b4a19b2225b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:35.152865 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:35.205828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8688d86-6780-496f-89cb-6b4a19b2225b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:35.209489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4967b-cdcd-4568-a1e1-fad844c80c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:35.210158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4967b-cdcd-4568-a1e1-fad844c80c3d service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:35.210438 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4967b-cdcd-4568-a1e1-fad844c80c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:35.210707 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4967b-cdcd-4568-a1e1-fad844c80c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:35.220089 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4967b-cdcd-4568-a1e1-fad844c80c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:35.221508 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4967b-cdcd-4568-a1e1-fad844c80c3d service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:35.230809 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1303/2605] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:36.696588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ad31a-1bac-4253-a2aa-63dadc1cea31 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:36.699530 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e48ad31a-1bac-4253-a2aa-63dadc1cea31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:36.762892 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:36.813310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ad31a-1bac-4253-a2aa-63dadc1cea31 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:36.821012 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819dcf8-7be5-4813-b7e1-e82a9a748e42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:36.821785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819dcf8-7be5-4813-b7e1-e82a9a748e42 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:36.822630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819dcf8-7be5-4813-b7e1-e82a9a748e42 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:36.822920 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819dcf8-7be5-4813-b7e1-e82a9a748e42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:36.825472 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5819dcf8-7be5-4813-b7e1-e82a9a748e42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:36.844229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819dcf8-7be5-4813-b7e1-e82a9a748e42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:36.846457 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819dcf8-7be5-4813-b7e1-e82a9a748e42 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:36.863993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1303/2606] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:40.231300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76643e-8056-4daf-8cec-2a4cb0ae2776 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:40.231746 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76643e-8056-4daf-8cec-2a4cb0ae2776 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:40.232019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76643e-8056-4daf-8cec-2a4cb0ae2776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:40.265048 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-2a76643e-8056-4daf-8cec-2a4cb0ae2776 None None] MFA Rules not processed for user `41c11f8edbd648869963db0f1846cbf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:40.266723 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2a76643e-8056-4daf-8cec-2a4cb0ae2776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:40.346592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1304/2607] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:40.351633 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819dcf8-7be5-4813-b7e1-e82a9a748e42 service nova] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:40.369089 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819dcf8-7be5-4813-b7e1-e82a9a748e42 service nova] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:40.377837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c56f5-840a-403d-8113-c463c8dc6378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:40.378724 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c56f5-840a-403d-8113-c463c8dc6378 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:40.379363 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c56f5-840a-403d-8113-c463c8dc6378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:40.379506 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c56f5-840a-403d-8113-c463c8dc6378 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:40.380791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c56f5-840a-403d-8113-c463c8dc6378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:40.383432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c56f5-840a-403d-8113-c463c8dc6378 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:40.417644 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1304/2608] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:07:40 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:40.418969 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76643e-8056-4daf-8cec-2a4cb0ae2776 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:40.431437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76643e-8056-4daf-8cec-2a4cb0ae2776 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:40.492939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97197f13-9a28-4c8a-9b28-e74d6e5c8f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:40.493754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97197f13-9a28-4c8a-9b28-e74d6e5c8f77 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:40.494154 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97197f13-9a28-4c8a-9b28-e74d6e5c8f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:40.494503 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97197f13-9a28-4c8a-9b28-e74d6e5c8f77 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:40.495266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97197f13-9a28-4c8a-9b28-e74d6e5c8f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:40.497279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97197f13-9a28-4c8a-9b28-e74d6e5c8f77 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:40.522347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1305/2609] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:07:40 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:40.523637 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c56f5-840a-403d-8113-c463c8dc6378 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:40.534515 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c56f5-840a-403d-8113-c463c8dc6378 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:40.539135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17b02-9148-4ad6-a37d-c673e9a902f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:40.539792 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17b02-9148-4ad6-a37d-c673e9a902f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:40.540072 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17b02-9148-4ad6-a37d-c673e9a902f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:40.540343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17b02-9148-4ad6-a37d-c673e9a902f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:40.541065 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e17b02-9148-4ad6-a37d-c673e9a902f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:40.542667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e17b02-9148-4ad6-a37d-c673e9a902f9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:40.553573 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1305/2610] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:40.557787 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97197f13-9a28-4c8a-9b28-e74d6e5c8f77 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:40.568682 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97197f13-9a28-4c8a-9b28-e74d6e5c8f77 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:40.573308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5448f-7f40-4bd2-9c8c-c7adadb69f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:40.574266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5448f-7f40-4bd2-9c8c-c7adadb69f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:40.574504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5448f-7f40-4bd2-9c8c-c7adadb69f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:40.574782 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5448f-7f40-4bd2-9c8c-c7adadb69f20 admin admin] PATH_INFO: `/v3/projects/b13d61b8f75848b5b0b1d27a69a586ed/users/69962cad34e3472aa82323cc8912bef1/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:40.590386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5448f-7f40-4bd2-9c8c-c7adadb69f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13d61b8f75848b5b0b1d27a69a586ed, user_id=69962cad34e3472aa82323cc8912bef1, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:40.593121 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5448f-7f40-4bd2-9c8c-c7adadb69f20 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:40.602821 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:40.608409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1306/2611] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:40 2022] PUT /identity/v3/projects/b13d61b8f75848b5b0b1d27a69a586ed/users/69962cad34e3472aa82323cc8912bef1/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:40.613657 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17b02-9148-4ad6-a37d-c673e9a902f9 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:40.623631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17b02-9148-4ad6-a37d-c673e9a902f9 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:40.679903 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98a8c0-3238-4e9e-9465-750bd2c622d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:40.680575 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98a8c0-3238-4e9e-9465-750bd2c622d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:40.680858 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98a8c0-3238-4e9e-9465-750bd2c622d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:40.681139 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98a8c0-3238-4e9e-9465-750bd2c622d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:40.681857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98a8c0-3238-4e9e-9465-750bd2c622d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:40.683479 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98a8c0-3238-4e9e-9465-750bd2c622d0 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:40.693135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1306/2612] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:40.697247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5448f-7f40-4bd2-9c8c-c7adadb69f20 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:40.707439 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5448f-7f40-4bd2-9c8c-c7adadb69f20 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:40.711941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b20a5a-7485-4aec-b78e-d562ba33fd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:40.712805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b20a5a-7485-4aec-b78e-d562ba33fd77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:40.713081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b20a5a-7485-4aec-b78e-d562ba33fd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:40.713347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b20a5a-7485-4aec-b78e-d562ba33fd77 admin admin] PATH_INFO: `/v3/projects/b13d61b8f75848b5b0b1d27a69a586ed/users/69962cad34e3472aa82323cc8912bef1/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:40.715315 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b20a5a-7485-4aec-b78e-d562ba33fd77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13d61b8f75848b5b0b1d27a69a586ed, user_id=69962cad34e3472aa82323cc8912bef1, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:40.717919 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b20a5a-7485-4aec-b78e-d562ba33fd77 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:40.728308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1307/2613] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:40 2022] PUT /identity/v3/projects/b13d61b8f75848b5b0b1d27a69a586ed/users/69962cad34e3472aa82323cc8912bef1/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:41.358140 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98a8c0-3238-4e9e-9465-750bd2c622d0 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:41.450633 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98a8c0-3238-4e9e-9465-750bd2c622d0 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:41.514845 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:41.527523 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a07911-5da7-40e6-a1f9-2f0e10411e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:41.529452 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a07911-5da7-40e6-a1f9-2f0e10411e7c service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:41.529745 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a07911-5da7-40e6-a1f9-2f0e10411e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:41.530105 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a07911-5da7-40e6-a1f9-2f0e10411e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:41.532771 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-24a07911-5da7-40e6-a1f9-2f0e10411e7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:41.643969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a07911-5da7-40e6-a1f9-2f0e10411e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:41.646302 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a07911-5da7-40e6-a1f9-2f0e10411e7c service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:41.660158 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1307/2614] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:46.504032 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223ef41-f252-471b-b5c5-3f1c6bedcf3c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:46.505295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223ef41-f252-471b-b5c5-3f1c6bedcf3c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:46.505780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223ef41-f252-471b-b5c5-3f1c6bedcf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:46.529335 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a07911-5da7-40e6-a1f9-2f0e10411e7c service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:46.530799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-24a07911-5da7-40e6-a1f9-2f0e10411e7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:46.570753 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f223ef41-f252-471b-b5c5-3f1c6bedcf3c None None] MFA Rules not processed for user `69962cad34e3472aa82323cc8912bef1`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:46.572213 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f223ef41-f252-471b-b5c5-3f1c6bedcf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:46.701701 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a07911-5da7-40e6-a1f9-2f0e10411e7c service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:46.707791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659366c6-86b0-4e7b-a225-c31df6ee9695 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90facf92f97d435dbe8a001759a8fe0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:46.708455 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659366c6-86b0-4e7b-a225-c31df6ee9695 service placement] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:46.708737 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659366c6-86b0-4e7b-a225-c31df6ee9695 service placement] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:46.709015 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659366c6-86b0-4e7b-a225-c31df6ee9695 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:46.711693 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-659366c6-86b0-4e7b-a225-c31df6ee9695 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:46.716016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1308/2615] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:46.717076 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223ef41-f252-471b-b5c5-3f1c6bedcf3c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:46.719281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f223ef41-f252-471b-b5c5-3f1c6bedcf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:46.732971 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659366c6-86b0-4e7b-a225-c31df6ee9695 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:46.736118 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659366c6-86b0-4e7b-a225-c31df6ee9695 service placement] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:46.745795 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223ef41-f252-471b-b5c5-3f1c6bedcf3c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:46.747222 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1308/2616] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:07:46.747902 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659366c6-86b0-4e7b-a225-c31df6ee9695 service placement] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:46.749195 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-659366c6-86b0-4e7b-a225-c31df6ee9695 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:46.751480 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4362d54-46cc-48d0-b700-884cd2c3b0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:46.752470 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4362d54-46cc-48d0-b700-884cd2c3b0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:46.752851 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4362d54-46cc-48d0-b700-884cd2c3b0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:46.753222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4362d54-46cc-48d0-b700-884cd2c3b0ac admin admin] PATH_INFO: `/v3/users/08868c65e4824034a998df7398daac9b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:46.754608 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4362d54-46cc-48d0-b700-884cd2c3b0ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=08868c65e4824034a998df7398daac9b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:46.756562 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4362d54-46cc-48d0-b700-884cd2c3b0ac admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:46.821095 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f4362d54-46cc-48d0-b700-884cd2c3b0ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08868c65e4824034a998df7398daac9b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:46.830816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f4362d54-46cc-48d0-b700-884cd2c3b0ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08868c65e4824034a998df7398daac9b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:46.839425 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f4362d54-46cc-48d0-b700-884cd2c3b0ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08868c65e4824034a998df7398daac9b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:46.840341 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f4362d54-46cc-48d0-b700-884cd2c3b0ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08868c65e4824034a998df7398daac9b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:46.841017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f4362d54-46cc-48d0-b700-884cd2c3b0ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08868c65e4824034a998df7398daac9b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:46.849448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659366c6-86b0-4e7b-a225-c31df6ee9695 service placement] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:46.857619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e3fa6-dab2-4a2c-b04d-b7ea0f2b3bcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:46.858419 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e3fa6-dab2-4a2c-b04d-b7ea0f2b3bcb service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:46.858700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e3fa6-dab2-4a2c-b04d-b7ea0f2b3bcb service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:46.859113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e3fa6-dab2-4a2c-b04d-b7ea0f2b3bcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:46.861273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c52e3fa6-dab2-4a2c-b04d-b7ea0f2b3bcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:46.862043 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1309/2617] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:07:46 2022] DELETE /identity/v3/users/08868c65e4824034a998df7398daac9b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:46.885633 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:46.930387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e3fa6-dab2-4a2c-b04d-b7ea0f2b3bcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:46.932080 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e3fa6-dab2-4a2c-b04d-b7ea0f2b3bcb service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:46.942630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1309/2618] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:47.053058 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4362d54-46cc-48d0-b700-884cd2c3b0ac admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:47.054935 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f4362d54-46cc-48d0-b700-884cd2c3b0ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:47.115591 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:47.143094 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4362d54-46cc-48d0-b700-884cd2c3b0ac admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:47.150437 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b232ad4-fde1-41e0-b49c-97c995e295e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:47.151894 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b232ad4-fde1-41e0-b49c-97c995e295e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:47.152375 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b232ad4-fde1-41e0-b49c-97c995e295e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:47.152869 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b232ad4-fde1-41e0-b49c-97c995e295e0 admin admin] PATH_INFO: `/v3/projects/afaac01d95e74b9e9058c9c7ce7237ea` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:47.154670 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b232ad4-fde1-41e0-b49c-97c995e295e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afaac01d95e74b9e9058c9c7ce7237ea)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:47.157193 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b232ad4-fde1-41e0-b49c-97c995e295e0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:47.225015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1b232ad4-fde1-41e0-b49c-97c995e295e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afaac01d95e74b9e9058c9c7ce7237ea', 'request_id': 'req-1b232ad4-fde1-41e0-b49c-97c995e295e0'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:47.231750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1b232ad4-fde1-41e0-b49c-97c995e295e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afaac01d95e74b9e9058c9c7ce7237ea', 'request_id': 'req-1b232ad4-fde1-41e0-b49c-97c995e295e0'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:47.238792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1b232ad4-fde1-41e0-b49c-97c995e295e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afaac01d95e74b9e9058c9c7ce7237ea', 'request_id': 'req-1b232ad4-fde1-41e0-b49c-97c995e295e0'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:47.252080 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1b232ad4-fde1-41e0-b49c-97c995e295e0 admin admin] The token cache is being invalidate because project afaac01d95e74b9e9058c9c7ce7237ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:07:47.252477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1b232ad4-fde1-41e0-b49c-97c995e295e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:47.253167 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1b232ad4-fde1-41e0-b49c-97c995e295e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:07:47.256012 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1310/2619] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:07:47 2022] DELETE /identity/v3/projects/afaac01d95e74b9e9058c9c7ce7237ea => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:47.260025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10f355-6b85-477a-ade1-1cb13a6f506b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:47.260384 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10f355-6b85-477a-ade1-1cb13a6f506b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:47.260726 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10f355-6b85-477a-ade1-1cb13a6f506b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:47.286636 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-2f10f355-6b85-477a-ade1-1cb13a6f506b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:47.287921 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-2f10f355-6b85-477a-ade1-1cb13a6f506b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:47.359928 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1310/2620] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:07:47.362038 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7d028-baf6-4b1a-9e47-47701ff017f7 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:47.362332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7d028-baf6-4b1a-9e47-47701ff017f7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:47.362689 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7d028-baf6-4b1a-9e47-47701ff017f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:47.383200 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-98b7d028-baf6-4b1a-9e47-47701ff017f7 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:47.384535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-98b7d028-baf6-4b1a-9e47-47701ff017f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:47.392978 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1311/2621] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:47.397050 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10f355-6b85-477a-ade1-1cb13a6f506b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:47.409517 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10f355-6b85-477a-ade1-1cb13a6f506b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:47.416010 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d759873-3021-4881-b9d7-b4522b147200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:47.416711 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d759873-3021-4881-b9d7-b4522b147200 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:47.417098 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d759873-3021-4881-b9d7-b4522b147200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:47.417375 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d759873-3021-4881-b9d7-b4522b147200 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:47.418277 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d759873-3021-4881-b9d7-b4522b147200 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:07:47.418585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d759873-3021-4881-b9d7-b4522b147200 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:47.420203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d759873-3021-4881-b9d7-b4522b147200 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:47.433908 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1311/2622] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:07:47.438234 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7d028-baf6-4b1a-9e47-47701ff017f7 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:47.447404 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7d028-baf6-4b1a-9e47-47701ff017f7 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:47.452168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44223129-b898-4f33-8173-f6ec59c6ffad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:47.452861 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44223129-b898-4f33-8173-f6ec59c6ffad admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:47.453137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44223129-b898-4f33-8173-f6ec59c6ffad admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:47.453458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44223129-b898-4f33-8173-f6ec59c6ffad admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:47.454287 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44223129-b898-4f33-8173-f6ec59c6ffad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:47.456299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44223129-b898-4f33-8173-f6ec59c6ffad admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:47.497906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1312/2623] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:07:47 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:47.499682 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d759873-3021-4881-b9d7-b4522b147200 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:47.516606 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d759873-3021-4881-b9d7-b4522b147200 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:47.584135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10353f-bda7-4536-b7f1-f6f7bdedbb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:47.584767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10353f-bda7-4536-b7f1-f6f7bdedbb47 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:47.584767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10353f-bda7-4536-b7f1-f6f7bdedbb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:47.585041 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10353f-bda7-4536-b7f1-f6f7bdedbb47 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:47.585795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10353f-bda7-4536-b7f1-f6f7bdedbb47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:47.588107 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10353f-bda7-4536-b7f1-f6f7bdedbb47 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:47.610496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1312/2624] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:07:47 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:47.615395 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44223129-b898-4f33-8173-f6ec59c6ffad admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:47.627761 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44223129-b898-4f33-8173-f6ec59c6ffad admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:47.632712 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b380fb2-52c8-41e0-918e-f4bde0817400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:47.633828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b380fb2-52c8-41e0-918e-f4bde0817400 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:47.633828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b380fb2-52c8-41e0-918e-f4bde0817400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:47.634101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b380fb2-52c8-41e0-918e-f4bde0817400 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:47.634703 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b380fb2-52c8-41e0-918e-f4bde0817400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:47.636425 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b380fb2-52c8-41e0-918e-f4bde0817400 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:47.648447 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1313/2625] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:47.652533 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10353f-bda7-4536-b7f1-f6f7bdedbb47 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:47.663925 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10353f-bda7-4536-b7f1-f6f7bdedbb47 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:47.669079 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ff2b5-da15-4d47-95c4-8b684e918eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:47.669872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ff2b5-da15-4d47-95c4-8b684e918eef admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:47.670192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ff2b5-da15-4d47-95c4-8b684e918eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:47.670471 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ff2b5-da15-4d47-95c4-8b684e918eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:47.671208 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ff2b5-da15-4d47-95c4-8b684e918eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:47.674478 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ff2b5-da15-4d47-95c4-8b684e918eef admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:47.686415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1313/2626] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:47.690432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b380fb2-52c8-41e0-918e-f4bde0817400 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:47.701963 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b380fb2-52c8-41e0-918e-f4bde0817400 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:47.721675 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682c728-de31-492c-9a0e-8da8b77f84da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:47.722715 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682c728-de31-492c-9a0e-8da8b77f84da admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:47.723068 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682c728-de31-492c-9a0e-8da8b77f84da admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:47.723558 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682c728-de31-492c-9a0e-8da8b77f84da admin admin] PATH_INFO: `/v3/projects/da3694ba7fe1410a8ec493fc621449e8/users/8af72d0f18b04993953dbfdd7a235134/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:47.755249 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682c728-de31-492c-9a0e-8da8b77f84da admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3694ba7fe1410a8ec493fc621449e8, user_id=8af72d0f18b04993953dbfdd7a235134, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:47.759054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682c728-de31-492c-9a0e-8da8b77f84da admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:47.788527 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1314/2627] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:47 2022] PUT /identity/v3/projects/da3694ba7fe1410a8ec493fc621449e8/users/8af72d0f18b04993953dbfdd7a235134/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:47.791166 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf2032-e169-4dc1-8ac3-79f4a74fefb0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:47.791626 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf2032-e169-4dc1-8ac3-79f4a74fefb0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:47.792053 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf2032-e169-4dc1-8ac3-79f4a74fefb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:47.834083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-feaf2032-e169-4dc1-8ac3-79f4a74fefb0 None None] MFA Rules not processed for user `8af72d0f18b04993953dbfdd7a235134`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:47.835778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-feaf2032-e169-4dc1-8ac3-79f4a74fefb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:47.863054 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:47.929113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1314/2628] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:47.933615 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682c728-de31-492c-9a0e-8da8b77f84da admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:48.019219 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682c728-de31-492c-9a0e-8da8b77f84da admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:48.024605 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a89a53-bad9-4afd-ba0d-a15093b47c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:48.025364 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a89a53-bad9-4afd-ba0d-a15093b47c53 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:48.025553 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a89a53-bad9-4afd-ba0d-a15093b47c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:48.025830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a89a53-bad9-4afd-ba0d-a15093b47c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:48.026579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a89a53-bad9-4afd-ba0d-a15093b47c53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:48.028570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a89a53-bad9-4afd-ba0d-a15093b47c53 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:48.034720 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:48.062860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1315/2629] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:07:47 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:07:48.067588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf2032-e169-4dc1-8ac3-79f4a74fefb0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:48.080403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf2032-e169-4dc1-8ac3-79f4a74fefb0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:48.148256 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649a0ac-1ed7-41bc-9049-8afc64f3c58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:48.148946 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649a0ac-1ed7-41bc-9049-8afc64f3c58d admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:48.149325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649a0ac-1ed7-41bc-9049-8afc64f3c58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:48.149702 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649a0ac-1ed7-41bc-9049-8afc64f3c58d admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:48.150502 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649a0ac-1ed7-41bc-9049-8afc64f3c58d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:48.152773 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649a0ac-1ed7-41bc-9049-8afc64f3c58d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:48.177076 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1315/2630] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:07:48 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:07:48.182501 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a89a53-bad9-4afd-ba0d-a15093b47c53 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:48.194768 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a89a53-bad9-4afd-ba0d-a15093b47c53 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:48.201228 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962204a-209d-449f-b2ff-fc9b9b77a7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:48.202091 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962204a-209d-449f-b2ff-fc9b9b77a7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:48.202624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962204a-209d-449f-b2ff-fc9b9b77a7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:48.203984 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962204a-209d-449f-b2ff-fc9b9b77a7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:48.205805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962204a-209d-449f-b2ff-fc9b9b77a7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:48.208002 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962204a-209d-449f-b2ff-fc9b9b77a7e3 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:48.222807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1316/2631] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:07:48.224260 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649a0ac-1ed7-41bc-9049-8afc64f3c58d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:48.236411 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649a0ac-1ed7-41bc-9049-8afc64f3c58d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:48.243006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ed74b-732e-44f4-a821-43129e8832b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:48.243945 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ed74b-732e-44f4-a821-43129e8832b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:48.244229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ed74b-732e-44f4-a821-43129e8832b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:48.244938 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ed74b-732e-44f4-a821-43129e8832b7 admin admin] PATH_INFO: `/v3/projects/3056e5c598f44bc19a50fd94ef1b32fa/users/b44a9df0dd3f4748958e1f1c225356a3/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:48.264999 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ed74b-732e-44f4-a821-43129e8832b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3056e5c598f44bc19a50fd94ef1b32fa, user_id=b44a9df0dd3f4748958e1f1c225356a3, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:48.268792 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ed74b-732e-44f4-a821-43129e8832b7 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:48.285828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c108dbe-c7c3-4ebf-a217-57da8092f7f4 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:48.286235 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c108dbe-c7c3-4ebf-a217-57da8092f7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:48.286658 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c108dbe-c7c3-4ebf-a217-57da8092f7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:48.291289 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1316/2632] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:48 2022] PUT /identity/v3/projects/3056e5c598f44bc19a50fd94ef1b32fa/users/b44a9df0dd3f4748958e1f1c225356a3/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:48.292466 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ed74b-732e-44f4-a821-43129e8832b7 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:48.312604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5c108dbe-c7c3-4ebf-a217-57da8092f7f4 None None] MFA Rules not processed for user `41c11f8edbd648869963db0f1846cbf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:48.314040 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5c108dbe-c7c3-4ebf-a217-57da8092f7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:48.379041 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ed74b-732e-44f4-a821-43129e8832b7 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:48.380623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1317/2633] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:07:48.385099 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050508a8-eeb3-405c-883b-3ac5f735771b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:48.385867 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050508a8-eeb3-405c-883b-3ac5f735771b admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:48.386729 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050508a8-eeb3-405c-883b-3ac5f735771b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:48.386729 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050508a8-eeb3-405c-883b-3ac5f735771b admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:48.387872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050508a8-eeb3-405c-883b-3ac5f735771b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:48.389209 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050508a8-eeb3-405c-883b-3ac5f735771b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:48.407560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1317/2634] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:07:48.409427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c108dbe-c7c3-4ebf-a217-57da8092f7f4 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:48.423447 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c108dbe-c7c3-4ebf-a217-57da8092f7f4 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:48.428397 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0829e-70fa-471a-aa3b-6b5743f81ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:48.429431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0829e-70fa-471a-aa3b-6b5743f81ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:48.429737 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0829e-70fa-471a-aa3b-6b5743f81ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:48.430230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0829e-70fa-471a-aa3b-6b5743f81ca5 admin admin] PATH_INFO: `/v3/projects/3056e5c598f44bc19a50fd94ef1b32fa/users/b44a9df0dd3f4748958e1f1c225356a3/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:48.432556 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0829e-70fa-471a-aa3b-6b5743f81ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3056e5c598f44bc19a50fd94ef1b32fa, user_id=b44a9df0dd3f4748958e1f1c225356a3, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:48.435328 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0829e-70fa-471a-aa3b-6b5743f81ca5 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:48.448080 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1318/2635] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:07:48 2022] PUT /identity/v3/projects/3056e5c598f44bc19a50fd94ef1b32fa/users/b44a9df0dd3f4748958e1f1c225356a3/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:07:48.459837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdd6e8-96b4-448e-adf8-92d74aaeebf9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:48.460137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdd6e8-96b4-448e-adf8-92d74aaeebf9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:48.460629 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdd6e8-96b4-448e-adf8-92d74aaeebf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:48.498154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b6bdd6e8-96b4-448e-adf8-92d74aaeebf9 None None] MFA Rules not processed for user `b44a9df0dd3f4748958e1f1c225356a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:07:48.500307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b6bdd6e8-96b4-448e-adf8-92d74aaeebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:48.506386 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:48.588761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1318/2636] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:07:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:07:48.603720 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0829e-70fa-471a-aa3b-6b5743f81ca5 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:48.605609 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-72f0829e-70fa-471a-aa3b-6b5743f81ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:07:48.672358 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0829e-70fa-471a-aa3b-6b5743f81ca5 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:48.677497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a8c19-0e44-49b4-8923-56e4eb09672b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:48.678422 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a8c19-0e44-49b4-8923-56e4eb09672b service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:48.678704 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a8c19-0e44-49b4-8923-56e4eb09672b service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:48.679070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a8c19-0e44-49b4-8923-56e4eb09672b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:48.690837 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a8c19-0e44-49b4-8923-56e4eb09672b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:48.692551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a8c19-0e44-49b4-8923-56e4eb09672b service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:48.706440 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1319/2637] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:48.789423 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdd6e8-96b4-448e-adf8-92d74aaeebf9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:07:48.807387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdd6e8-96b4-448e-adf8-92d74aaeebf9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:07:48.811120 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ed05a-7a32-4831-9783-4bd8f8344e65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:07:48.811767 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ed05a-7a32-4831-9783-4bd8f8344e65 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:07:48.812637 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ed05a-7a32-4831-9783-4bd8f8344e65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:07:48.812893 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ed05a-7a32-4831-9783-4bd8f8344e65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:07:48.886297 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ed05a-7a32-4831-9783-4bd8f8344e65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:07:48.888034 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ed05a-7a32-4831-9783-4bd8f8344e65 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:07:48.904737 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1319/2638] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:07:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:07:58.699514 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=66,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:07:58.899743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=54 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:11.162340 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a8c19-0e44-49b4-8923-56e4eb09672b service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:11.164031 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-079a8c19-0e44-49b4-8923-56e4eb09672b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:11.273409 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a8c19-0e44-49b4-8923-56e4eb09672b service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:11.278893 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78473e29-bcdf-40a4-9b0a-d9cd2750502f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:11.279537 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78473e29-bcdf-40a4-9b0a-d9cd2750502f service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:11.279821 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78473e29-bcdf-40a4-9b0a-d9cd2750502f service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:11.280096 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78473e29-bcdf-40a4-9b0a-d9cd2750502f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:11.282497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-78473e29-bcdf-40a4-9b0a-d9cd2750502f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:11.295098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78473e29-bcdf-40a4-9b0a-d9cd2750502f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:11.296670 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78473e29-bcdf-40a4-9b0a-d9cd2750502f service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:11.308159 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1320/2639] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:08:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:08:14.165397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ed05a-7a32-4831-9783-4bd8f8344e65 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:14.167067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-079ed05a-7a32-4831-9783-4bd8f8344e65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:14.224068 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ed05a-7a32-4831-9783-4bd8f8344e65 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:14.227849 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e49f6-e565-49ef-9f9c-36c1a0edaba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:14.228514 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e49f6-e565-49ef-9f9c-36c1a0edaba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:14.228796 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e49f6-e565-49ef-9f9c-36c1a0edaba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:14.229072 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e49f6-e565-49ef-9f9c-36c1a0edaba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:14.230839 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5a3e49f6-e565-49ef-9f9c-36c1a0edaba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:14.291997 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e49f6-e565-49ef-9f9c-36c1a0edaba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:14.293416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e49f6-e565-49ef-9f9c-36c1a0edaba8 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:14.303491 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1320/2640] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:08:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:08:18.087167 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78473e29-bcdf-40a4-9b0a-d9cd2750502f service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:18.149099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78473e29-bcdf-40a4-9b0a-d9cd2750502f service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:18.153611 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbeb93b-ad63-481f-8fd5-edbf3c07ecfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:18.154494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbeb93b-ad63-481f-8fd5-edbf3c07ecfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:18.154775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbeb93b-ad63-481f-8fd5-edbf3c07ecfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:18.155044 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbeb93b-ad63-481f-8fd5-edbf3c07ecfe admin admin] PATH_INFO: `/v3/users/8af72d0f18b04993953dbfdd7a235134` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:18.156212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbeb93b-ad63-481f-8fd5-edbf3c07ecfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af72d0f18b04993953dbfdd7a235134)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:18.158655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbeb93b-ad63-481f-8fd5-edbf3c07ecfe admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:18.204799 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fcbeb93b-ad63-481f-8fd5-edbf3c07ecfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af72d0f18b04993953dbfdd7a235134'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:18.212997 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fcbeb93b-ad63-481f-8fd5-edbf3c07ecfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af72d0f18b04993953dbfdd7a235134'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:18.220533 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fcbeb93b-ad63-481f-8fd5-edbf3c07ecfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af72d0f18b04993953dbfdd7a235134'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:18.221151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fcbeb93b-ad63-481f-8fd5-edbf3c07ecfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af72d0f18b04993953dbfdd7a235134'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:18.221755 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fcbeb93b-ad63-481f-8fd5-edbf3c07ecfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af72d0f18b04993953dbfdd7a235134'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:18.239753 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1321/2641] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:08:18 2022] DELETE /identity/v3/users/8af72d0f18b04993953dbfdd7a235134 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:18.244163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cac57-5361-4267-bafd-9701d6aaa94b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:18.244618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cac57-5361-4267-bafd-9701d6aaa94b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:18.244713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cac57-5361-4267-bafd-9701d6aaa94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:18.261721 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-f72cac57-5361-4267-bafd-9701d6aaa94b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:18.262958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f72cac57-5361-4267-bafd-9701d6aaa94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:18.322377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1321/2642] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:18.331864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbeb93b-ad63-481f-8fd5-edbf3c07ecfe admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:18.333241 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fcbeb93b-ad63-481f-8fd5-edbf3c07ecfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:18.339829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:18.392708 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbeb93b-ad63-481f-8fd5-edbf3c07ecfe admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:18.396417 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b8e16-35be-4ca0-a7dd-e1a7a129b08e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:18.397047 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b8e16-35be-4ca0-a7dd-e1a7a129b08e service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:18.397325 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b8e16-35be-4ca0-a7dd-e1a7a129b08e service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:18.397594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b8e16-35be-4ca0-a7dd-e1a7a129b08e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:18.407343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b8e16-35be-4ca0-a7dd-e1a7a129b08e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:18.408787 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b8e16-35be-4ca0-a7dd-e1a7a129b08e service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:18.418620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1322/2643] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:08:18.685585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cac57-5361-4267-bafd-9701d6aaa94b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:18.687090 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f72cac57-5361-4267-bafd-9701d6aaa94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:18.699256 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cac57-5361-4267-bafd-9701d6aaa94b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:18.704607 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247202c-5fed-42d0-9560-9969361e5f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:18.705486 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247202c-5fed-42d0-9560-9969361e5f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:18.705755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247202c-5fed-42d0-9560-9969361e5f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:18.706093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247202c-5fed-42d0-9560-9969361e5f10 admin admin] PATH_INFO: `/v3/projects/da3694ba7fe1410a8ec493fc621449e8` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:18.707275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247202c-5fed-42d0-9560-9969361e5f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da3694ba7fe1410a8ec493fc621449e8)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:18.709178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247202c-5fed-42d0-9560-9969361e5f10 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:18.754235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:18.757389 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d247202c-5fed-42d0-9560-9969361e5f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da3694ba7fe1410a8ec493fc621449e8', 'request_id': 'req-d247202c-5fed-42d0-9560-9969361e5f10'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:18.763764 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d247202c-5fed-42d0-9560-9969361e5f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da3694ba7fe1410a8ec493fc621449e8', 'request_id': 'req-d247202c-5fed-42d0-9560-9969361e5f10'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:18.770285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d247202c-5fed-42d0-9560-9969361e5f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da3694ba7fe1410a8ec493fc621449e8', 'request_id': 'req-d247202c-5fed-42d0-9560-9969361e5f10'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:18.782609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d247202c-5fed-42d0-9560-9969361e5f10 admin admin] The token cache is being invalidate because project da3694ba7fe1410a8ec493fc621449e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:08:18.782889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d247202c-5fed-42d0-9560-9969361e5f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:18.783527 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d247202c-5fed-42d0-9560-9969361e5f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:18.785084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1322/2644] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:08:18 2022] DELETE /identity/v3/projects/da3694ba7fe1410a8ec493fc621449e8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:18.789185 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b8e16-35be-4ca0-a7dd-e1a7a129b08e service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:18.799026 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b8e16-35be-4ca0-a7dd-e1a7a129b08e service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:18.854132 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4543546-37a6-46bc-92b1-c3f3ce9c8d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:18.854996 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543546-37a6-46bc-92b1-c3f3ce9c8d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:18.855274 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543546-37a6-46bc-92b1-c3f3ce9c8d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:18.855546 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543546-37a6-46bc-92b1-c3f3ce9c8d19 admin admin] PATH_INFO: `/v3/users/b44a9df0dd3f4748958e1f1c225356a3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:18.856709 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4543546-37a6-46bc-92b1-c3f3ce9c8d19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b44a9df0dd3f4748958e1f1c225356a3)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:18.858654 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4543546-37a6-46bc-92b1-c3f3ce9c8d19 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:18.902817 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e4543546-37a6-46bc-92b1-c3f3ce9c8d19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b44a9df0dd3f4748958e1f1c225356a3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:18.910053 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e4543546-37a6-46bc-92b1-c3f3ce9c8d19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b44a9df0dd3f4748958e1f1c225356a3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:18.917045 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e4543546-37a6-46bc-92b1-c3f3ce9c8d19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b44a9df0dd3f4748958e1f1c225356a3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:18.917653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e4543546-37a6-46bc-92b1-c3f3ce9c8d19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b44a9df0dd3f4748958e1f1c225356a3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:18.918259 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e4543546-37a6-46bc-92b1-c3f3ce9c8d19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b44a9df0dd3f4748958e1f1c225356a3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:18.934973 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1323/2645] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:08:18 2022] DELETE /identity/v3/users/b44a9df0dd3f4748958e1f1c225356a3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:08:19.442141 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247202c-5fed-42d0-9560-9969361e5f10 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:19.443824 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d247202c-5fed-42d0-9560-9969361e5f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:19.458832 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247202c-5fed-42d0-9560-9969361e5f10 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:19.516394 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f351c2-f838-4945-8671-4bd25491c045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:19.517245 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f351c2-f838-4945-8671-4bd25491c045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:19.517523 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f351c2-f838-4945-8671-4bd25491c045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:19.517792 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f351c2-f838-4945-8671-4bd25491c045 admin admin] PATH_INFO: `/v3/projects/3056e5c598f44bc19a50fd94ef1b32fa` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:19.518989 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f351c2-f838-4945-8671-4bd25491c045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3056e5c598f44bc19a50fd94ef1b32fa)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:19.520950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f351c2-f838-4945-8671-4bd25491c045 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:19.566092 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-44f351c2-f838-4945-8671-4bd25491c045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3056e5c598f44bc19a50fd94ef1b32fa', 'request_id': 'req-44f351c2-f838-4945-8671-4bd25491c045'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:19.571511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-44f351c2-f838-4945-8671-4bd25491c045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3056e5c598f44bc19a50fd94ef1b32fa', 'request_id': 'req-44f351c2-f838-4945-8671-4bd25491c045'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:19.577438 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-44f351c2-f838-4945-8671-4bd25491c045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3056e5c598f44bc19a50fd94ef1b32fa', 'request_id': 'req-44f351c2-f838-4945-8671-4bd25491c045'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:19.589776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-44f351c2-f838-4945-8671-4bd25491c045 admin admin] The token cache is being invalidate because project 3056e5c598f44bc19a50fd94ef1b32fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:08:19.590097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-44f351c2-f838-4945-8671-4bd25491c045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:19.590715 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-44f351c2-f838-4945-8671-4bd25491c045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:19.592270 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1323/2646] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:08:19 2022] DELETE /identity/v3/projects/3056e5c598f44bc19a50fd94ef1b32fa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:19.597586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d394c9-e5f0-47c8-85fe-5e33526ae21a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:19.598093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d394c9-e5f0-47c8-85fe-5e33526ae21a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:19.598212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d394c9-e5f0-47c8-85fe-5e33526ae21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:19.617517 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-02d394c9-e5f0-47c8-85fe-5e33526ae21a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:19.618664 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-02d394c9-e5f0-47c8-85fe-5e33526ae21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:19.638420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:19.680756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1324/2647] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:19.688557 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc6b98-dc6a-4af3-9660-6e0f4dc7ecc5 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:19.688847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc6b98-dc6a-4af3-9660-6e0f4dc7ecc5 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:19.689126 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc6b98-dc6a-4af3-9660-6e0f4dc7ecc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:19.706943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-16bc6b98-dc6a-4af3-9660-6e0f4dc7ecc5 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:19.708163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-16bc6b98-dc6a-4af3-9660-6e0f4dc7ecc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:19.716063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1324/2648] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:19.720567 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d394c9-e5f0-47c8-85fe-5e33526ae21a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:19.730283 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d394c9-e5f0-47c8-85fe-5e33526ae21a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:19.735400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e3a26-1957-49be-b866-97283c675d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:19.736327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e3a26-1957-49be-b866-97283c675d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:19.736617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e3a26-1957-49be-b866-97283c675d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:19.736895 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e3a26-1957-49be-b866-97283c675d66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:19.737616 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e3a26-1957-49be-b866-97283c675d66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:08:19.737941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e3a26-1957-49be-b866-97283c675d66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:19.739561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e3a26-1957-49be-b866-97283c675d66 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:19.751052 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1325/2649] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:08:19.755332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc6b98-dc6a-4af3-9660-6e0f4dc7ecc5 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:19.764615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc6b98-dc6a-4af3-9660-6e0f4dc7ecc5 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:19.769320 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03462b0c-7ff8-402c-bd5a-3621d3e96784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:19.770006 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03462b0c-7ff8-402c-bd5a-3621d3e96784 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:19.770297 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03462b0c-7ff8-402c-bd5a-3621d3e96784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:19.770575 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03462b0c-7ff8-402c-bd5a-3621d3e96784 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:19.771273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03462b0c-7ff8-402c-bd5a-3621d3e96784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:19.773203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03462b0c-7ff8-402c-bd5a-3621d3e96784 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:19.798728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1325/2650] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:08:19 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:08:19.802962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e3a26-1957-49be-b866-97283c675d66 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:19.813326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e3a26-1957-49be-b866-97283c675d66 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:19.868871 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f9e27-8c8a-446e-979f-3b8c9e0d9827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:19.869455 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f9e27-8c8a-446e-979f-3b8c9e0d9827 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:19.869735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f9e27-8c8a-446e-979f-3b8c9e0d9827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:19.870049 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f9e27-8c8a-446e-979f-3b8c9e0d9827 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:19.870736 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f9e27-8c8a-446e-979f-3b8c9e0d9827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:19.872630 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f9e27-8c8a-446e-979f-3b8c9e0d9827 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:19.891642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1326/2651] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:08:19 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:08:19.895805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03462b0c-7ff8-402c-bd5a-3621d3e96784 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:19.906036 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03462b0c-7ff8-402c-bd5a-3621d3e96784 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:19.911089 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a44d4-f23d-4fde-bfe2-8d02208a9742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:19.911733 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a44d4-f23d-4fde-bfe2-8d02208a9742 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:19.912017 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a44d4-f23d-4fde-bfe2-8d02208a9742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:19.912294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a44d4-f23d-4fde-bfe2-8d02208a9742 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:19.913016 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a44d4-f23d-4fde-bfe2-8d02208a9742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:19.914649 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a44d4-f23d-4fde-bfe2-8d02208a9742 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:19.927116 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1326/2652] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:08:19.931227 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f9e27-8c8a-446e-979f-3b8c9e0d9827 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:19.941106 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f9e27-8c8a-446e-979f-3b8c9e0d9827 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:19.945687 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ce11a-a069-47fe-adeb-c7f7edd2a54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:19.946364 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ce11a-a069-47fe-adeb-c7f7edd2a54b admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:19.946646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ce11a-a069-47fe-adeb-c7f7edd2a54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:19.946919 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ce11a-a069-47fe-adeb-c7f7edd2a54b admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:19.947636 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ce11a-a069-47fe-adeb-c7f7edd2a54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:19.949214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ce11a-a069-47fe-adeb-c7f7edd2a54b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:19.959618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1327/2653] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:08:19.963542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a44d4-f23d-4fde-bfe2-8d02208a9742 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:19.974280 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a44d4-f23d-4fde-bfe2-8d02208a9742 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:19.978970 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965c54e-78fc-4320-ac22-024bfd2d08d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:19.979846 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c54e-78fc-4320-ac22-024bfd2d08d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:19.980140 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c54e-78fc-4320-ac22-024bfd2d08d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:19.980404 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c54e-78fc-4320-ac22-024bfd2d08d3 admin admin] PATH_INFO: `/v3/projects/b06b6a9a32e543689168b319bedb9eb8/users/dc33692708824b13a8205f1515fe5c4b/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:19.996007 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965c54e-78fc-4320-ac22-024bfd2d08d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06b6a9a32e543689168b319bedb9eb8, user_id=dc33692708824b13a8205f1515fe5c4b, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:19.998666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965c54e-78fc-4320-ac22-024bfd2d08d3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:20.007332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:20.012299 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1327/2654] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:08:19 2022] PUT /identity/v3/projects/b06b6a9a32e543689168b319bedb9eb8/users/dc33692708824b13a8205f1515fe5c4b/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:20.024166 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f60a9-bcf7-44a6-95bc-51c7731c7801 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:20.024459 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f60a9-bcf7-44a6-95bc-51c7731c7801 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:20.024765 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f60a9-bcf7-44a6-95bc-51c7731c7801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:20.051117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5e2f60a9-bcf7-44a6-95bc-51c7731c7801 None None] MFA Rules not processed for user `dc33692708824b13a8205f1515fe5c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:20.052339 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5e2f60a9-bcf7-44a6-95bc-51c7731c7801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:20.115014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1328/2655] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:20.119486 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965c54e-78fc-4320-ac22-024bfd2d08d3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:20.179348 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965c54e-78fc-4320-ac22-024bfd2d08d3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:20.184034 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e72a1f-2386-4d49-a0b5-bcaac7c16e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:20.184711 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e72a1f-2386-4d49-a0b5-bcaac7c16e18 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:20.184993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e72a1f-2386-4d49-a0b5-bcaac7c16e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:20.185270 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e72a1f-2386-4d49-a0b5-bcaac7c16e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:20.185968 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e72a1f-2386-4d49-a0b5-bcaac7c16e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:20.187892 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e72a1f-2386-4d49-a0b5-bcaac7c16e18 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:20.218618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1328/2656] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:08:20 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:08:20.220316 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f60a9-bcf7-44a6-95bc-51c7731c7801 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:20.230850 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f60a9-bcf7-44a6-95bc-51c7731c7801 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:20.248734 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:20.287662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca83c1c-5e77-44d1-b72d-f5a89ad3b3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:20.288321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca83c1c-5e77-44d1-b72d-f5a89ad3b3eb admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:20.288605 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca83c1c-5e77-44d1-b72d-f5a89ad3b3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:20.288901 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca83c1c-5e77-44d1-b72d-f5a89ad3b3eb admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:20.289594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca83c1c-5e77-44d1-b72d-f5a89ad3b3eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:20.291553 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca83c1c-5e77-44d1-b72d-f5a89ad3b3eb admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:20.309552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1329/2657] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:08:20 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:08:20.314182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e72a1f-2386-4d49-a0b5-bcaac7c16e18 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:20.324349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e72a1f-2386-4d49-a0b5-bcaac7c16e18 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:20.330221 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6795828-b5ac-4239-8e9c-0e89d840319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:20.330865 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6795828-b5ac-4239-8e9c-0e89d840319b admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:20.331160 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6795828-b5ac-4239-8e9c-0e89d840319b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:20.331413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6795828-b5ac-4239-8e9c-0e89d840319b admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:20.332123 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6795828-b5ac-4239-8e9c-0e89d840319b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:20.333699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6795828-b5ac-4239-8e9c-0e89d840319b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:20.343976 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1329/2658] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:08:20.347871 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca83c1c-5e77-44d1-b72d-f5a89ad3b3eb admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:20.357819 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca83c1c-5e77-44d1-b72d-f5a89ad3b3eb admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:20.362808 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aeb0ab-3a49-490e-950d-f501fef9af6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:20.363688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeb0ab-3a49-490e-950d-f501fef9af6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:20.363970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeb0ab-3a49-490e-950d-f501fef9af6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:20.364247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeb0ab-3a49-490e-950d-f501fef9af6f admin admin] PATH_INFO: `/v3/projects/2036cdcbb70a44ef917933b51ba230c8/users/62e6bdc48b5b45ecb5436875fec0d2be/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:20.379359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aeb0ab-3a49-490e-950d-f501fef9af6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2036cdcbb70a44ef917933b51ba230c8, user_id=62e6bdc48b5b45ecb5436875fec0d2be, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:20.381974 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aeb0ab-3a49-490e-950d-f501fef9af6f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:20.394989 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1330/2659] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:08:20 2022] PUT /identity/v3/projects/2036cdcbb70a44ef917933b51ba230c8/users/62e6bdc48b5b45ecb5436875fec0d2be/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:20.398862 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6795828-b5ac-4239-8e9c-0e89d840319b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:20.408953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6795828-b5ac-4239-8e9c-0e89d840319b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:20.464457 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b5ba6-9f21-461c-b613-274c4f90b806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:20.465115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5ba6-9f21-461c-b613-274c4f90b806 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:20.465398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5ba6-9f21-461c-b613-274c4f90b806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:20.465674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5ba6-9f21-461c-b613-274c4f90b806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:20.466424 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b5ba6-9f21-461c-b613-274c4f90b806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:20.468012 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b5ba6-9f21-461c-b613-274c4f90b806 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:20.477559 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1330/2660] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:08:20.481668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aeb0ab-3a49-490e-950d-f501fef9af6f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:20.492087 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aeb0ab-3a49-490e-950d-f501fef9af6f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:20.496623 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f276b30-d0c9-498a-a4f9-599a397e9116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:20.497494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f276b30-d0c9-498a-a4f9-599a397e9116 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:20.497771 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f276b30-d0c9-498a-a4f9-599a397e9116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:20.498081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f276b30-d0c9-498a-a4f9-599a397e9116 admin admin] PATH_INFO: `/v3/projects/2036cdcbb70a44ef917933b51ba230c8/users/62e6bdc48b5b45ecb5436875fec0d2be/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:20.500024 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f276b30-d0c9-498a-a4f9-599a397e9116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2036cdcbb70a44ef917933b51ba230c8, user_id=62e6bdc48b5b45ecb5436875fec0d2be, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:20.503204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f276b30-d0c9-498a-a4f9-599a397e9116 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:20.513232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1331/2661] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:08:20 2022] PUT /identity/v3/projects/2036cdcbb70a44ef917933b51ba230c8/users/62e6bdc48b5b45ecb5436875fec0d2be/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:20.523627 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0528f-feef-4bcb-a37c-92297fb2b280 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:20.523919 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0528f-feef-4bcb-a37c-92297fb2b280 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:20.524202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0528f-feef-4bcb-a37c-92297fb2b280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:20.549756 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c4b0528f-feef-4bcb-a37c-92297fb2b280 None None] MFA Rules not processed for user `62e6bdc48b5b45ecb5436875fec0d2be`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:20.550979 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c4b0528f-feef-4bcb-a37c-92297fb2b280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:20.608182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:20.621254 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1331/2662] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:08:20.630507 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f276b30-d0c9-498a-a4f9-599a397e9116 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:20.632170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0f276b30-d0c9-498a-a4f9-599a397e9116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:20.687746 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f276b30-d0c9-498a-a4f9-599a397e9116 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:20.691843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872851e-d077-4f30-be9c-dc98291d170d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:20.692476 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872851e-d077-4f30-be9c-dc98291d170d service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:20.692756 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872851e-d077-4f30-be9c-dc98291d170d service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:20.693095 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872851e-d077-4f30-be9c-dc98291d170d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:20.702302 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872851e-d077-4f30-be9c-dc98291d170d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:20.704452 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872851e-d077-4f30-be9c-dc98291d170d service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:20.713827 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1332/2663] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:08:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:08:21.011299 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0528f-feef-4bcb-a37c-92297fb2b280 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:21.020432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0528f-feef-4bcb-a37c-92297fb2b280 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:21.025426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d164f-8a1d-4882-9470-25c0ed9d3487 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e6bdc48b5b45ecb5436875fec0d2be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2036cdcbb70a44ef917933b51ba230c8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:21.026114 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d164f-8a1d-4882-9470-25c0ed9d3487 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:21.026406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d164f-8a1d-4882-9470-25c0ed9d3487 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:21.026687 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d164f-8a1d-4882-9470-25c0ed9d3487 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:21.027416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d164f-8a1d-4882-9470-25c0ed9d3487 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:08:21.027729 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d164f-8a1d-4882-9470-25c0ed9d3487 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:21.029325 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d164f-8a1d-4882-9470-25c0ed9d3487 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:21.041237 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1332/2664] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:08:21.045069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872851e-d077-4f30-be9c-dc98291d170d service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:21.054611 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872851e-d077-4f30-be9c-dc98291d170d service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:21.059096 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6049a91-7fa1-4f4c-93d9-019529e8e9eb tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e6bdc48b5b45ecb5436875fec0d2be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2036cdcbb70a44ef917933b51ba230c8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:21.059731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6049a91-7fa1-4f4c-93d9-019529e8e9eb tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:21.060016 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6049a91-7fa1-4f4c-93d9-019529e8e9eb tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:21.060293 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6049a91-7fa1-4f4c-93d9-019529e8e9eb tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:21.060981 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6049a91-7fa1-4f4c-93d9-019529e8e9eb tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:21.062915 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6049a91-7fa1-4f4c-93d9-019529e8e9eb tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:21.088448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1333/2665] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:08:21 2022] POST /identity/v3/projects => generated 354 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:08:21.092451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d164f-8a1d-4882-9470-25c0ed9d3487 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:21.102699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d164f-8a1d-4882-9470-25c0ed9d3487 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:21.157760 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b1663-28f3-46db-8077-c905f6ef9107 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e6bdc48b5b45ecb5436875fec0d2be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2036cdcbb70a44ef917933b51ba230c8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:21.158426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b1663-28f3-46db-8077-c905f6ef9107 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:21.158710 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b1663-28f3-46db-8077-c905f6ef9107 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:21.158983 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b1663-28f3-46db-8077-c905f6ef9107 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:21.159692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b1663-28f3-46db-8077-c905f6ef9107 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:08:21.160004 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b1663-28f3-46db-8077-c905f6ef9107 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:21.161580 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b1663-28f3-46db-8077-c905f6ef9107 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:21.173032 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1333/2666] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:08:21.208431 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6049a91-7fa1-4f4c-93d9-019529e8e9eb tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:21.218649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6049a91-7fa1-4f4c-93d9-019529e8e9eb tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:21.223632 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7297d-49f8-4f65-9e10-35ae1e200bf8 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e6bdc48b5b45ecb5436875fec0d2be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2036cdcbb70a44ef917933b51ba230c8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:21.224486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7297d-49f8-4f65-9e10-35ae1e200bf8 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:21.224765 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7297d-49f8-4f65-9e10-35ae1e200bf8 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:21.225038 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7297d-49f8-4f65-9e10-35ae1e200bf8 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] PATH_INFO: `/v3/projects/ca2d6ca687a14a15be4cb8e2b1c93f4b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:21.226347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7297d-49f8-4f65-9e10-35ae1e200bf8 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ca2d6ca687a14a15be4cb8e2b1c93f4b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:21.228332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7297d-49f8-4f65-9e10-35ae1e200bf8 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:21.273272 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f9b7297d-49f8-4f65-9e10-35ae1e200bf8 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2d6ca687a14a15be4cb8e2b1c93f4b', 'request_id': 'req-f9b7297d-49f8-4f65-9e10-35ae1e200bf8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:21.274359 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:21.280644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f9b7297d-49f8-4f65-9e10-35ae1e200bf8 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2d6ca687a14a15be4cb8e2b1c93f4b', 'request_id': 'req-f9b7297d-49f8-4f65-9e10-35ae1e200bf8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:21.287067 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f9b7297d-49f8-4f65-9e10-35ae1e200bf8 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2d6ca687a14a15be4cb8e2b1c93f4b', 'request_id': 'req-f9b7297d-49f8-4f65-9e10-35ae1e200bf8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:21.300504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f9b7297d-49f8-4f65-9e10-35ae1e200bf8 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] The token cache is being invalidate because project ca2d6ca687a14a15be4cb8e2b1c93f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:08:21.300788 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f9b7297d-49f8-4f65-9e10-35ae1e200bf8 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:21.301418 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f9b7297d-49f8-4f65-9e10-35ae1e200bf8 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:21.302981 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1334/2667] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:08:21 2022] DELETE /identity/v3/projects/ca2d6ca687a14a15be4cb8e2b1c93f4b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:21.487654 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b1663-28f3-46db-8077-c905f6ef9107 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:21.489472 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-827b1663-28f3-46db-8077-c905f6ef9107 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:21.553300 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b1663-28f3-46db-8077-c905f6ef9107 tempest-VolumeQuotaClassesTest-595043093 tempest-VolumeQuotaClassesTest-595043093-project-admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:21.607959 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e939c-435e-4c6d-8fe7-1eae81f17ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:21.608827 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e939c-435e-4c6d-8fe7-1eae81f17ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:21.609108 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e939c-435e-4c6d-8fe7-1eae81f17ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:21.609385 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e939c-435e-4c6d-8fe7-1eae81f17ad5 admin admin] PATH_INFO: `/v3/users/dc33692708824b13a8205f1515fe5c4b` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:21.610866 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e939c-435e-4c6d-8fe7-1eae81f17ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc33692708824b13a8205f1515fe5c4b)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:21.612831 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e939c-435e-4c6d-8fe7-1eae81f17ad5 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:21.640587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:21.661773 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e09e939c-435e-4c6d-8fe7-1eae81f17ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc33692708824b13a8205f1515fe5c4b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:21.668626 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e09e939c-435e-4c6d-8fe7-1eae81f17ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc33692708824b13a8205f1515fe5c4b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:21.669280 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e09e939c-435e-4c6d-8fe7-1eae81f17ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc33692708824b13a8205f1515fe5c4b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:21.677080 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e09e939c-435e-4c6d-8fe7-1eae81f17ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc33692708824b13a8205f1515fe5c4b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:21.677684 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e09e939c-435e-4c6d-8fe7-1eae81f17ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc33692708824b13a8205f1515fe5c4b'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:21.694493 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1334/2668] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:08:21 2022] DELETE /identity/v3/users/dc33692708824b13a8205f1515fe5c4b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:21.699049 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201aecd-cc66-498a-ae34-ff148ab8e3ed None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:21.699523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201aecd-cc66-498a-ae34-ff148ab8e3ed None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:21.699637 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201aecd-cc66-498a-ae34-ff148ab8e3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:21.717358 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5201aecd-cc66-498a-ae34-ff148ab8e3ed None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:21.718579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5201aecd-cc66-498a-ae34-ff148ab8e3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:21.778639 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1335/2669] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:21.788815 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e939c-435e-4c6d-8fe7-1eae81f17ad5 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:21.790244 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e09e939c-435e-4c6d-8fe7-1eae81f17ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:21.846295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e939c-435e-4c6d-8fe7-1eae81f17ad5 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:21.849852 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241760a8-2b1f-4fc8-8cfc-0ffc44c6ab1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:21.850510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241760a8-2b1f-4fc8-8cfc-0ffc44c6ab1f service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:21.850790 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241760a8-2b1f-4fc8-8cfc-0ffc44c6ab1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:21.851061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241760a8-2b1f-4fc8-8cfc-0ffc44c6ab1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:21.859998 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241760a8-2b1f-4fc8-8cfc-0ffc44c6ab1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:21.861663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241760a8-2b1f-4fc8-8cfc-0ffc44c6ab1f service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:21.870924 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1335/2670] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:08:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:08:22.130138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201aecd-cc66-498a-ae34-ff148ab8e3ed None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:22.131689 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5201aecd-cc66-498a-ae34-ff148ab8e3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:22.143664 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201aecd-cc66-498a-ae34-ff148ab8e3ed None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:22.148206 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37aa03a-94d9-4f7d-9208-acce032210b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:22.149063 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37aa03a-94d9-4f7d-9208-acce032210b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:22.149342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37aa03a-94d9-4f7d-9208-acce032210b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:22.149608 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37aa03a-94d9-4f7d-9208-acce032210b8 admin admin] PATH_INFO: `/v3/projects/b06b6a9a32e543689168b319bedb9eb8` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:22.150804 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37aa03a-94d9-4f7d-9208-acce032210b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b06b6a9a32e543689168b319bedb9eb8)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:22.152688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37aa03a-94d9-4f7d-9208-acce032210b8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:22.199025 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a37aa03a-94d9-4f7d-9208-acce032210b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b06b6a9a32e543689168b319bedb9eb8', 'request_id': 'req-a37aa03a-94d9-4f7d-9208-acce032210b8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:22.206925 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a37aa03a-94d9-4f7d-9208-acce032210b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b06b6a9a32e543689168b319bedb9eb8', 'request_id': 'req-a37aa03a-94d9-4f7d-9208-acce032210b8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:22.212777 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a37aa03a-94d9-4f7d-9208-acce032210b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b06b6a9a32e543689168b319bedb9eb8', 'request_id': 'req-a37aa03a-94d9-4f7d-9208-acce032210b8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:22.225648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a37aa03a-94d9-4f7d-9208-acce032210b8 admin admin] The token cache is being invalidate because project b06b6a9a32e543689168b319bedb9eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:08:22.225952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a37aa03a-94d9-4f7d-9208-acce032210b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:22.226585 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a37aa03a-94d9-4f7d-9208-acce032210b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:22.228110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1336/2671] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:08:22 2022] DELETE /identity/v3/projects/b06b6a9a32e543689168b319bedb9eb8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:22.232042 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241760a8-2b1f-4fc8-8cfc-0ffc44c6ab1f service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:22.241752 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241760a8-2b1f-4fc8-8cfc-0ffc44c6ab1f service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:22.296614 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157df9f-0ed2-46b3-8e81-c7f33b787159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:22.297561 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157df9f-0ed2-46b3-8e81-c7f33b787159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:22.297851 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157df9f-0ed2-46b3-8e81-c7f33b787159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:22.298160 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157df9f-0ed2-46b3-8e81-c7f33b787159 admin admin] PATH_INFO: `/v3/users/62e6bdc48b5b45ecb5436875fec0d2be` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:22.299399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157df9f-0ed2-46b3-8e81-c7f33b787159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e6bdc48b5b45ecb5436875fec0d2be)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:22.301319 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157df9f-0ed2-46b3-8e81-c7f33b787159 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:22.349175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e157df9f-0ed2-46b3-8e81-c7f33b787159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e6bdc48b5b45ecb5436875fec0d2be'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:22.350427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:22.358184 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e157df9f-0ed2-46b3-8e81-c7f33b787159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e6bdc48b5b45ecb5436875fec0d2be'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:22.358947 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e157df9f-0ed2-46b3-8e81-c7f33b787159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e6bdc48b5b45ecb5436875fec0d2be'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:22.367674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e157df9f-0ed2-46b3-8e81-c7f33b787159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e6bdc48b5b45ecb5436875fec0d2be'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:22.368294 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-e157df9f-0ed2-46b3-8e81-c7f33b787159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e6bdc48b5b45ecb5436875fec0d2be'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:22.385621 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1336/2672] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:08:22 2022] DELETE /identity/v3/users/62e6bdc48b5b45ecb5436875fec0d2be => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:22.651764 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37aa03a-94d9-4f7d-9208-acce032210b8 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:22.653220 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a37aa03a-94d9-4f7d-9208-acce032210b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:22.665983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37aa03a-94d9-4f7d-9208-acce032210b8 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:22.724441 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560e7c0-e04b-4f6e-98fe-3e764836d1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:22.725423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560e7c0-e04b-4f6e-98fe-3e764836d1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:22.725784 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560e7c0-e04b-4f6e-98fe-3e764836d1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:22.726105 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560e7c0-e04b-4f6e-98fe-3e764836d1d3 admin admin] PATH_INFO: `/v3/projects/2036cdcbb70a44ef917933b51ba230c8` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:22.727311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560e7c0-e04b-4f6e-98fe-3e764836d1d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2036cdcbb70a44ef917933b51ba230c8)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:22.729243 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560e7c0-e04b-4f6e-98fe-3e764836d1d3 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:22.731570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:22.776515 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8560e7c0-e04b-4f6e-98fe-3e764836d1d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2036cdcbb70a44ef917933b51ba230c8', 'request_id': 'req-8560e7c0-e04b-4f6e-98fe-3e764836d1d3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:22.782398 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8560e7c0-e04b-4f6e-98fe-3e764836d1d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2036cdcbb70a44ef917933b51ba230c8', 'request_id': 'req-8560e7c0-e04b-4f6e-98fe-3e764836d1d3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:22.788138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8560e7c0-e04b-4f6e-98fe-3e764836d1d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2036cdcbb70a44ef917933b51ba230c8', 'request_id': 'req-8560e7c0-e04b-4f6e-98fe-3e764836d1d3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:22.801657 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8560e7c0-e04b-4f6e-98fe-3e764836d1d3 admin admin] The token cache is being invalidate because project 2036cdcbb70a44ef917933b51ba230c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:08:22.801966 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8560e7c0-e04b-4f6e-98fe-3e764836d1d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:22.802622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8560e7c0-e04b-4f6e-98fe-3e764836d1d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:22.804146 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1337/2673] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:08:22 2022] DELETE /identity/v3/projects/2036cdcbb70a44ef917933b51ba230c8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:22.808956 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59515ae8-f7ef-484a-b91a-ae9f4d4cad65 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:22.809396 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59515ae8-f7ef-484a-b91a-ae9f4d4cad65 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:22.809631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59515ae8-f7ef-484a-b91a-ae9f4d4cad65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:22.827897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-59515ae8-f7ef-484a-b91a-ae9f4d4cad65 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:22.829573 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-59515ae8-f7ef-484a-b91a-ae9f4d4cad65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:22.886678 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1337/2674] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:22.894934 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c040de3-d40e-4df9-9245-8d69dd541e50 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:22.895241 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c040de3-d40e-4df9-9245-8d69dd541e50 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:22.895517 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c040de3-d40e-4df9-9245-8d69dd541e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:22.913555 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1c040de3-d40e-4df9-9245-8d69dd541e50 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:22.914776 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1c040de3-d40e-4df9-9245-8d69dd541e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:22.922695 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1338/2675] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:22.926720 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59515ae8-f7ef-484a-b91a-ae9f4d4cad65 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:22.936374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59515ae8-f7ef-484a-b91a-ae9f4d4cad65 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:22.941706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266ad39-26e8-4b9d-9a68-d135613ad973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:22.942388 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266ad39-26e8-4b9d-9a68-d135613ad973 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:22.942662 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266ad39-26e8-4b9d-9a68-d135613ad973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:22.942963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266ad39-26e8-4b9d-9a68-d135613ad973 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:22.943682 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266ad39-26e8-4b9d-9a68-d135613ad973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:08:22.943983 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266ad39-26e8-4b9d-9a68-d135613ad973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:22.945569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266ad39-26e8-4b9d-9a68-d135613ad973 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:22.957409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1338/2676] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:08:22.961600 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c040de3-d40e-4df9-9245-8d69dd541e50 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:22.970725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c040de3-d40e-4df9-9245-8d69dd541e50 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:22.975343 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473443c7-f9cb-45ad-9184-0f9c52096cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:22.975969 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473443c7-f9cb-45ad-9184-0f9c52096cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:22.976252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473443c7-f9cb-45ad-9184-0f9c52096cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:22.976519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473443c7-f9cb-45ad-9184-0f9c52096cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:22.977203 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473443c7-f9cb-45ad-9184-0f9c52096cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:22.979106 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473443c7-f9cb-45ad-9184-0f9c52096cd4 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:23.004987 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1339/2677] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:08:22 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:08:23.008907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266ad39-26e8-4b9d-9a68-d135613ad973 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:23.018923 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266ad39-26e8-4b9d-9a68-d135613ad973 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:23.075799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072d2e3-7440-47de-9030-9f91251ac5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:23.076456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072d2e3-7440-47de-9030-9f91251ac5ff admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:23.076737 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072d2e3-7440-47de-9030-9f91251ac5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:23.077025 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072d2e3-7440-47de-9030-9f91251ac5ff admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:23.077691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072d2e3-7440-47de-9030-9f91251ac5ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:23.079696 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072d2e3-7440-47de-9030-9f91251ac5ff admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:23.099401 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1339/2678] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:08:23 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:08:23.103508 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473443c7-f9cb-45ad-9184-0f9c52096cd4 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:23.114391 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473443c7-f9cb-45ad-9184-0f9c52096cd4 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:23.119445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a979c5-d321-44df-9b00-b2d3b0010102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:23.120098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a979c5-d321-44df-9b00-b2d3b0010102 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:23.120386 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a979c5-d321-44df-9b00-b2d3b0010102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:23.120689 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a979c5-d321-44df-9b00-b2d3b0010102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:23.121413 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a979c5-d321-44df-9b00-b2d3b0010102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:23.123037 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a979c5-d321-44df-9b00-b2d3b0010102 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:23.133745 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1340/2679] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:08:23.137572 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072d2e3-7440-47de-9030-9f91251ac5ff admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:23.148635 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072d2e3-7440-47de-9030-9f91251ac5ff admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:23.153210 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5af4ed-26d4-4a98-a6b3-a5cb61cd87cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:23.153855 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5af4ed-26d4-4a98-a6b3-a5cb61cd87cf admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:23.154169 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5af4ed-26d4-4a98-a6b3-a5cb61cd87cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:23.154449 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5af4ed-26d4-4a98-a6b3-a5cb61cd87cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:23.155179 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5af4ed-26d4-4a98-a6b3-a5cb61cd87cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:23.156779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5af4ed-26d4-4a98-a6b3-a5cb61cd87cf admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:23.166542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1340/2680] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:08:23.170350 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a979c5-d321-44df-9b00-b2d3b0010102 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:23.180645 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a979c5-d321-44df-9b00-b2d3b0010102 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:23.185285 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4974bc-7534-411a-a275-189f54e3b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:23.186232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4974bc-7534-411a-a275-189f54e3b342 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:23.186866 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4974bc-7534-411a-a275-189f54e3b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:23.186866 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4974bc-7534-411a-a275-189f54e3b342 admin admin] PATH_INFO: `/v3/projects/81851a0f5b734282bfd295d784aba0dc/users/d59c0115781c48b8a9e3fc48f0bc1572/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:23.204081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4974bc-7534-411a-a275-189f54e3b342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81851a0f5b734282bfd295d784aba0dc, user_id=d59c0115781c48b8a9e3fc48f0bc1572, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:23.206853 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4974bc-7534-411a-a275-189f54e3b342 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:23.219514 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1341/2681] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:08:23 2022] PUT /identity/v3/projects/81851a0f5b734282bfd295d784aba0dc/users/d59c0115781c48b8a9e3fc48f0bc1572/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:23.230759 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e324f4a-eb21-459c-96f5-d40d697f8f94 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:23.231066 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e324f4a-eb21-459c-96f5-d40d697f8f94 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:23.231390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e324f4a-eb21-459c-96f5-d40d697f8f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:23.258384 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0e324f4a-eb21-459c-96f5-d40d697f8f94 None None] MFA Rules not processed for user `d59c0115781c48b8a9e3fc48f0bc1572`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:23.259585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0e324f4a-eb21-459c-96f5-d40d697f8f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:23.277310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:23.323315 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1341/2682] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:23.327767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4974bc-7534-411a-a275-189f54e3b342 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:23.390545 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4974bc-7534-411a-a275-189f54e3b342 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:23.395232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459759d-2646-4b5e-97fc-a3b6ace326f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:23.395885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459759d-2646-4b5e-97fc-a3b6ace326f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:23.396170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459759d-2646-4b5e-97fc-a3b6ace326f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:23.396443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459759d-2646-4b5e-97fc-a3b6ace326f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:23.397137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459759d-2646-4b5e-97fc-a3b6ace326f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:23.399078 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459759d-2646-4b5e-97fc-a3b6ace326f5 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:23.425306 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1342/2683] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:08:23 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:08:23.429317 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e324f4a-eb21-459c-96f5-d40d697f8f94 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:23.439923 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e324f4a-eb21-459c-96f5-d40d697f8f94 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:23.495451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23dbd8-f7f2-4175-b791-90ba4ae45f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:23.496110 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23dbd8-f7f2-4175-b791-90ba4ae45f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:23.496393 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23dbd8-f7f2-4175-b791-90ba4ae45f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:23.496672 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23dbd8-f7f2-4175-b791-90ba4ae45f67 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:23.497353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23dbd8-f7f2-4175-b791-90ba4ae45f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:23.499296 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23dbd8-f7f2-4175-b791-90ba4ae45f67 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:23.519763 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1342/2684] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:08:23 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:08:23.523745 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459759d-2646-4b5e-97fc-a3b6ace326f5 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:23.534474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459759d-2646-4b5e-97fc-a3b6ace326f5 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:23.539015 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed991b75-df5e-4738-8cad-4a816dbc3f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:23.539662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed991b75-df5e-4738-8cad-4a816dbc3f1c admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:23.539947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed991b75-df5e-4738-8cad-4a816dbc3f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:23.540224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed991b75-df5e-4738-8cad-4a816dbc3f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:23.540941 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed991b75-df5e-4738-8cad-4a816dbc3f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:23.542580 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed991b75-df5e-4738-8cad-4a816dbc3f1c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:23.553438 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1343/2685] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:08:23.557244 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23dbd8-f7f2-4175-b791-90ba4ae45f67 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:23.567300 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23dbd8-f7f2-4175-b791-90ba4ae45f67 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:23.572008 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b6093-bae3-4296-8869-665d639a8dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:23.572894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b6093-bae3-4296-8869-665d639a8dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:23.573175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b6093-bae3-4296-8869-665d639a8dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:23.573447 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b6093-bae3-4296-8869-665d639a8dc5 admin admin] PATH_INFO: `/v3/projects/de50a48cf3074b83b3d5e153964a32a0/users/c3293a2e01344a54a55fa4bde74acdf4/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:23.587988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b6093-bae3-4296-8869-665d639a8dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de50a48cf3074b83b3d5e153964a32a0, user_id=c3293a2e01344a54a55fa4bde74acdf4, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:23.590729 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b6093-bae3-4296-8869-665d639a8dc5 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:23.604000 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1343/2686] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:08:23 2022] PUT /identity/v3/projects/de50a48cf3074b83b3d5e153964a32a0/users/c3293a2e01344a54a55fa4bde74acdf4/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:23.607885 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed991b75-df5e-4738-8cad-4a816dbc3f1c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:23.613781 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:23.623517 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed991b75-df5e-4738-8cad-4a816dbc3f1c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:23.676878 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bfa6f-4c7f-4952-bbd0-e9223f85f831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:23.677539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bfa6f-4c7f-4952-bbd0-e9223f85f831 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:23.677823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bfa6f-4c7f-4952-bbd0-e9223f85f831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:23.678129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bfa6f-4c7f-4952-bbd0-e9223f85f831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:23.678844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bfa6f-4c7f-4952-bbd0-e9223f85f831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:23.680446 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bfa6f-4c7f-4952-bbd0-e9223f85f831 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:23.690500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1344/2687] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:08:23.694645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b6093-bae3-4296-8869-665d639a8dc5 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:23.705766 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b6093-bae3-4296-8869-665d639a8dc5 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:23.710646 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628d75b-c192-4f3d-97ef-15199eb08057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:23.711524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628d75b-c192-4f3d-97ef-15199eb08057 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:23.711809 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628d75b-c192-4f3d-97ef-15199eb08057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:23.712089 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628d75b-c192-4f3d-97ef-15199eb08057 admin admin] PATH_INFO: `/v3/projects/de50a48cf3074b83b3d5e153964a32a0/users/c3293a2e01344a54a55fa4bde74acdf4/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:23.714097 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628d75b-c192-4f3d-97ef-15199eb08057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de50a48cf3074b83b3d5e153964a32a0, user_id=c3293a2e01344a54a55fa4bde74acdf4, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:23.716785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628d75b-c192-4f3d-97ef-15199eb08057 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:23.727451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1344/2688] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:08:23 2022] PUT /identity/v3/projects/de50a48cf3074b83b3d5e153964a32a0/users/c3293a2e01344a54a55fa4bde74acdf4/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:08:23.737613 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b55ab9-0dbe-488c-8ed0-88a7271b64c5 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:23.738131 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b55ab9-0dbe-488c-8ed0-88a7271b64c5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:23.738229 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b55ab9-0dbe-488c-8ed0-88a7271b64c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:23.763519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-41b55ab9-0dbe-488c-8ed0-88a7271b64c5 None None] MFA Rules not processed for user `c3293a2e01344a54a55fa4bde74acdf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:23.764717 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-41b55ab9-0dbe-488c-8ed0-88a7271b64c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:23.831624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1345/2689] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:23.842260 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628d75b-c192-4f3d-97ef-15199eb08057 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:23.844069 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-e628d75b-c192-4f3d-97ef-15199eb08057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:23.901013 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628d75b-c192-4f3d-97ef-15199eb08057 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:23.904714 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e5847-0b69-4f18-bda6-25358dd7b905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:23.905353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e5847-0b69-4f18-bda6-25358dd7b905 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:23.905634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e5847-0b69-4f18-bda6-25358dd7b905 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:23.905907 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e5847-0b69-4f18-bda6-25358dd7b905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:23.915553 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e5847-0b69-4f18-bda6-25358dd7b905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:23.916966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e5847-0b69-4f18-bda6-25358dd7b905 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:23.926142 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1345/2690] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:08:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:08:24.021289 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b55ab9-0dbe-488c-8ed0-88a7271b64c5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:24.030780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b55ab9-0dbe-488c-8ed0-88a7271b64c5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:24.034930 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bf994-a910-4b90-bbd4-c9318d81a57a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:24.035555 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bf994-a910-4b90-bbd4-c9318d81a57a service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:24.035840 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bf994-a910-4b90-bbd4-c9318d81a57a service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:24.036117 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bf994-a910-4b90-bbd4-c9318d81a57a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:24.091248 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bf994-a910-4b90-bbd4-c9318d81a57a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:24.092682 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bf994-a910-4b90-bbd4-c9318d81a57a service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:24.101392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1346/2691] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:08:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:08:26.651587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e5847-0b69-4f18-bda6-25358dd7b905 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:26.668843 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:26.713706 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e5847-0b69-4f18-bda6-25358dd7b905 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:26.718167 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1417dfa-8b71-4db8-8e41-76dbb6cd1614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:26.719018 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1417dfa-8b71-4db8-8e41-76dbb6cd1614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:26.720049 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1417dfa-8b71-4db8-8e41-76dbb6cd1614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:26.720322 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1417dfa-8b71-4db8-8e41-76dbb6cd1614 admin admin] PATH_INFO: `/v3/users/d59c0115781c48b8a9e3fc48f0bc1572` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:26.721492 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1417dfa-8b71-4db8-8e41-76dbb6cd1614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d59c0115781c48b8a9e3fc48f0bc1572)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:26.723410 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1417dfa-8b71-4db8-8e41-76dbb6cd1614 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:26.766850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b1417dfa-8b71-4db8-8e41-76dbb6cd1614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd59c0115781c48b8a9e3fc48f0bc1572'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:26.773693 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b1417dfa-8b71-4db8-8e41-76dbb6cd1614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd59c0115781c48b8a9e3fc48f0bc1572'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:26.774354 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b1417dfa-8b71-4db8-8e41-76dbb6cd1614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd59c0115781c48b8a9e3fc48f0bc1572'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:26.781353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b1417dfa-8b71-4db8-8e41-76dbb6cd1614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd59c0115781c48b8a9e3fc48f0bc1572'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:26.782534 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b1417dfa-8b71-4db8-8e41-76dbb6cd1614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd59c0115781c48b8a9e3fc48f0bc1572'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:26.799673 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1346/2692] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:08:26 2022] DELETE /identity/v3/users/d59c0115781c48b8a9e3fc48f0bc1572 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:26.804178 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6ad07-c869-478f-b460-d6876fd70e1a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:26.804676 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6ad07-c869-478f-b460-d6876fd70e1a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:26.804787 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6ad07-c869-478f-b460-d6876fd70e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:26.821618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-35b6ad07-c869-478f-b460-d6876fd70e1a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:26.822860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-35b6ad07-c869-478f-b460-d6876fd70e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:26.839842 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:26.882892 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1347/2693] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:26.892944 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1417dfa-8b71-4db8-8e41-76dbb6cd1614 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:26.894375 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b1417dfa-8b71-4db8-8e41-76dbb6cd1614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:26.951159 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1417dfa-8b71-4db8-8e41-76dbb6cd1614 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:26.955357 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43d067-3966-4a29-baea-de8a4ed842b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:26.955990 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43d067-3966-4a29-baea-de8a4ed842b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:26.956274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43d067-3966-4a29-baea-de8a4ed842b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:26.956552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43d067-3966-4a29-baea-de8a4ed842b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:26.965596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43d067-3966-4a29-baea-de8a4ed842b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:26.967047 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43d067-3966-4a29-baea-de8a4ed842b1 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:26.977060 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1347/2694] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:08:27.243891 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6ad07-c869-478f-b460-d6876fd70e1a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:27.245451 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-35b6ad07-c869-478f-b460-d6876fd70e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:27.259088 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6ad07-c869-478f-b460-d6876fd70e1a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:27.263419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:27.264278 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:27.264562 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:27.264839 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b admin admin] PATH_INFO: `/v3/projects/81851a0f5b734282bfd295d784aba0dc` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:27.266078 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=81851a0f5b734282bfd295d784aba0dc)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:27.268589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:27.314577 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81851a0f5b734282bfd295d784aba0dc', 'request_id': 'req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:27.320585 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81851a0f5b734282bfd295d784aba0dc', 'request_id': 'req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:27.326308 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81851a0f5b734282bfd295d784aba0dc', 'request_id': 'req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:27.339125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b admin admin] The token cache is being invalidate because project 81851a0f5b734282bfd295d784aba0dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:08:27.339414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:27.340032 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:27.341550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1348/2695] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:08:27 2022] DELETE /identity/v3/projects/81851a0f5b734282bfd295d784aba0dc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:27.345587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43d067-3966-4a29-baea-de8a4ed842b1 service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:27.355624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43d067-3966-4a29-baea-de8a4ed842b1 service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:27.388981 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:27.413021 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22271496-d356-40b7-b3a2-b3a4530d8a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:27.413957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22271496-d356-40b7-b3a2-b3a4530d8a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:27.414194 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22271496-d356-40b7-b3a2-b3a4530d8a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:27.414464 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22271496-d356-40b7-b3a2-b3a4530d8a6c admin admin] PATH_INFO: `/v3/users/c3293a2e01344a54a55fa4bde74acdf4` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:27.415634 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22271496-d356-40b7-b3a2-b3a4530d8a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3293a2e01344a54a55fa4bde74acdf4)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:27.417533 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22271496-d356-40b7-b3a2-b3a4530d8a6c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:27.464329 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-22271496-d356-40b7-b3a2-b3a4530d8a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3293a2e01344a54a55fa4bde74acdf4'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:27.471101 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-22271496-d356-40b7-b3a2-b3a4530d8a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3293a2e01344a54a55fa4bde74acdf4'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:27.471758 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-22271496-d356-40b7-b3a2-b3a4530d8a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3293a2e01344a54a55fa4bde74acdf4'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:27.478911 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-22271496-d356-40b7-b3a2-b3a4530d8a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3293a2e01344a54a55fa4bde74acdf4'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:27.479526 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-22271496-d356-40b7-b3a2-b3a4530d8a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3293a2e01344a54a55fa4bde74acdf4'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:27.497403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1348/2696] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:08:27 2022] DELETE /identity/v3/users/c3293a2e01344a54a55fa4bde74acdf4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:27.762247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:27.763706 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:27.777168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8f17e-d9cf-4e50-903f-b4e139945a2b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:27.834392 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe394f8-d680-4247-8465-3f83b59c2e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:27.835365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe394f8-d680-4247-8465-3f83b59c2e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:27.835646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe394f8-d680-4247-8465-3f83b59c2e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:27.835915 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe394f8-d680-4247-8465-3f83b59c2e9d admin admin] PATH_INFO: `/v3/projects/de50a48cf3074b83b3d5e153964a32a0` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:27.837073 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe394f8-d680-4247-8465-3f83b59c2e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=de50a48cf3074b83b3d5e153964a32a0)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:27.839010 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe394f8-d680-4247-8465-3f83b59c2e9d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:27.883671 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:27.884868 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8fe394f8-d680-4247-8465-3f83b59c2e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de50a48cf3074b83b3d5e153964a32a0', 'request_id': 'req-8fe394f8-d680-4247-8465-3f83b59c2e9d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:27.892571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8fe394f8-d680-4247-8465-3f83b59c2e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de50a48cf3074b83b3d5e153964a32a0', 'request_id': 'req-8fe394f8-d680-4247-8465-3f83b59c2e9d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:27.898460 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8fe394f8-d680-4247-8465-3f83b59c2e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de50a48cf3074b83b3d5e153964a32a0', 'request_id': 'req-8fe394f8-d680-4247-8465-3f83b59c2e9d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:27.910481 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8fe394f8-d680-4247-8465-3f83b59c2e9d admin admin] The token cache is being invalidate because project de50a48cf3074b83b3d5e153964a32a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:08:27.910771 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8fe394f8-d680-4247-8465-3f83b59c2e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:27.911419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8fe394f8-d680-4247-8465-3f83b59c2e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:27.912934 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1349/2697] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:08:27 2022] DELETE /identity/v3/projects/de50a48cf3074b83b3d5e153964a32a0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:27.917860 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966864b-51a5-408d-9729-f52ab5ee5e56 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:27.918329 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966864b-51a5-408d-9729-f52ab5ee5e56 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:27.918455 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966864b-51a5-408d-9729-f52ab5ee5e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:27.937219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6966864b-51a5-408d-9729-f52ab5ee5e56 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:27.938546 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6966864b-51a5-408d-9729-f52ab5ee5e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:27.996647 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1349/2698] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:28.004383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe32a5-1088-4e6e-a84d-b7ee118be23c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:28.004677 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe32a5-1088-4e6e-a84d-b7ee118be23c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:28.004958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe32a5-1088-4e6e-a84d-b7ee118be23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:28.022633 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-fcfe32a5-1088-4e6e-a84d-b7ee118be23c None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:28.023813 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fcfe32a5-1088-4e6e-a84d-b7ee118be23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:28.031648 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1350/2699] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:28.036151 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966864b-51a5-408d-9729-f52ab5ee5e56 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:28.045729 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966864b-51a5-408d-9729-f52ab5ee5e56 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:28.050978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fbccf-c49b-434a-a154-971932b7fa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:28.051619 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fbccf-c49b-434a-a154-971932b7fa41 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:28.051908 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fbccf-c49b-434a-a154-971932b7fa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:28.052187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fbccf-c49b-434a-a154-971932b7fa41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:28.052909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fbccf-c49b-434a-a154-971932b7fa41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:08:28.053223 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fbccf-c49b-434a-a154-971932b7fa41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:28.054857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fbccf-c49b-434a-a154-971932b7fa41 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:28.066233 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1350/2700] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:08:28.070224 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe32a5-1088-4e6e-a84d-b7ee118be23c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:28.079370 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe32a5-1088-4e6e-a84d-b7ee118be23c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:28.084005 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a6686-692a-4c3b-b50e-8a7ac8e871df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:28.084646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a6686-692a-4c3b-b50e-8a7ac8e871df admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:28.084928 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a6686-692a-4c3b-b50e-8a7ac8e871df admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:28.085205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a6686-692a-4c3b-b50e-8a7ac8e871df admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:28.085902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a6686-692a-4c3b-b50e-8a7ac8e871df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:28.087807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a6686-692a-4c3b-b50e-8a7ac8e871df admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:28.114833 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1351/2701] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:08:28 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:08:28.118853 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fbccf-c49b-434a-a154-971932b7fa41 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:28.128832 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fbccf-c49b-434a-a154-971932b7fa41 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:28.168957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:28.185496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29eac8-a028-4bff-ad4a-e313364733e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:28.186179 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29eac8-a028-4bff-ad4a-e313364733e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:28.186462 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29eac8-a028-4bff-ad4a-e313364733e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:28.186736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29eac8-a028-4bff-ad4a-e313364733e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:28.187428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29eac8-a028-4bff-ad4a-e313364733e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:28.189416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29eac8-a028-4bff-ad4a-e313364733e3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:28.208862 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1351/2702] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:08:28 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:08:28.212907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a6686-692a-4c3b-b50e-8a7ac8e871df admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:28.224212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a6686-692a-4c3b-b50e-8a7ac8e871df admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:28.228909 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695c4aa-3d6a-4a51-81e8-d4646436cf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:28.229561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c4aa-3d6a-4a51-81e8-d4646436cf06 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:28.229844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c4aa-3d6a-4a51-81e8-d4646436cf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:28.230155 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c4aa-3d6a-4a51-81e8-d4646436cf06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:28.230876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695c4aa-3d6a-4a51-81e8-d4646436cf06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:28.232462 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695c4aa-3d6a-4a51-81e8-d4646436cf06 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:28.243048 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1352/2703] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:08:28.247022 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29eac8-a028-4bff-ad4a-e313364733e3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:28.256646 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29eac8-a028-4bff-ad4a-e313364733e3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:28.261176 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d85cc-a953-474b-a31c-acf5d3151fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:28.261809 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d85cc-a953-474b-a31c-acf5d3151fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:28.262121 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d85cc-a953-474b-a31c-acf5d3151fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:28.262394 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d85cc-a953-474b-a31c-acf5d3151fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:28.263109 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d85cc-a953-474b-a31c-acf5d3151fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:28.264678 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d85cc-a953-474b-a31c-acf5d3151fa0 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:28.274741 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1352/2704] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:08:28.278535 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695c4aa-3d6a-4a51-81e8-d4646436cf06 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:28.288750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695c4aa-3d6a-4a51-81e8-d4646436cf06 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:28.293271 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bda28-fc71-499e-8e14-ac9358752ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:28.294167 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bda28-fc71-499e-8e14-ac9358752ede admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:28.294453 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bda28-fc71-499e-8e14-ac9358752ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:28.294722 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bda28-fc71-499e-8e14-ac9358752ede admin admin] PATH_INFO: `/v3/projects/d6b9f38a804a4fe9bfae42719639d2cf/users/16e899e294da48c5a13b39d222fa443c/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:28.308880 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bda28-fc71-499e-8e14-ac9358752ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b9f38a804a4fe9bfae42719639d2cf, user_id=16e899e294da48c5a13b39d222fa443c, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:28.311555 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bda28-fc71-499e-8e14-ac9358752ede admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:28.325434 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1353/2705] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:08:28 2022] PUT /identity/v3/projects/d6b9f38a804a4fe9bfae42719639d2cf/users/16e899e294da48c5a13b39d222fa443c/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:28.337281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4498437-1ff2-4dc3-8622-7aa6caddf218 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:28.337573 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4498437-1ff2-4dc3-8622-7aa6caddf218 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:28.337846 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4498437-1ff2-4dc3-8622-7aa6caddf218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:28.365381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d4498437-1ff2-4dc3-8622-7aa6caddf218 None None] MFA Rules not processed for user `16e899e294da48c5a13b39d222fa443c`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:28.367139 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d4498437-1ff2-4dc3-8622-7aa6caddf218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:28.431692 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1353/2706] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:28.436318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bda28-fc71-499e-8e14-ac9358752ede admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:28.496549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bda28-fc71-499e-8e14-ac9358752ede admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:28.501050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4c74e-fdc9-4985-acbb-0ed3defd43d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:28.501725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4c74e-fdc9-4985-acbb-0ed3defd43d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:28.502035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4c74e-fdc9-4985-acbb-0ed3defd43d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:28.502310 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4c74e-fdc9-4985-acbb-0ed3defd43d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:28.502993 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4c74e-fdc9-4985-acbb-0ed3defd43d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:28.504886 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4c74e-fdc9-4985-acbb-0ed3defd43d0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:28.529856 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1354/2707] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:08:28 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:08:28.534482 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4498437-1ff2-4dc3-8622-7aa6caddf218 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:28.544913 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4498437-1ff2-4dc3-8622-7aa6caddf218 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:28.599552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4a55f-bd2e-44f3-9f40-d10da45bcce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:28.600203 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4a55f-bd2e-44f3-9f40-d10da45bcce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:28.600512 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4a55f-bd2e-44f3-9f40-d10da45bcce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:28.600788 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4a55f-bd2e-44f3-9f40-d10da45bcce1 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:28.601477 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4a55f-bd2e-44f3-9f40-d10da45bcce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:28.603408 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4a55f-bd2e-44f3-9f40-d10da45bcce1 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:28.623930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1354/2708] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:08:28 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:08:28.628365 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4c74e-fdc9-4985-acbb-0ed3defd43d0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:28.638452 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4c74e-fdc9-4985-acbb-0ed3defd43d0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:28.643660 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e6594-c010-42c1-bf07-86f703e1a60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:28.644312 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e6594-c010-42c1-bf07-86f703e1a60b admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:28.644620 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e6594-c010-42c1-bf07-86f703e1a60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:28.644881 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e6594-c010-42c1-bf07-86f703e1a60b admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:28.645599 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e6594-c010-42c1-bf07-86f703e1a60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:28.647223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e6594-c010-42c1-bf07-86f703e1a60b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:28.657593 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1355/2709] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:08:28.661424 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4a55f-bd2e-44f3-9f40-d10da45bcce1 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:28.671109 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4a55f-bd2e-44f3-9f40-d10da45bcce1 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:28.675716 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209fb89-a64b-49b6-9bcd-937bf8411b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:28.676582 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209fb89-a64b-49b6-9bcd-937bf8411b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:28.676866 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209fb89-a64b-49b6-9bcd-937bf8411b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:28.677144 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209fb89-a64b-49b6-9bcd-937bf8411b72 admin admin] PATH_INFO: `/v3/projects/f8ec1e61c8bc4fac9e511cc2dd20ff1a/users/856905cb45d547ebab883a06d926d808/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:28.691840 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209fb89-a64b-49b6-9bcd-937bf8411b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ec1e61c8bc4fac9e511cc2dd20ff1a, user_id=856905cb45d547ebab883a06d926d808, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:28.694510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209fb89-a64b-49b6-9bcd-937bf8411b72 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:28.707228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1355/2710] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:08:28 2022] PUT /identity/v3/projects/f8ec1e61c8bc4fac9e511cc2dd20ff1a/users/856905cb45d547ebab883a06d926d808/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:08:28.711037 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e6594-c010-42c1-bf07-86f703e1a60b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:28.720906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e6594-c010-42c1-bf07-86f703e1a60b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:28.763990 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:28.778552 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b2f39-ff16-47b5-8804-7b87911aec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:28.779210 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b2f39-ff16-47b5-8804-7b87911aec29 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:28.779500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b2f39-ff16-47b5-8804-7b87911aec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:28.779777 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b2f39-ff16-47b5-8804-7b87911aec29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:28.780496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b2f39-ff16-47b5-8804-7b87911aec29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:28.782133 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b2f39-ff16-47b5-8804-7b87911aec29 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:28.791858 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1356/2711] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:08:28.795915 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209fb89-a64b-49b6-9bcd-937bf8411b72 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:28.805993 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209fb89-a64b-49b6-9bcd-937bf8411b72 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:28.810474 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f6e17-13f9-414e-812d-e0b4c3a72c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:28.811342 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f6e17-13f9-414e-812d-e0b4c3a72c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:28.811621 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f6e17-13f9-414e-812d-e0b4c3a72c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:28.811892 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f6e17-13f9-414e-812d-e0b4c3a72c99 admin admin] PATH_INFO: `/v3/projects/f8ec1e61c8bc4fac9e511cc2dd20ff1a/users/856905cb45d547ebab883a06d926d808/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:28.813850 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f6e17-13f9-414e-812d-e0b4c3a72c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ec1e61c8bc4fac9e511cc2dd20ff1a, user_id=856905cb45d547ebab883a06d926d808, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:28.817016 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f6e17-13f9-414e-812d-e0b4c3a72c99 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:28.827411 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1356/2712] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:08:28 2022] PUT /identity/v3/projects/f8ec1e61c8bc4fac9e511cc2dd20ff1a/users/856905cb45d547ebab883a06d926d808/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:28.838252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c62d5-5b91-47f8-ad34-a6ecbe1b5c95 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:28.838758 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c62d5-5b91-47f8-ad34-a6ecbe1b5c95 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:28.838867 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c62d5-5b91-47f8-ad34-a6ecbe1b5c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:28.864551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-876c62d5-5b91-47f8-ad34-a6ecbe1b5c95 None None] MFA Rules not processed for user `856905cb45d547ebab883a06d926d808`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:28.865747 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-876c62d5-5b91-47f8-ad34-a6ecbe1b5c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:28.931269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1357/2713] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:28.942510 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f6e17-13f9-414e-812d-e0b4c3a72c99 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:28.944295 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c62f6e17-13f9-414e-812d-e0b4c3a72c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:28.950815 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:29.002246 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f6e17-13f9-414e-812d-e0b4c3a72c99 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:29.005857 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9be858-9c85-46b1-9a72-69054d17de35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:29.006519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9be858-9c85-46b1-9a72-69054d17de35 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:29.006791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9be858-9c85-46b1-9a72-69054d17de35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:29.007070 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9be858-9c85-46b1-9a72-69054d17de35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:29.063580 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9be858-9c85-46b1-9a72-69054d17de35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:29.065581 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9be858-9c85-46b1-9a72-69054d17de35 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:29.074550 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1357/2714] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:08:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:08:33.225260 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c62d5-5b91-47f8-ad34-a6ecbe1b5c95 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:33.226705 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-876c62d5-5b91-47f8-ad34-a6ecbe1b5c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:33.241046 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c62d5-5b91-47f8-ad34-a6ecbe1b5c95 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:33.245361 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4725a-714d-41a7-bd5b-8bdd67ca0b16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:33.246414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4725a-714d-41a7-bd5b-8bdd67ca0b16 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:33.246702 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4725a-714d-41a7-bd5b-8bdd67ca0b16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:33.246985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4725a-714d-41a7-bd5b-8bdd67ca0b16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:33.258719 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4725a-714d-41a7-bd5b-8bdd67ca0b16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:33.260162 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4725a-714d-41a7-bd5b-8bdd67ca0b16 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:33.270451 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1358/2715] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:08:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:08:38.102565 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9be858-9c85-46b1-9a72-69054d17de35 service cinder] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:38.163352 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9be858-9c85-46b1-9a72-69054d17de35 service cinder] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:38.167774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb01528-8f76-4054-b442-0ebe80957091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:38.168628 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb01528-8f76-4054-b442-0ebe80957091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:38.168905 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb01528-8f76-4054-b442-0ebe80957091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:38.169175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb01528-8f76-4054-b442-0ebe80957091 admin admin] PATH_INFO: `/v3/users/16e899e294da48c5a13b39d222fa443c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:38.170382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb01528-8f76-4054-b442-0ebe80957091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e899e294da48c5a13b39d222fa443c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:38.172280 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb01528-8f76-4054-b442-0ebe80957091 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:38.219059 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-adb01528-8f76-4054-b442-0ebe80957091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e899e294da48c5a13b39d222fa443c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:38.226472 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-adb01528-8f76-4054-b442-0ebe80957091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e899e294da48c5a13b39d222fa443c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:38.227208 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-adb01528-8f76-4054-b442-0ebe80957091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e899e294da48c5a13b39d222fa443c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:38.230776 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:38.234695 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-adb01528-8f76-4054-b442-0ebe80957091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e899e294da48c5a13b39d222fa443c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:38.235416 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-adb01528-8f76-4054-b442-0ebe80957091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e899e294da48c5a13b39d222fa443c'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:38.254516 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1358/2716] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:08:38 2022] DELETE /identity/v3/users/16e899e294da48c5a13b39d222fa443c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:38.258983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882e153-b56f-4b16-be4a-082711a2061c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:38.259461 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882e153-b56f-4b16-be4a-082711a2061c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:38.259570 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882e153-b56f-4b16-be4a-082711a2061c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:38.277138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b882e153-b56f-4b16-be4a-082711a2061c None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:38.278352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b882e153-b56f-4b16-be4a-082711a2061c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:38.335630 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1359/2717] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:38.345335 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb01528-8f76-4054-b442-0ebe80957091 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:38.346791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-adb01528-8f76-4054-b442-0ebe80957091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:38.404300 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb01528-8f76-4054-b442-0ebe80957091 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:38.407963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9d2b9-4132-4ad6-bafb-84c08c670f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:38.408607 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9d2b9-4132-4ad6-bafb-84c08c670f0e service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:38.408889 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9d2b9-4132-4ad6-bafb-84c08c670f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:38.409163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9d2b9-4132-4ad6-bafb-84c08c670f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:38.418266 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9d2b9-4132-4ad6-bafb-84c08c670f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:38.419774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9d2b9-4132-4ad6-bafb-84c08c670f0e service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:38.430663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1359/2718] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:08:38.700572 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882e153-b56f-4b16-be4a-082711a2061c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:38.702023 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b882e153-b56f-4b16-be4a-082711a2061c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:38.713877 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882e153-b56f-4b16-be4a-082711a2061c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:38.718482 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cdfcf-e609-4152-86aa-1aed7b0f05d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:38.719374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cdfcf-e609-4152-86aa-1aed7b0f05d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:38.719657 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cdfcf-e609-4152-86aa-1aed7b0f05d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:38.719934 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cdfcf-e609-4152-86aa-1aed7b0f05d0 admin admin] PATH_INFO: `/v3/projects/d6b9f38a804a4fe9bfae42719639d2cf` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:38.721128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cdfcf-e609-4152-86aa-1aed7b0f05d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b9f38a804a4fe9bfae42719639d2cf)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:38.723136 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cdfcf-e609-4152-86aa-1aed7b0f05d0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:38.769669 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-568cdfcf-e609-4152-86aa-1aed7b0f05d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b9f38a804a4fe9bfae42719639d2cf', 'request_id': 'req-568cdfcf-e609-4152-86aa-1aed7b0f05d0'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:38.770799 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:38.777701 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-568cdfcf-e609-4152-86aa-1aed7b0f05d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b9f38a804a4fe9bfae42719639d2cf', 'request_id': 'req-568cdfcf-e609-4152-86aa-1aed7b0f05d0'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:38.784045 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-568cdfcf-e609-4152-86aa-1aed7b0f05d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b9f38a804a4fe9bfae42719639d2cf', 'request_id': 'req-568cdfcf-e609-4152-86aa-1aed7b0f05d0'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:38.795946 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-568cdfcf-e609-4152-86aa-1aed7b0f05d0 admin admin] The token cache is being invalidate because project d6b9f38a804a4fe9bfae42719639d2cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:08:38.796230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-568cdfcf-e609-4152-86aa-1aed7b0f05d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:38.796844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-568cdfcf-e609-4152-86aa-1aed7b0f05d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:38.798408 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1360/2719] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:08:38 2022] DELETE /identity/v3/projects/d6b9f38a804a4fe9bfae42719639d2cf => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:38.802817 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9d2b9-4132-4ad6-bafb-84c08c670f0e service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:38.812217 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9d2b9-4132-4ad6-bafb-84c08c670f0e service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:38.867122 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d40c21-a7a4-4e04-bbd5-d968f3773985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:38.867973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d40c21-a7a4-4e04-bbd5-d968f3773985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:38.868251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d40c21-a7a4-4e04-bbd5-d968f3773985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:38.868522 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d40c21-a7a4-4e04-bbd5-d968f3773985 admin admin] PATH_INFO: `/v3/users/856905cb45d547ebab883a06d926d808` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:38.869681 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d40c21-a7a4-4e04-bbd5-d968f3773985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=856905cb45d547ebab883a06d926d808)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:38.871630 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d40c21-a7a4-4e04-bbd5-d968f3773985 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:38.916113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-43d40c21-a7a4-4e04-bbd5-d968f3773985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '856905cb45d547ebab883a06d926d808'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:38.922874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-43d40c21-a7a4-4e04-bbd5-d968f3773985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '856905cb45d547ebab883a06d926d808'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:38.923538 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-43d40c21-a7a4-4e04-bbd5-d968f3773985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '856905cb45d547ebab883a06d926d808'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:38.931204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-43d40c21-a7a4-4e04-bbd5-d968f3773985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '856905cb45d547ebab883a06d926d808'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:38.931829 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-43d40c21-a7a4-4e04-bbd5-d968f3773985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '856905cb45d547ebab883a06d926d808'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:38.945811 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:38.950642 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1360/2720] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:08:38 2022] DELETE /identity/v3/users/856905cb45d547ebab883a06d926d808 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:39.215416 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cdfcf-e609-4152-86aa-1aed7b0f05d0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:39.216899 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-568cdfcf-e609-4152-86aa-1aed7b0f05d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:39.231104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cdfcf-e609-4152-86aa-1aed7b0f05d0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:39.288489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dd495-5db6-403f-8834-c19b5c275147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:39.289342 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dd495-5db6-403f-8834-c19b5c275147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:39.289619 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dd495-5db6-403f-8834-c19b5c275147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:39.289888 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dd495-5db6-403f-8834-c19b5c275147 admin admin] PATH_INFO: `/v3/projects/f8ec1e61c8bc4fac9e511cc2dd20ff1a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:39.291065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7dd495-5db6-403f-8834-c19b5c275147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ec1e61c8bc4fac9e511cc2dd20ff1a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:39.292950 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7dd495-5db6-403f-8834-c19b5c275147 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:39.337630 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7b7dd495-5db6-403f-8834-c19b5c275147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ec1e61c8bc4fac9e511cc2dd20ff1a', 'request_id': 'req-7b7dd495-5db6-403f-8834-c19b5c275147'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:39.343550 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7b7dd495-5db6-403f-8834-c19b5c275147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ec1e61c8bc4fac9e511cc2dd20ff1a', 'request_id': 'req-7b7dd495-5db6-403f-8834-c19b5c275147'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:39.349523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7b7dd495-5db6-403f-8834-c19b5c275147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ec1e61c8bc4fac9e511cc2dd20ff1a', 'request_id': 'req-7b7dd495-5db6-403f-8834-c19b5c275147'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:39.362735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7b7dd495-5db6-403f-8834-c19b5c275147 admin admin] The token cache is being invalidate because project f8ec1e61c8bc4fac9e511cc2dd20ff1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:08:39.363023 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7b7dd495-5db6-403f-8834-c19b5c275147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:39.363646 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7b7dd495-5db6-403f-8834-c19b5c275147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:39.365232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1361/2721] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:08:39 2022] DELETE /identity/v3/projects/f8ec1e61c8bc4fac9e511cc2dd20ff1a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:39.371216 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2eabbd-860b-4ba1-81f5-cbed6925001a None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:39.371700 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2eabbd-860b-4ba1-81f5-cbed6925001a None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:39.371802 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2eabbd-860b-4ba1-81f5-cbed6925001a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:39.390558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4d2eabbd-860b-4ba1-81f5-cbed6925001a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:39.391737 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4d2eabbd-860b-4ba1-81f5-cbed6925001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:39.450488 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1361/2722] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:39.459993 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c5ba4-1c7c-4f60-930a-355cbd28dc60 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:39.460173 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c5ba4-1c7c-4f60-930a-355cbd28dc60 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:39.460456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c5ba4-1c7c-4f60-930a-355cbd28dc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:39.478419 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-fc4c5ba4-1c7c-4f60-930a-355cbd28dc60 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:39.479607 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fc4c5ba4-1c7c-4f60-930a-355cbd28dc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:39.488191 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1362/2723] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:39.492381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2eabbd-860b-4ba1-81f5-cbed6925001a None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:39.501903 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2eabbd-860b-4ba1-81f5-cbed6925001a None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:39.507350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52081c28-9aa0-4522-bd87-244c13ae3d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:39.508030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52081c28-9aa0-4522-bd87-244c13ae3d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:39.508314 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52081c28-9aa0-4522-bd87-244c13ae3d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:39.508593 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52081c28-9aa0-4522-bd87-244c13ae3d40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:39.509318 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52081c28-9aa0-4522-bd87-244c13ae3d40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:08:39.509623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52081c28-9aa0-4522-bd87-244c13ae3d40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:39.511330 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52081c28-9aa0-4522-bd87-244c13ae3d40 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:39.523029 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1362/2724] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:08:39.527165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c5ba4-1c7c-4f60-930a-355cbd28dc60 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:39.536227 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c5ba4-1c7c-4f60-930a-355cbd28dc60 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:39.540775 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5756e2-b1aa-4f2c-ba4c-5983a060bf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:39.541405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5756e2-b1aa-4f2c-ba4c-5983a060bf1e admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:39.541688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5756e2-b1aa-4f2c-ba4c-5983a060bf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:39.541991 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5756e2-b1aa-4f2c-ba4c-5983a060bf1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:39.542681 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5756e2-b1aa-4f2c-ba4c-5983a060bf1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:39.544561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5756e2-b1aa-4f2c-ba4c-5983a060bf1e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:39.570725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1363/2725] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:08:39 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:08:39.574591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52081c28-9aa0-4522-bd87-244c13ae3d40 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:39.584353 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52081c28-9aa0-4522-bd87-244c13ae3d40 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:39.639394 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f671e-7943-4214-a2aa-2a79d757b042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:39.640389 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f671e-7943-4214-a2aa-2a79d757b042 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:39.640686 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f671e-7943-4214-a2aa-2a79d757b042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:39.640959 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f671e-7943-4214-a2aa-2a79d757b042 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:39.641655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f671e-7943-4214-a2aa-2a79d757b042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:39.643638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f671e-7943-4214-a2aa-2a79d757b042 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:39.662952 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1363/2726] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:08:39 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:08:39.666902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5756e2-b1aa-4f2c-ba4c-5983a060bf1e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:39.677536 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5756e2-b1aa-4f2c-ba4c-5983a060bf1e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:39.682169 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab9c04-0275-48e4-b3c1-3bf2b7fbe109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:39.682817 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab9c04-0275-48e4-b3c1-3bf2b7fbe109 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:39.683101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab9c04-0275-48e4-b3c1-3bf2b7fbe109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:39.683378 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab9c04-0275-48e4-b3c1-3bf2b7fbe109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:39.684099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab9c04-0275-48e4-b3c1-3bf2b7fbe109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:39.685687 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab9c04-0275-48e4-b3c1-3bf2b7fbe109 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:39.696532 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1364/2727] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:08:39.700932 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f671e-7943-4214-a2aa-2a79d757b042 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:39.710795 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f671e-7943-4214-a2aa-2a79d757b042 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:39.715298 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc33b67-9164-4396-ab7a-b9b7d6f78402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:39.715935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc33b67-9164-4396-ab7a-b9b7d6f78402 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:39.716217 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc33b67-9164-4396-ab7a-b9b7d6f78402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:39.716519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc33b67-9164-4396-ab7a-b9b7d6f78402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:39.717202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc33b67-9164-4396-ab7a-b9b7d6f78402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:39.718813 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc33b67-9164-4396-ab7a-b9b7d6f78402 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:39.728406 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1364/2728] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:08:39.732397 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab9c04-0275-48e4-b3c1-3bf2b7fbe109 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:39.743738 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab9c04-0275-48e4-b3c1-3bf2b7fbe109 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:39.754093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9282a1-87ce-4ae4-8404-56fa997aaf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:39.754973 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9282a1-87ce-4ae4-8404-56fa997aaf53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:39.755255 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9282a1-87ce-4ae4-8404-56fa997aaf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:39.755530 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9282a1-87ce-4ae4-8404-56fa997aaf53 admin admin] PATH_INFO: `/v3/projects/21493ae3f0914a588cf0b49893a04bcb/users/07fbb3f314664637bc9d8344860347f9/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:39.770112 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9282a1-87ce-4ae4-8404-56fa997aaf53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21493ae3f0914a588cf0b49893a04bcb, user_id=07fbb3f314664637bc9d8344860347f9, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:39.772777 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9282a1-87ce-4ae4-8404-56fa997aaf53 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:39.786400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1365/2729] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:08:39 2022] PUT /identity/v3/projects/21493ae3f0914a588cf0b49893a04bcb/users/07fbb3f314664637bc9d8344860347f9/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:39.797364 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c71809-5249-4c41-9809-9e1cf0e34928 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:39.797655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c71809-5249-4c41-9809-9e1cf0e34928 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:39.797951 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c71809-5249-4c41-9809-9e1cf0e34928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:39.824286 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-48c71809-5249-4c41-9809-9e1cf0e34928 None None] MFA Rules not processed for user `07fbb3f314664637bc9d8344860347f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:39.825468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-48c71809-5249-4c41-9809-9e1cf0e34928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:39.879246 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:39.889073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1365/2730] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:39.900208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9282a1-87ce-4ae4-8404-56fa997aaf53 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:39.901858 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-cb9282a1-87ce-4ae4-8404-56fa997aaf53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:39.908444 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:39.963457 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9282a1-87ce-4ae4-8404-56fa997aaf53 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:39.967047 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6829b20-0572-48a0-b83b-ee13dfc1418c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:39.967685 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6829b20-0572-48a0-b83b-ee13dfc1418c service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:39.967968 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6829b20-0572-48a0-b83b-ee13dfc1418c service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:39.968268 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6829b20-0572-48a0-b83b-ee13dfc1418c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:39.976995 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6829b20-0572-48a0-b83b-ee13dfc1418c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:39.978456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6829b20-0572-48a0-b83b-ee13dfc1418c service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:39.987992 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1366/2731] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:08:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:08:42.946914 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c71809-5249-4c41-9809-9e1cf0e34928 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:43.008851 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c71809-5249-4c41-9809-9e1cf0e34928 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:43.013272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e8363-96f0-46f8-8fdd-e8df6ad721ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:43.014152 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e8363-96f0-46f8-8fdd-e8df6ad721ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:43.014437 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e8363-96f0-46f8-8fdd-e8df6ad721ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:43.014713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e8363-96f0-46f8-8fdd-e8df6ad721ea admin admin] PATH_INFO: `/v3/users/07fbb3f314664637bc9d8344860347f9` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:43.015882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e8363-96f0-46f8-8fdd-e8df6ad721ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=07fbb3f314664637bc9d8344860347f9)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:43.017797 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e8363-96f0-46f8-8fdd-e8df6ad721ea admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:43.062568 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b09e8363-96f0-46f8-8fdd-e8df6ad721ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07fbb3f314664637bc9d8344860347f9'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:43.069858 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b09e8363-96f0-46f8-8fdd-e8df6ad721ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07fbb3f314664637bc9d8344860347f9'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:43.070524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b09e8363-96f0-46f8-8fdd-e8df6ad721ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07fbb3f314664637bc9d8344860347f9'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:43.077871 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b09e8363-96f0-46f8-8fdd-e8df6ad721ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07fbb3f314664637bc9d8344860347f9'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:43.078596 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b09e8363-96f0-46f8-8fdd-e8df6ad721ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07fbb3f314664637bc9d8344860347f9'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:43.096262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1366/2732] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:08:42 2022] DELETE /identity/v3/users/07fbb3f314664637bc9d8344860347f9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:43.100715 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f9895-a595-45a6-aa0c-aef656a50a1a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:43.101184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f9895-a595-45a6-aa0c-aef656a50a1a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:43.101281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f9895-a595-45a6-aa0c-aef656a50a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:43.118679 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-570f9895-a595-45a6-aa0c-aef656a50a1a None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:43.119860 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-570f9895-a595-45a6-aa0c-aef656a50a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:43.177170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1367/2733] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:08:43.187368 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e8363-96f0-46f8-8fdd-e8df6ad721ea admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:43.188931 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b09e8363-96f0-46f8-8fdd-e8df6ad721ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:43.247496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e8363-96f0-46f8-8fdd-e8df6ad721ea admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:43.251140 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f183608-20d2-4d36-aeee-1b182210bd89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:43.251777 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f183608-20d2-4d36-aeee-1b182210bd89 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:43.252063 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f183608-20d2-4d36-aeee-1b182210bd89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:43.252338 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f183608-20d2-4d36-aeee-1b182210bd89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:43.261954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f183608-20d2-4d36-aeee-1b182210bd89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:43.263417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f183608-20d2-4d36-aeee-1b182210bd89 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:43.272917 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1367/2734] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:08:43.538472 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f9895-a595-45a6-aa0c-aef656a50a1a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:43.539911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-570f9895-a595-45a6-aa0c-aef656a50a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:43.551877 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f9895-a595-45a6-aa0c-aef656a50a1a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:43.556930 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cff5e-c333-412a-bb89-28619a297519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:43.557793 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cff5e-c333-412a-bb89-28619a297519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:43.558104 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cff5e-c333-412a-bb89-28619a297519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:43.558379 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cff5e-c333-412a-bb89-28619a297519 admin admin] PATH_INFO: `/v3/projects/21493ae3f0914a588cf0b49893a04bcb` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:43.559553 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5cff5e-c333-412a-bb89-28619a297519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21493ae3f0914a588cf0b49893a04bcb)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:43.561451 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5cff5e-c333-412a-bb89-28619a297519 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:43.607566 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7a5cff5e-c333-412a-bb89-28619a297519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21493ae3f0914a588cf0b49893a04bcb', 'request_id': 'req-7a5cff5e-c333-412a-bb89-28619a297519'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:43.613806 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7a5cff5e-c333-412a-bb89-28619a297519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21493ae3f0914a588cf0b49893a04bcb', 'request_id': 'req-7a5cff5e-c333-412a-bb89-28619a297519'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:43.619792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7a5cff5e-c333-412a-bb89-28619a297519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21493ae3f0914a588cf0b49893a04bcb', 'request_id': 'req-7a5cff5e-c333-412a-bb89-28619a297519'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:43.631992 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7a5cff5e-c333-412a-bb89-28619a297519 admin admin] The token cache is being invalidate because project 21493ae3f0914a588cf0b49893a04bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:08:43.632304 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7a5cff5e-c333-412a-bb89-28619a297519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:43.632925 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7a5cff5e-c333-412a-bb89-28619a297519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:08:43.634510 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1368/2735] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:08:43 2022] DELETE /identity/v3/projects/21493ae3f0914a588cf0b49893a04bcb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:43.639737 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5397d-3381-42bf-b36f-c7d91f3ca56d None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:43.640031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5397d-3381-42bf-b36f-c7d91f3ca56d None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:43.640318 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5397d-3381-42bf-b36f-c7d91f3ca56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:43.657956 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-7ae5397d-3381-42bf-b36f-c7d91f3ca56d None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:43.659152 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-7ae5397d-3381-42bf-b36f-c7d91f3ca56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:43.671409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:43.719082 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1368/2736] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:43.727186 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce23719-a2c0-4bd9-a7b0-ff84eb146466 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:43.727479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce23719-a2c0-4bd9-a7b0-ff84eb146466 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:43.727758 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce23719-a2c0-4bd9-a7b0-ff84eb146466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:43.747024 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-6ce23719-a2c0-4bd9-a7b0-ff84eb146466 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:43.748228 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6ce23719-a2c0-4bd9-a7b0-ff84eb146466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:43.756228 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1369/2737] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:43.760347 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5397d-3381-42bf-b36f-c7d91f3ca56d None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:43.770081 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5397d-3381-42bf-b36f-c7d91f3ca56d None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:43.775413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d9e0f-f006-4449-9f0c-4173c1703cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:43.776089 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d9e0f-f006-4449-9f0c-4173c1703cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:43.776451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d9e0f-f006-4449-9f0c-4173c1703cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:43.776623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d9e0f-f006-4449-9f0c-4173c1703cc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:43.777366 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d9e0f-f006-4449-9f0c-4173c1703cc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:08:43.777631 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d9e0f-f006-4449-9f0c-4173c1703cc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:43.779267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d9e0f-f006-4449-9f0c-4173c1703cc3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:43.791332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1369/2738] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:08:43.795404 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce23719-a2c0-4bd9-a7b0-ff84eb146466 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:43.804445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce23719-a2c0-4bd9-a7b0-ff84eb146466 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:43.809003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a677a0-84ee-4375-80f6-601a34956aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:43.809661 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a677a0-84ee-4375-80f6-601a34956aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:43.810013 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a677a0-84ee-4375-80f6-601a34956aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:43.810250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a677a0-84ee-4375-80f6-601a34956aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:43.810936 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a677a0-84ee-4375-80f6-601a34956aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:43.812819 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a677a0-84ee-4375-80f6-601a34956aa0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:43.838116 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1370/2739] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:08:43 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:08:43.842140 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d9e0f-f006-4449-9f0c-4173c1703cc3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:43.852436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d9e0f-f006-4449-9f0c-4173c1703cc3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:43.906415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d024f8-cca5-4a20-9084-59d376dc7c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:43.907094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d024f8-cca5-4a20-9084-59d376dc7c05 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:43.907378 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d024f8-cca5-4a20-9084-59d376dc7c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:43.907648 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d024f8-cca5-4a20-9084-59d376dc7c05 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:43.908326 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d024f8-cca5-4a20-9084-59d376dc7c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:43.910249 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d024f8-cca5-4a20-9084-59d376dc7c05 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:43.930343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1370/2740] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:08:43 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:08:43.934485 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a677a0-84ee-4375-80f6-601a34956aa0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:43.940069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:43.947842 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a677a0-84ee-4375-80f6-601a34956aa0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:43.952724 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742d658-1df4-43f5-9601-d69f4b6ef360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:43.953373 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742d658-1df4-43f5-9601-d69f4b6ef360 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:43.953652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742d658-1df4-43f5-9601-d69f4b6ef360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:43.953967 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742d658-1df4-43f5-9601-d69f4b6ef360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:43.954670 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742d658-1df4-43f5-9601-d69f4b6ef360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:43.956249 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742d658-1df4-43f5-9601-d69f4b6ef360 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:43.966571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1371/2741] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:08:43.970403 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d024f8-cca5-4a20-9084-59d376dc7c05 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:43.980138 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d024f8-cca5-4a20-9084-59d376dc7c05 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:43.984641 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b889d-0407-4537-9c95-4ba1a5871aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:43.985280 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b889d-0407-4537-9c95-4ba1a5871aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:43.985558 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b889d-0407-4537-9c95-4ba1a5871aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:43.985828 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b889d-0407-4537-9c95-4ba1a5871aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:43.986837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b889d-0407-4537-9c95-4ba1a5871aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:43.988451 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b889d-0407-4537-9c95-4ba1a5871aa8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:43.998615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1371/2742] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:08:44.002375 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742d658-1df4-43f5-9601-d69f4b6ef360 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:44.012665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742d658-1df4-43f5-9601-d69f4b6ef360 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:44.017230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f03a07-2868-4db6-91ac-a00c6a5c6e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:44.018128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f03a07-2868-4db6-91ac-a00c6a5c6e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:44.018407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f03a07-2868-4db6-91ac-a00c6a5c6e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:44.018681 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f03a07-2868-4db6-91ac-a00c6a5c6e86 admin admin] PATH_INFO: `/v3/projects/1fee1eb9272a4f889a492ddaa75eef8d/users/79d815de97584f0f91b00c0d62c34ef3/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:44.033595 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f03a07-2868-4db6-91ac-a00c6a5c6e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fee1eb9272a4f889a492ddaa75eef8d, user_id=79d815de97584f0f91b00c0d62c34ef3, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:44.036252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f03a07-2868-4db6-91ac-a00c6a5c6e86 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:44.048727 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1372/2743] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:08:44 2022] PUT /identity/v3/projects/1fee1eb9272a4f889a492ddaa75eef8d/users/79d815de97584f0f91b00c0d62c34ef3/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:08:44.053569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114189e-1bed-4751-8fd1-794f6a10982b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:44.054393 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114189e-1bed-4751-8fd1-794f6a10982b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:44.054671 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114189e-1bed-4751-8fd1-794f6a10982b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:44.072895 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-9114189e-1bed-4751-8fd1-794f6a10982b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:44.074115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9114189e-1bed-4751-8fd1-794f6a10982b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:44.131868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1372/2744] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:08:44.142300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f03a07-2868-4db6-91ac-a00c6a5c6e86 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:44.144089 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-88f03a07-2868-4db6-91ac-a00c6a5c6e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:44.198926 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f03a07-2868-4db6-91ac-a00c6a5c6e86 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:44.202668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c04950-e651-4fd7-951f-342097617932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:44.203346 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c04950-e651-4fd7-951f-342097617932 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:44.203572 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c04950-e651-4fd7-951f-342097617932 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:44.203830 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c04950-e651-4fd7-951f-342097617932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:44.212864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c04950-e651-4fd7-951f-342097617932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:44.214311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c04950-e651-4fd7-951f-342097617932 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:44.223952 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1373/2745] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:08:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:08:44.885851 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b4c62-8ff8-4be3-9a8b-8a667b7fe9d6 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:44.886175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b4c62-8ff8-4be3-9a8b-8a667b7fe9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:44.886457 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b4c62-8ff8-4be3-9a8b-8a667b7fe9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:44.914400 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-959b4c62-8ff8-4be3-9a8b-8a667b7fe9d6 None None] MFA Rules not processed for user `79d815de97584f0f91b00c0d62c34ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:44.915627 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-959b4c62-8ff8-4be3-9a8b-8a667b7fe9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:44.927999 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:44.983925 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1373/2746] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:44.995617 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c04950-e651-4fd7-951f-342097617932 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:08:44.997069 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-36c04950-e651-4fd7-951f-342097617932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:45.052829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c04950-e651-4fd7-951f-342097617932 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:08:45.056385 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d595f-e6c5-4557-b938-77f3663cf314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:08:45.057011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d595f-e6c5-4557-b938-77f3663cf314 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:45.057286 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d595f-e6c5-4557-b938-77f3663cf314 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:45.057554 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d595f-e6c5-4557-b938-77f3663cf314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:45.065878 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d595f-e6c5-4557-b938-77f3663cf314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:08:45.067316 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d595f-e6c5-4557-b938-77f3663cf314 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:08:45.076481 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1374/2747] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:08:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:08:46.411283 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30043bb6-19ab-4c72-a5f6-69b29b2ffce9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:08:46.411788 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30043bb6-19ab-4c72-a5f6-69b29b2ffce9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:08:46.411910 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30043bb6-19ab-4c72-a5f6-69b29b2ffce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:08:46.429789 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-30043bb6-19ab-4c72-a5f6-69b29b2ffce9 None None] MFA Rules not processed for user `79d815de97584f0f91b00c0d62c34ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:08:46.431011 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-30043bb6-19ab-4c72-a5f6-69b29b2ffce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:08:46.437801 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1374/2748] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:08:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:08:55.072523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=66,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:08:56.424638 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=24 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:09:00.036704 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892bcc-ffd1-4a16-be6b-3ff91c0fce60 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:09:00.037217 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892bcc-ffd1-4a16-be6b-3ff91c0fce60 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:09:00.037217 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892bcc-ffd1-4a16-be6b-3ff91c0fce60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:09:00.053806 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5b892bcc-ffd1-4a16-be6b-3ff91c0fce60 None None] MFA Rules not processed for user `47b214a23ec74f58904fe6d82deb8bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:09:00.055061 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5b892bcc-ffd1-4a16-be6b-3ff91c0fce60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:09:00.112731 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1375/2749] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:09:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:09:00.482858 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30043bb6-19ab-4c72-a5f6-69b29b2ffce9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:09:00.484250 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-30043bb6-19ab-4c72-a5f6-69b29b2ffce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:09:00.496301 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30043bb6-19ab-4c72-a5f6-69b29b2ffce9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:09:00.499780 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62ca98-bdb3-440c-a327-659dee568afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:09:00.500407 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62ca98-bdb3-440c-a327-659dee568afe service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:09:00.500688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62ca98-bdb3-440c-a327-659dee568afe service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:09:00.500962 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62ca98-bdb3-440c-a327-659dee568afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:09:00.502685 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5a62ca98-bdb3-440c-a327-659dee568afe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:09:00.511794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62ca98-bdb3-440c-a327-659dee568afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:09:00.513211 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62ca98-bdb3-440c-a327-659dee568afe service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:09:00.521233 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1375/2750] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:09:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:09:01.943054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6d1f9-5256-47c1-885b-7e868a63973b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:09:01.944164 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6d1f9-5256-47c1-885b-7e868a63973b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:09:01.945052 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6d1f9-5256-47c1-885b-7e868a63973b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:09:01.977602 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-6fe6d1f9-5256-47c1-885b-7e868a63973b None None] MFA Rules not processed for user `79d815de97584f0f91b00c0d62c34ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:09:01.978959 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6fe6d1f9-5256-47c1-885b-7e868a63973b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:09:01.986742 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1376/2751] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:09:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:09:10.517561 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=6 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:09:11.965717 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=28 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:09:18.144800 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc324e-c381-4fb1-8248-8fc12e8ee693 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:09:18.145262 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc324e-c381-4fb1-8248-8fc12e8ee693 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:09:18.145372 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc324e-c381-4fb1-8248-8fc12e8ee693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:09:18.163355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-37bc324e-c381-4fb1-8248-8fc12e8ee693 None None] MFA Rules not processed for user `4fc55e3a9107489a9b24385ac5379ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:09:18.164547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-37bc324e-c381-4fb1-8248-8fc12e8ee693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:09:18.219679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1376/2752] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 7 22:09:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:09:18.265977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6d1f9-5256-47c1-885b-7e868a63973b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:09:18.267394 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6fe6d1f9-5256-47c1-885b-7e868a63973b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:09:18.336470 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6d1f9-5256-47c1-885b-7e868a63973b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:09:18.341339 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32303b-b930-464a-bf47-9d78cb5ff123 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b69c708fbc470aae3e3954e21a1e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:09:18.342007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32303b-b930-464a-bf47-9d78cb5ff123 service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:09:18.342300 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32303b-b930-464a-bf47-9d78cb5ff123 service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:09:18.342578 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32303b-b930-464a-bf47-9d78cb5ff123 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:09:18.352019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32303b-b930-464a-bf47-9d78cb5ff123 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:09:18.353630 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32303b-b930-464a-bf47-9d78cb5ff123 service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:09:18.362341 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1377/2753] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 7 22:09:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 22:09:28.213033 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=25 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:09:28.358767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=32 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:09:32.844440 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa9c0c-cad3-4490-be9c-39f6b0e551d2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:09:32.844886 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa9c0c-cad3-4490-be9c-39f6b0e551d2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:09:32.845031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa9c0c-cad3-4490-be9c-39f6b0e551d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:09:32.862641 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-54aa9c0c-cad3-4490-be9c-39f6b0e551d2 None None] MFA Rules not processed for user `4fc55e3a9107489a9b24385ac5379ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:09:32.863818 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-54aa9c0c-cad3-4490-be9c-39f6b0e551d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:09:32.871371 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1377/2754] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jun 7 22:09:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:09:32.883642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32303b-b930-464a-bf47-9d78cb5ff123 service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:09:32.894060 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32303b-b930-464a-bf47-9d78cb5ff123 service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:09:32.899378 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a68d2b-af08-4554-9155-a303048e544d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b69c708fbc470aae3e3954e21a1e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:09:32.900000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a68d2b-af08-4554-9155-a303048e544d service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:09:32.900281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a68d2b-af08-4554-9155-a303048e544d service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:09:32.900557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a68d2b-af08-4554-9155-a303048e544d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:09:32.908500 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a68d2b-af08-4554-9155-a303048e544d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:09:32.910129 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a68d2b-af08-4554-9155-a303048e544d service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:09:32.918530 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1378/2755] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 7 22:09:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 22:09:34.230275 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa9c0c-cad3-4490-be9c-39f6b0e551d2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:09:34.231651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-54aa9c0c-cad3-4490-be9c-39f6b0e551d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:09:34.300299 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa9c0c-cad3-4490-be9c-39f6b0e551d2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:09:34.305948 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a97de-f111-468a-ab7e-5fe78be71a70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90facf92f97d435dbe8a001759a8fe0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:09:34.306643 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a97de-f111-468a-ab7e-5fe78be71a70 service placement] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:09:34.306927 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a97de-f111-468a-ab7e-5fe78be71a70 service placement] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:09:34.307205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a97de-f111-468a-ab7e-5fe78be71a70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:09:34.309034 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-170a97de-f111-468a-ab7e-5fe78be71a70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:09:34.321470 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a97de-f111-468a-ab7e-5fe78be71a70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:09:34.323076 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a97de-f111-468a-ab7e-5fe78be71a70 service placement] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:09:34.333236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1378/2756] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:09:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:09:34.810340 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a68d2b-af08-4554-9155-a303048e544d service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:09:34.821269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a68d2b-af08-4554-9155-a303048e544d service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:09:34.825984 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a573ec-3f0d-40cf-8fe0-98dd13d3907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:09:34.826845 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a573ec-3f0d-40cf-8fe0-98dd13d3907f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:09:34.827124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a573ec-3f0d-40cf-8fe0-98dd13d3907f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:09:34.827394 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a573ec-3f0d-40cf-8fe0-98dd13d3907f admin admin] PATH_INFO: `/v3/users/79d815de97584f0f91b00c0d62c34ef3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:09:34.828580 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a573ec-3f0d-40cf-8fe0-98dd13d3907f admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d815de97584f0f91b00c0d62c34ef3)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:09:34.830501 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a573ec-3f0d-40cf-8fe0-98dd13d3907f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:09:34.876735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-97a573ec-3f0d-40cf-8fe0-98dd13d3907f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d815de97584f0f91b00c0d62c34ef3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:09:34.883694 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-97a573ec-3f0d-40cf-8fe0-98dd13d3907f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d815de97584f0f91b00c0d62c34ef3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:09:34.891718 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-97a573ec-3f0d-40cf-8fe0-98dd13d3907f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d815de97584f0f91b00c0d62c34ef3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:09:34.892434 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-97a573ec-3f0d-40cf-8fe0-98dd13d3907f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d815de97584f0f91b00c0d62c34ef3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:09:34.893091 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-97a573ec-3f0d-40cf-8fe0-98dd13d3907f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d815de97584f0f91b00c0d62c34ef3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:09:34.911778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1379/2757] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:09:34 2022] DELETE /identity/v3/users/79d815de97584f0f91b00c0d62c34ef3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:09:35.094055 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a97de-f111-468a-ab7e-5fe78be71a70 service placement] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:09:35.113273 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a97de-f111-468a-ab7e-5fe78be71a70 service placement] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:09:35.175399 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c10cb-3691-4688-90ac-a7b0b3e1f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:09:35.176260 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c10cb-3691-4688-90ac-a7b0b3e1f330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:09:35.176543 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c10cb-3691-4688-90ac-a7b0b3e1f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:09:35.176817 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c10cb-3691-4688-90ac-a7b0b3e1f330 admin admin] PATH_INFO: `/v3/projects/1fee1eb9272a4f889a492ddaa75eef8d` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:09:35.178036 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c10cb-3691-4688-90ac-a7b0b3e1f330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fee1eb9272a4f889a492ddaa75eef8d)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:09:35.179969 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c10cb-3691-4688-90ac-a7b0b3e1f330 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:09:35.228527 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-757c10cb-3691-4688-90ac-a7b0b3e1f330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fee1eb9272a4f889a492ddaa75eef8d', 'request_id': 'req-757c10cb-3691-4688-90ac-a7b0b3e1f330'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:09:35.233967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-757c10cb-3691-4688-90ac-a7b0b3e1f330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fee1eb9272a4f889a492ddaa75eef8d', 'request_id': 'req-757c10cb-3691-4688-90ac-a7b0b3e1f330'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:09:35.240625 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-757c10cb-3691-4688-90ac-a7b0b3e1f330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fee1eb9272a4f889a492ddaa75eef8d', 'request_id': 'req-757c10cb-3691-4688-90ac-a7b0b3e1f330'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:09:35.252409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-757c10cb-3691-4688-90ac-a7b0b3e1f330 admin admin] The token cache is being invalidate because project 1fee1eb9272a4f889a492ddaa75eef8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:09:35.252697 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-757c10cb-3691-4688-90ac-a7b0b3e1f330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:09:35.253311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-757c10cb-3691-4688-90ac-a7b0b3e1f330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:09:35.254885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1379/2758] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:09:35 2022] DELETE /identity/v3/projects/1fee1eb9272a4f889a492ddaa75eef8d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:09:44.907986 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:09:45.249232 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:11.255411 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a573ec-3f0d-40cf-8fe0-98dd13d3907f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:11.257579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-97a573ec-3f0d-40cf-8fe0-98dd13d3907f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:11.274370 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a573ec-3f0d-40cf-8fe0-98dd13d3907f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:11.333479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdc1c3-ca68-48c4-b2ef-b924551f1d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:11.335003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdc1c3-ca68-48c4-b2ef-b924551f1d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:11.335287 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdc1c3-ca68-48c4-b2ef-b924551f1d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:11.335563 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdc1c3-ca68-48c4-b2ef-b924551f1d9b admin admin] PATH_INFO: `/v3/users/47b214a23ec74f58904fe6d82deb8bb6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:11.336942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdc1c3-ca68-48c4-b2ef-b924551f1d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=47b214a23ec74f58904fe6d82deb8bb6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:11.339019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdc1c3-ca68-48c4-b2ef-b924551f1d9b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:11.389839 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-32cdc1c3-ca68-48c4-b2ef-b924551f1d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47b214a23ec74f58904fe6d82deb8bb6'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:11.397139 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-32cdc1c3-ca68-48c4-b2ef-b924551f1d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47b214a23ec74f58904fe6d82deb8bb6'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:11.404101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-32cdc1c3-ca68-48c4-b2ef-b924551f1d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47b214a23ec74f58904fe6d82deb8bb6'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:11.404697 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-32cdc1c3-ca68-48c4-b2ef-b924551f1d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47b214a23ec74f58904fe6d82deb8bb6'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:11.405288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-32cdc1c3-ca68-48c4-b2ef-b924551f1d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47b214a23ec74f58904fe6d82deb8bb6'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:11.422547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1380/2759] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:10:11 2022] DELETE /identity/v3/users/47b214a23ec74f58904fe6d82deb8bb6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:10:11.593362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c10cb-3691-4688-90ac-a7b0b3e1f330 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:11.594930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-757c10cb-3691-4688-90ac-a7b0b3e1f330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:11.608091 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c10cb-3691-4688-90ac-a7b0b3e1f330 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:11.668020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf5082-039a-405f-952d-97ee4226c947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:11.668884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf5082-039a-405f-952d-97ee4226c947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:11.669165 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf5082-039a-405f-952d-97ee4226c947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:11.669440 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf5082-039a-405f-952d-97ee4226c947 admin admin] PATH_INFO: `/v3/projects/4f11371bf2124125badc1c503af5f760` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:11.670647 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf5082-039a-405f-952d-97ee4226c947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f11371bf2124125badc1c503af5f760)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:11.672552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf5082-039a-405f-952d-97ee4226c947 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:11.717953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a6cf5082-039a-405f-952d-97ee4226c947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f11371bf2124125badc1c503af5f760', 'request_id': 'req-a6cf5082-039a-405f-952d-97ee4226c947'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:11.723497 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a6cf5082-039a-405f-952d-97ee4226c947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f11371bf2124125badc1c503af5f760', 'request_id': 'req-a6cf5082-039a-405f-952d-97ee4226c947'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:11.729830 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a6cf5082-039a-405f-952d-97ee4226c947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f11371bf2124125badc1c503af5f760', 'request_id': 'req-a6cf5082-039a-405f-952d-97ee4226c947'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:11.742844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a6cf5082-039a-405f-952d-97ee4226c947 admin admin] The token cache is being invalidate because project 4f11371bf2124125badc1c503af5f760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:10:11.743130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a6cf5082-039a-405f-952d-97ee4226c947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:11.743747 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a6cf5082-039a-405f-952d-97ee4226c947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:11.745256 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1380/2760] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:10:11 2022] DELETE /identity/v3/projects/4f11371bf2124125badc1c503af5f760 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:10:11.750366 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fb191-56c3-4486-a974-663b8edb1a45 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:11.750664 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fb191-56c3-4486-a974-663b8edb1a45 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:11.750945 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fb191-56c3-4486-a974-663b8edb1a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:11.768918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f59fb191-56c3-4486-a974-663b8edb1a45 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:11.770211 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f59fb191-56c3-4486-a974-663b8edb1a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:11.829109 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1381/2761] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:10:11.838436 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47d5d7-2521-4ffc-a19e-ee33a6820824 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:11.838728 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47d5d7-2521-4ffc-a19e-ee33a6820824 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:11.839005 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47d5d7-2521-4ffc-a19e-ee33a6820824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:11.857853 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ac47d5d7-2521-4ffc-a19e-ee33a6820824 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:11.859113 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ac47d5d7-2521-4ffc-a19e-ee33a6820824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:11.868248 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1381/2762] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:10:11.872353 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fb191-56c3-4486-a974-663b8edb1a45 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:11.883077 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fb191-56c3-4486-a974-663b8edb1a45 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:11.887618 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f33fd8-8739-403c-9466-217486a8bfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:11.888279 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f33fd8-8739-403c-9466-217486a8bfbf admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:11.888561 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f33fd8-8739-403c-9466-217486a8bfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:11.888970 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f33fd8-8739-403c-9466-217486a8bfbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:11.889707 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f33fd8-8739-403c-9466-217486a8bfbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:10:11.890056 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f33fd8-8739-403c-9466-217486a8bfbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:11.891694 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f33fd8-8739-403c-9466-217486a8bfbf admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:11.903826 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1382/2763] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:10:11.908152 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47d5d7-2521-4ffc-a19e-ee33a6820824 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:11.917943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47d5d7-2521-4ffc-a19e-ee33a6820824 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:11.922641 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bb337-2717-45f1-b381-f066c22ea2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:11.923284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bb337-2717-45f1-b381-f066c22ea2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:11.923565 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bb337-2717-45f1-b381-f066c22ea2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:11.923836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bb337-2717-45f1-b381-f066c22ea2c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:11.924529 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bb337-2717-45f1-b381-f066c22ea2c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:11.926456 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bb337-2717-45f1-b381-f066c22ea2c4 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:11.958019 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1382/2764] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:10:11 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:10:11.959434 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f33fd8-8739-403c-9466-217486a8bfbf admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:11.969544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f33fd8-8739-403c-9466-217486a8bfbf admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:11.973209 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:12.027616 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51b2d9-3d97-442e-8e2f-e5b1603aa0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:12.028205 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51b2d9-3d97-442e-8e2f-e5b1603aa0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:12.028485 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51b2d9-3d97-442e-8e2f-e5b1603aa0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:12.028754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51b2d9-3d97-442e-8e2f-e5b1603aa0c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:12.029465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51b2d9-3d97-442e-8e2f-e5b1603aa0c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:12.031395 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51b2d9-3d97-442e-8e2f-e5b1603aa0c7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:12.050754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1383/2765] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:10:11 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:10:12.055475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bb337-2717-45f1-b381-f066c22ea2c4 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:12.066062 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bb337-2717-45f1-b381-f066c22ea2c4 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:12.070708 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512f5ff-18a0-4466-9e6a-63b72463e8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:12.071391 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512f5ff-18a0-4466-9e6a-63b72463e8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:12.071674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512f5ff-18a0-4466-9e6a-63b72463e8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:12.071950 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512f5ff-18a0-4466-9e6a-63b72463e8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:12.072699 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512f5ff-18a0-4466-9e6a-63b72463e8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:12.074375 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512f5ff-18a0-4466-9e6a-63b72463e8c2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:12.084881 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1383/2766] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:10:12.088697 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51b2d9-3d97-442e-8e2f-e5b1603aa0c7 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:12.098652 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51b2d9-3d97-442e-8e2f-e5b1603aa0c7 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:12.104851 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829565c-1ea6-4348-8904-1eafb4203610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:12.105466 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829565c-1ea6-4348-8904-1eafb4203610 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:12.105754 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829565c-1ea6-4348-8904-1eafb4203610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:12.106056 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829565c-1ea6-4348-8904-1eafb4203610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:12.106774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829565c-1ea6-4348-8904-1eafb4203610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:12.108370 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829565c-1ea6-4348-8904-1eafb4203610 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:12.118513 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1384/2767] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:10:12.122512 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512f5ff-18a0-4466-9e6a-63b72463e8c2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:12.132977 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512f5ff-18a0-4466-9e6a-63b72463e8c2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:12.137894 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3466c-ecb0-409e-bc19-32a65920b583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:12.138798 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3466c-ecb0-409e-bc19-32a65920b583 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:12.139083 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3466c-ecb0-409e-bc19-32a65920b583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:12.139359 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3466c-ecb0-409e-bc19-32a65920b583 admin admin] PATH_INFO: `/v3/projects/246606be02e649eea122a85118fda765/users/70cbeb20923546abaf2a345f9a3334eb/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:12.154252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3466c-ecb0-409e-bc19-32a65920b583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=246606be02e649eea122a85118fda765, user_id=70cbeb20923546abaf2a345f9a3334eb, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:12.157009 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3466c-ecb0-409e-bc19-32a65920b583 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:12.169675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1384/2768] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:10:12 2022] PUT /identity/v3/projects/246606be02e649eea122a85118fda765/users/70cbeb20923546abaf2a345f9a3334eb/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:10:12.180478 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfcacc-6169-4ed9-a8e8-364b0b2fd9b6 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:12.180770 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfcacc-6169-4ed9-a8e8-364b0b2fd9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:12.181047 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfcacc-6169-4ed9-a8e8-364b0b2fd9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:12.208233 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-bdbfcacc-6169-4ed9-a8e8-364b0b2fd9b6 None None] MFA Rules not processed for user `70cbeb20923546abaf2a345f9a3334eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:12.209956 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bdbfcacc-6169-4ed9-a8e8-364b0b2fd9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:12.275664 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1385/2769] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:10:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:10:12.280303 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3466c-ecb0-409e-bc19-32a65920b583 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:12.310361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:12.344020 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3466c-ecb0-409e-bc19-32a65920b583 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:12.348923 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90f2f1-64bc-4859-9339-264f7e5a6004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:12.350362 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90f2f1-64bc-4859-9339-264f7e5a6004 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:12.350648 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90f2f1-64bc-4859-9339-264f7e5a6004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:12.350926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90f2f1-64bc-4859-9339-264f7e5a6004 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:12.351781 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90f2f1-64bc-4859-9339-264f7e5a6004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:12.353781 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90f2f1-64bc-4859-9339-264f7e5a6004 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:12.380873 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1385/2770] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:10:12 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:10:12.384757 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfcacc-6169-4ed9-a8e8-364b0b2fd9b6 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:12.395399 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfcacc-6169-4ed9-a8e8-364b0b2fd9b6 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:12.452641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165d67d-4d77-4fdf-9997-6b80e00a31ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:12.453312 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165d67d-4d77-4fdf-9997-6b80e00a31ea admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:12.453604 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165d67d-4d77-4fdf-9997-6b80e00a31ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:12.453871 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165d67d-4d77-4fdf-9997-6b80e00a31ea admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:12.454589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165d67d-4d77-4fdf-9997-6b80e00a31ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:12.456710 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165d67d-4d77-4fdf-9997-6b80e00a31ea admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:12.483477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1386/2771] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:10:12 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:10:12.484722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90f2f1-64bc-4859-9339-264f7e5a6004 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:12.496962 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90f2f1-64bc-4859-9339-264f7e5a6004 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:12.501571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d8a99-8bba-4337-8889-c8be04687f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:12.502272 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d8a99-8bba-4337-8889-c8be04687f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:12.502555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d8a99-8bba-4337-8889-c8be04687f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:12.502831 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d8a99-8bba-4337-8889-c8be04687f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:12.503557 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d8a99-8bba-4337-8889-c8be04687f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:12.505162 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d8a99-8bba-4337-8889-c8be04687f6d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:12.516802 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1386/2772] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:10:12.521528 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165d67d-4d77-4fdf-9997-6b80e00a31ea admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:12.528275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:12.533114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165d67d-4d77-4fdf-9997-6b80e00a31ea admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:12.539855 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3b32c-a927-44cd-8e33-cd23154c720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:12.540831 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3b32c-a927-44cd-8e33-cd23154c720e admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:12.541119 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3b32c-a927-44cd-8e33-cd23154c720e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:12.541396 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3b32c-a927-44cd-8e33-cd23154c720e admin admin] PATH_INFO: `/v3/projects/c95351fb3880439e962c076487c9523c/users/0ffbe1fa53d54699a0de7f42d993e83e/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:12.556864 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3b32c-a927-44cd-8e33-cd23154c720e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95351fb3880439e962c076487c9523c, user_id=0ffbe1fa53d54699a0de7f42d993e83e, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:12.559251 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3b32c-a927-44cd-8e33-cd23154c720e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:12.573826 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1387/2773] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:10:12 2022] PUT /identity/v3/projects/c95351fb3880439e962c076487c9523c/users/0ffbe1fa53d54699a0de7f42d993e83e/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:10:12.577880 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d8a99-8bba-4337-8889-c8be04687f6d admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:12.588690 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d8a99-8bba-4337-8889-c8be04687f6d admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:12.650981 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d5e75-69a3-4727-b24a-50d21aae1048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:12.651643 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d5e75-69a3-4727-b24a-50d21aae1048 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:12.651922 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d5e75-69a3-4727-b24a-50d21aae1048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:12.652198 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d5e75-69a3-4727-b24a-50d21aae1048 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:12.652922 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d5e75-69a3-4727-b24a-50d21aae1048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:12.654547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d5e75-69a3-4727-b24a-50d21aae1048 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:12.664912 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1387/2774] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:10:12.669026 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3b32c-a927-44cd-8e33-cd23154c720e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:12.679907 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3b32c-a927-44cd-8e33-cd23154c720e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:12.684491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3c506-0fbb-493a-8a02-fc84cac9ad73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:12.685361 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3c506-0fbb-493a-8a02-fc84cac9ad73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:12.685642 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3c506-0fbb-493a-8a02-fc84cac9ad73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:12.685914 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3c506-0fbb-493a-8a02-fc84cac9ad73 admin admin] PATH_INFO: `/v3/projects/c95351fb3880439e962c076487c9523c/users/0ffbe1fa53d54699a0de7f42d993e83e/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:12.687919 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3c506-0fbb-493a-8a02-fc84cac9ad73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95351fb3880439e962c076487c9523c, user_id=0ffbe1fa53d54699a0de7f42d993e83e, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:12.690579 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3c506-0fbb-493a-8a02-fc84cac9ad73 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:12.700580 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1388/2775] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:10:12 2022] PUT /identity/v3/projects/c95351fb3880439e962c076487c9523c/users/0ffbe1fa53d54699a0de7f42d993e83e/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:10:12.710632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351cf06-e849-4bc0-9abe-69418284acd2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:12.710926 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351cf06-e849-4bc0-9abe-69418284acd2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:12.711206 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351cf06-e849-4bc0-9abe-69418284acd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:12.737530 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-6351cf06-e849-4bc0-9abe-69418284acd2 None None] MFA Rules not processed for user `0ffbe1fa53d54699a0de7f42d993e83e`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:12.738833 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-6351cf06-e849-4bc0-9abe-69418284acd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:12.805186 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1388/2776] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:10:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:10:12.816119 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3c506-0fbb-493a-8a02-fc84cac9ad73 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:12.818277 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-42a3c506-0fbb-493a-8a02-fc84cac9ad73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:12.875114 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3c506-0fbb-493a-8a02-fc84cac9ad73 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:12.878767 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacb1e8-8575-4699-a693-5a1e2feab480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:12.879404 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacb1e8-8575-4699-a693-5a1e2feab480 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:12.879685 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacb1e8-8575-4699-a693-5a1e2feab480 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:12.879958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacb1e8-8575-4699-a693-5a1e2feab480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:12.889299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacb1e8-8575-4699-a693-5a1e2feab480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:12.890763 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacb1e8-8575-4699-a693-5a1e2feab480 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:12.900729 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1389/2777] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:10:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:10:12.971902 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351cf06-e849-4bc0-9abe-69418284acd2 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:12.981569 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351cf06-e849-4bc0-9abe-69418284acd2 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:12.985168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf434ccb-f35f-4a94-806d-2983c0387ba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:12.985794 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf434ccb-f35f-4a94-806d-2983c0387ba1 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:12.986112 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf434ccb-f35f-4a94-806d-2983c0387ba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:12.986387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf434ccb-f35f-4a94-806d-2983c0387ba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:13.006055 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:13.045414 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf434ccb-f35f-4a94-806d-2983c0387ba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:13.046865 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf434ccb-f35f-4a94-806d-2983c0387ba1 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:13.056079 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1389/2778] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:10:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:10:19.753497 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacb1e8-8575-4699-a693-5a1e2feab480 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:19.814318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacb1e8-8575-4699-a693-5a1e2feab480 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:19.818815 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827cb69-4d55-4b0d-9895-801067336cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:19.819678 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827cb69-4d55-4b0d-9895-801067336cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:19.819958 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827cb69-4d55-4b0d-9895-801067336cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:19.820796 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827cb69-4d55-4b0d-9895-801067336cdf admin admin] PATH_INFO: `/v3/users/70cbeb20923546abaf2a345f9a3334eb` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:19.821999 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827cb69-4d55-4b0d-9895-801067336cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=70cbeb20923546abaf2a345f9a3334eb)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:19.823906 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827cb69-4d55-4b0d-9895-801067336cdf admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:19.868569 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7827cb69-4d55-4b0d-9895-801067336cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70cbeb20923546abaf2a345f9a3334eb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:19.875225 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7827cb69-4d55-4b0d-9895-801067336cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70cbeb20923546abaf2a345f9a3334eb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:19.882257 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7827cb69-4d55-4b0d-9895-801067336cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70cbeb20923546abaf2a345f9a3334eb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:19.883399 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7827cb69-4d55-4b0d-9895-801067336cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70cbeb20923546abaf2a345f9a3334eb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:19.884002 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7827cb69-4d55-4b0d-9895-801067336cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70cbeb20923546abaf2a345f9a3334eb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:19.891002 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:19.903214 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1390/2779] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:10:19 2022] DELETE /identity/v3/users/70cbeb20923546abaf2a345f9a3334eb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:10:19.907632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7c5f8-b6ef-47f0-ae6e-153b34c7ffec None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:19.908087 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7c5f8-b6ef-47f0-ae6e-153b34c7ffec None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:19.908183 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7c5f8-b6ef-47f0-ae6e-153b34c7ffec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:19.925202 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a5e7c5f8-b6ef-47f0-ae6e-153b34c7ffec None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:19.926411 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a5e7c5f8-b6ef-47f0-ae6e-153b34c7ffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:19.985973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1390/2780] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:10:19.995862 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827cb69-4d55-4b0d-9895-801067336cdf admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:19.997260 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7827cb69-4d55-4b0d-9895-801067336cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:20.053666 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827cb69-4d55-4b0d-9895-801067336cdf admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:20.057339 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74550e4e-5393-4186-95a9-9e14488ce0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:20.058004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74550e4e-5393-4186-95a9-9e14488ce0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:20.058288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74550e4e-5393-4186-95a9-9e14488ce0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:20.058565 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74550e4e-5393-4186-95a9-9e14488ce0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:20.067462 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74550e4e-5393-4186-95a9-9e14488ce0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:20.068887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74550e4e-5393-4186-95a9-9e14488ce0b6 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:20.078759 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1391/2781] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:10:20.343079 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7c5f8-b6ef-47f0-ae6e-153b34c7ffec None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:20.344556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a5e7c5f8-b6ef-47f0-ae6e-153b34c7ffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:20.359205 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7c5f8-b6ef-47f0-ae6e-153b34c7ffec None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:20.364381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea613c0-b9d2-42b1-ac6f-e651b586f57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:20.365915 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea613c0-b9d2-42b1-ac6f-e651b586f57a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:20.366236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea613c0-b9d2-42b1-ac6f-e651b586f57a admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:20.366511 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea613c0-b9d2-42b1-ac6f-e651b586f57a admin admin] PATH_INFO: `/v3/projects/246606be02e649eea122a85118fda765` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:20.368564 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea613c0-b9d2-42b1-ac6f-e651b586f57a admin admin] RBAC: Authorizing `identity:delete_project(project_id=246606be02e649eea122a85118fda765)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:20.370532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea613c0-b9d2-42b1-ac6f-e651b586f57a admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:20.419620 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-dea613c0-b9d2-42b1-ac6f-e651b586f57a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '246606be02e649eea122a85118fda765', 'request_id': 'req-dea613c0-b9d2-42b1-ac6f-e651b586f57a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:20.425047 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-dea613c0-b9d2-42b1-ac6f-e651b586f57a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '246606be02e649eea122a85118fda765', 'request_id': 'req-dea613c0-b9d2-42b1-ac6f-e651b586f57a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:20.431691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-dea613c0-b9d2-42b1-ac6f-e651b586f57a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '246606be02e649eea122a85118fda765', 'request_id': 'req-dea613c0-b9d2-42b1-ac6f-e651b586f57a'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:20.443736 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-dea613c0-b9d2-42b1-ac6f-e651b586f57a admin admin] The token cache is being invalidate because project 246606be02e649eea122a85118fda765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:10:20.444015 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-dea613c0-b9d2-42b1-ac6f-e651b586f57a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:20.444625 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-dea613c0-b9d2-42b1-ac6f-e651b586f57a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:20.446178 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1391/2782] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:10:20 2022] DELETE /identity/v3/projects/246606be02e649eea122a85118fda765 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:10:20.450196 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74550e4e-5393-4186-95a9-9e14488ce0b6 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:20.459763 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74550e4e-5393-4186-95a9-9e14488ce0b6 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:20.515658 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfc7aa-1165-43de-a3e2-68596b2b1d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:20.516517 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfc7aa-1165-43de-a3e2-68596b2b1d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:20.516801 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfc7aa-1165-43de-a3e2-68596b2b1d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:20.517075 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfc7aa-1165-43de-a3e2-68596b2b1d4c admin admin] PATH_INFO: `/v3/users/0ffbe1fa53d54699a0de7f42d993e83e` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:20.518275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfc7aa-1165-43de-a3e2-68596b2b1d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ffbe1fa53d54699a0de7f42d993e83e)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:20.520168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfc7aa-1165-43de-a3e2-68596b2b1d4c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:20.564641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-29bfc7aa-1165-43de-a3e2-68596b2b1d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ffbe1fa53d54699a0de7f42d993e83e'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:20.571377 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-29bfc7aa-1165-43de-a3e2-68596b2b1d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ffbe1fa53d54699a0de7f42d993e83e'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:20.578310 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-29bfc7aa-1165-43de-a3e2-68596b2b1d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ffbe1fa53d54699a0de7f42d993e83e'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:20.579007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-29bfc7aa-1165-43de-a3e2-68596b2b1d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ffbe1fa53d54699a0de7f42d993e83e'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:20.579610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-29bfc7aa-1165-43de-a3e2-68596b2b1d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ffbe1fa53d54699a0de7f42d993e83e'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:20.597026 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1392/2783] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:10:20 2022] DELETE /identity/v3/users/0ffbe1fa53d54699a0de7f42d993e83e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:10:20.903259 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea613c0-b9d2-42b1-ac6f-e651b586f57a admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:20.904823 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-dea613c0-b9d2-42b1-ac6f-e651b586f57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:20.918332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea613c0-b9d2-42b1-ac6f-e651b586f57a admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:20.961548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:20.977519 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6bae2-7e9c-4f70-85ab-868687d92163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:20.978417 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6bae2-7e9c-4f70-85ab-868687d92163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:20.978703 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6bae2-7e9c-4f70-85ab-868687d92163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:20.978980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6bae2-7e9c-4f70-85ab-868687d92163 admin admin] PATH_INFO: `/v3/projects/c95351fb3880439e962c076487c9523c` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:20.980156 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6bae2-7e9c-4f70-85ab-868687d92163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c95351fb3880439e962c076487c9523c)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:20.982110 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6bae2-7e9c-4f70-85ab-868687d92163 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:21.027462 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-92d6bae2-7e9c-4f70-85ab-868687d92163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c95351fb3880439e962c076487c9523c', 'request_id': 'req-92d6bae2-7e9c-4f70-85ab-868687d92163'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:21.032789 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-92d6bae2-7e9c-4f70-85ab-868687d92163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c95351fb3880439e962c076487c9523c', 'request_id': 'req-92d6bae2-7e9c-4f70-85ab-868687d92163'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:21.038805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-92d6bae2-7e9c-4f70-85ab-868687d92163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c95351fb3880439e962c076487c9523c', 'request_id': 'req-92d6bae2-7e9c-4f70-85ab-868687d92163'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:21.050588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-92d6bae2-7e9c-4f70-85ab-868687d92163 admin admin] The token cache is being invalidate because project c95351fb3880439e962c076487c9523c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:10:21.050869 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-92d6bae2-7e9c-4f70-85ab-868687d92163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:21.051579 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-92d6bae2-7e9c-4f70-85ab-868687d92163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:21.053119 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1392/2784] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:10:20 2022] DELETE /identity/v3/projects/c95351fb3880439e962c076487c9523c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:10:21.057972 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f0ecb-a76e-4c13-af27-0066f03e0e1b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:21.058448 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f0ecb-a76e-4c13-af27-0066f03e0e1b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:21.058551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f0ecb-a76e-4c13-af27-0066f03e0e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:21.076020 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-666f0ecb-a76e-4c13-af27-0066f03e0e1b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:21.077184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-666f0ecb-a76e-4c13-af27-0066f03e0e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:21.082264 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:21.135799 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1393/2785] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:10:21.143392 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd739d8-69b0-4bda-813f-3949292283d0 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:21.143680 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd739d8-69b0-4bda-813f-3949292283d0 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:21.143954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd739d8-69b0-4bda-813f-3949292283d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:21.162391 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8dd739d8-69b0-4bda-813f-3949292283d0 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:21.163570 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8dd739d8-69b0-4bda-813f-3949292283d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:21.171398 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1393/2786] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:10:21.175374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f0ecb-a76e-4c13-af27-0066f03e0e1b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:21.185403 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f0ecb-a76e-4c13-af27-0066f03e0e1b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:21.189880 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4c2f3-538f-4366-97bd-757dcad0dafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:21.190549 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4c2f3-538f-4366-97bd-757dcad0dafd admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:21.190828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4c2f3-538f-4366-97bd-757dcad0dafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:21.191102 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4c2f3-538f-4366-97bd-757dcad0dafd admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:21.191911 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4c2f3-538f-4366-97bd-757dcad0dafd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:10:21.192218 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4c2f3-538f-4366-97bd-757dcad0dafd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:21.193854 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4c2f3-538f-4366-97bd-757dcad0dafd admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:21.206111 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1394/2787] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:10:21.211032 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd739d8-69b0-4bda-813f-3949292283d0 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:21.222363 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd739d8-69b0-4bda-813f-3949292283d0 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:21.227015 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b769d6-eda1-461f-b7da-917d6f2a8c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:21.227661 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b769d6-eda1-461f-b7da-917d6f2a8c3b admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:21.227946 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b769d6-eda1-461f-b7da-917d6f2a8c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:21.228220 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b769d6-eda1-461f-b7da-917d6f2a8c3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:21.228908 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b769d6-eda1-461f-b7da-917d6f2a8c3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:21.230845 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b769d6-eda1-461f-b7da-917d6f2a8c3b admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:21.257573 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1394/2788] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:10:21 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:10:21.262297 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4c2f3-538f-4366-97bd-757dcad0dafd admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:21.272138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4c2f3-538f-4366-97bd-757dcad0dafd admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:21.326884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad29a6e-dbe8-41cb-9252-13490ce4a787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:21.327539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad29a6e-dbe8-41cb-9252-13490ce4a787 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:21.327819 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad29a6e-dbe8-41cb-9252-13490ce4a787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:21.328093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad29a6e-dbe8-41cb-9252-13490ce4a787 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:21.328778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad29a6e-dbe8-41cb-9252-13490ce4a787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:21.330720 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad29a6e-dbe8-41cb-9252-13490ce4a787 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:21.349884 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1395/2789] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:10:21 2022] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:10:21.353973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b769d6-eda1-461f-b7da-917d6f2a8c3b admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:21.366002 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b769d6-eda1-461f-b7da-917d6f2a8c3b admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:21.371243 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac0519-5756-4265-b8cd-12142a5afa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:21.371896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac0519-5756-4265-b8cd-12142a5afa04 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:21.372188 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac0519-5756-4265-b8cd-12142a5afa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:21.372461 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac0519-5756-4265-b8cd-12142a5afa04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:21.373229 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac0519-5756-4265-b8cd-12142a5afa04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:21.374870 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac0519-5756-4265-b8cd-12142a5afa04 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:21.385749 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1395/2790] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:10:21.389650 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad29a6e-dbe8-41cb-9252-13490ce4a787 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:21.399575 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad29a6e-dbe8-41cb-9252-13490ce4a787 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:21.404165 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316041d1-01f2-446a-b4e3-d14f89a5c3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:21.404800 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316041d1-01f2-446a-b4e3-d14f89a5c3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:21.405078 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316041d1-01f2-446a-b4e3-d14f89a5c3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:21.405348 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316041d1-01f2-446a-b4e3-d14f89a5c3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:21.406098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316041d1-01f2-446a-b4e3-d14f89a5c3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:21.407700 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316041d1-01f2-446a-b4e3-d14f89a5c3b2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:21.417436 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1396/2791] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:10:21.421298 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac0519-5756-4265-b8cd-12142a5afa04 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:21.431587 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac0519-5756-4265-b8cd-12142a5afa04 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:21.436215 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d28910-12b0-4d0c-83e6-0b3cd6960a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:21.436989 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d28910-12b0-4d0c-83e6-0b3cd6960a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:21.437268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d28910-12b0-4d0c-83e6-0b3cd6960a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:21.437542 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d28910-12b0-4d0c-83e6-0b3cd6960a30 admin admin] PATH_INFO: `/v3/projects/41b27809ea8c421aa0b12102151c4082/users/de92a3591ec64e1a8e082c4f4861c619/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:21.452204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d28910-12b0-4d0c-83e6-0b3cd6960a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b27809ea8c421aa0b12102151c4082, user_id=de92a3591ec64e1a8e082c4f4861c619, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:21.454852 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d28910-12b0-4d0c-83e6-0b3cd6960a30 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:21.467189 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1396/2792] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:10:21 2022] PUT /identity/v3/projects/41b27809ea8c421aa0b12102151c4082/users/de92a3591ec64e1a8e082c4f4861c619/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:10:21.478523 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0123eb-21f0-43a6-aff4-e485cd742d26 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:21.478844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0123eb-21f0-43a6-aff4-e485cd742d26 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:21.479125 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0123eb-21f0-43a6-aff4-e485cd742d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:21.505706 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0c0123eb-21f0-43a6-aff4-e485cd742d26 None None] MFA Rules not processed for user `de92a3591ec64e1a8e082c4f4861c619`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:21.506944 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0c0123eb-21f0-43a6-aff4-e485cd742d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:21.571266 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1397/2793] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:10:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:10:21.575710 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d28910-12b0-4d0c-83e6-0b3cd6960a30 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:21.637613 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d28910-12b0-4d0c-83e6-0b3cd6960a30 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:21.642293 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bcdee-6732-4f57-a4cb-2cd2439ab99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:21.643049 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bcdee-6732-4f57-a4cb-2cd2439ab99f admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:21.643338 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bcdee-6732-4f57-a4cb-2cd2439ab99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:21.643618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bcdee-6732-4f57-a4cb-2cd2439ab99f admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:21.644317 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bcdee-6732-4f57-a4cb-2cd2439ab99f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:21.646247 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bcdee-6732-4f57-a4cb-2cd2439ab99f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:21.659708 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:21.677151 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1397/2794] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:10:21 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:10:21.678316 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0123eb-21f0-43a6-aff4-e485cd742d26 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:21.689764 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0123eb-21f0-43a6-aff4-e485cd742d26 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:21.693204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:21.746682 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c07ca-8b8f-43d3-ad6e-fc843ecac6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:21.747337 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c07ca-8b8f-43d3-ad6e-fc843ecac6df admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:21.747616 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c07ca-8b8f-43d3-ad6e-fc843ecac6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:21.747890 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c07ca-8b8f-43d3-ad6e-fc843ecac6df admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:21.748562 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c07ca-8b8f-43d3-ad6e-fc843ecac6df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:21.750495 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c07ca-8b8f-43d3-ad6e-fc843ecac6df admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:21.769244 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1398/2795] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:10:21 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:10:21.773290 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bcdee-6732-4f57-a4cb-2cd2439ab99f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:21.783410 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bcdee-6732-4f57-a4cb-2cd2439ab99f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:21.788284 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ac76d-aac8-41e1-8770-aa418d1959a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:21.789447 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac76d-aac8-41e1-8770-aa418d1959a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:21.789731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac76d-aac8-41e1-8770-aa418d1959a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:21.790051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac76d-aac8-41e1-8770-aa418d1959a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:21.790810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ac76d-aac8-41e1-8770-aa418d1959a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:21.792432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ac76d-aac8-41e1-8770-aa418d1959a9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:21.803051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1398/2796] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:10:21.807692 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c07ca-8b8f-43d3-ad6e-fc843ecac6df admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:21.817471 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c07ca-8b8f-43d3-ad6e-fc843ecac6df admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:21.821942 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f33780-a5e7-4c83-a481-52d5b423277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:21.822820 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f33780-a5e7-4c83-a481-52d5b423277b admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:21.823099 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f33780-a5e7-4c83-a481-52d5b423277b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:21.823372 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f33780-a5e7-4c83-a481-52d5b423277b admin admin] PATH_INFO: `/v3/projects/1a58b10b05df42cd96f736e17095ddfb/users/7453981d6899419e989b0673943b3bfa/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:21.837822 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f33780-a5e7-4c83-a481-52d5b423277b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a58b10b05df42cd96f736e17095ddfb, user_id=7453981d6899419e989b0673943b3bfa, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:21.840479 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f33780-a5e7-4c83-a481-52d5b423277b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:21.853586 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1399/2797] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:10:21 2022] PUT /identity/v3/projects/1a58b10b05df42cd96f736e17095ddfb/users/7453981d6899419e989b0673943b3bfa/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:10:21.857435 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ac76d-aac8-41e1-8770-aa418d1959a9 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:21.869599 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ac76d-aac8-41e1-8770-aa418d1959a9 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:21.933131 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca1717-a82a-4716-866e-54ba71b06cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:21.934663 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca1717-a82a-4716-866e-54ba71b06cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:21.934949 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca1717-a82a-4716-866e-54ba71b06cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:21.935219 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca1717-a82a-4716-866e-54ba71b06cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:21.936381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca1717-a82a-4716-866e-54ba71b06cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:21.938070 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca1717-a82a-4716-866e-54ba71b06cb0 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:21.950257 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1399/2798] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:10:21.954255 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f33780-a5e7-4c83-a481-52d5b423277b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:21.968566 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f33780-a5e7-4c83-a481-52d5b423277b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:21.973420 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aef740-0e18-46c2-af29-e49527e06e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:21.974380 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aef740-0e18-46c2-af29-e49527e06e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:21.974662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aef740-0e18-46c2-af29-e49527e06e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:21.974964 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aef740-0e18-46c2-af29-e49527e06e58 admin admin] PATH_INFO: `/v3/projects/1a58b10b05df42cd96f736e17095ddfb/users/7453981d6899419e989b0673943b3bfa/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:21.977640 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aef740-0e18-46c2-af29-e49527e06e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a58b10b05df42cd96f736e17095ddfb, user_id=7453981d6899419e989b0673943b3bfa, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:21.980333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aef740-0e18-46c2-af29-e49527e06e58 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:22.000822 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1400/2799] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:10:21 2022] PUT /identity/v3/projects/1a58b10b05df42cd96f736e17095ddfb/users/7453981d6899419e989b0673943b3bfa/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:10:22.002668 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50dcbd-2260-4e30-82da-b7965e74008e None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:22.002963 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50dcbd-2260-4e30-82da-b7965e74008e None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:22.003271 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50dcbd-2260-4e30-82da-b7965e74008e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:22.034377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-ad50dcbd-2260-4e30-82da-b7965e74008e None None] MFA Rules not processed for user `7453981d6899419e989b0673943b3bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:22.035574 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-ad50dcbd-2260-4e30-82da-b7965e74008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:22.104856 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1400/2800] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:10:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:10:22.116234 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aef740-0e18-46c2-af29-e49527e06e58 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:22.118048 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e0aef740-0e18-46c2-af29-e49527e06e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:22.174578 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aef740-0e18-46c2-af29-e49527e06e58 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:22.178174 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976f37d-23a0-426f-9443-9be230e28584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:22.178800 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976f37d-23a0-426f-9443-9be230e28584 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:22.179078 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976f37d-23a0-426f-9443-9be230e28584 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:22.179347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976f37d-23a0-426f-9443-9be230e28584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:22.188071 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976f37d-23a0-426f-9443-9be230e28584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:22.189484 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976f37d-23a0-426f-9443-9be230e28584 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:22.198638 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1401/2801] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:10:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:10:22.269384 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50dcbd-2260-4e30-82da-b7965e74008e None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:22.279672 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50dcbd-2260-4e30-82da-b7965e74008e None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:22.283281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4b9b8-83f0-46da-8f8b-c07f2a7cf0e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:22.283909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4b9b8-83f0-46da-8f8b-c07f2a7cf0e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:22.284194 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4b9b8-83f0-46da-8f8b-c07f2a7cf0e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:22.284471 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4b9b8-83f0-46da-8f8b-c07f2a7cf0e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:22.340179 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4b9b8-83f0-46da-8f8b-c07f2a7cf0e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:22.341602 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4b9b8-83f0-46da-8f8b-c07f2a7cf0e0 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:22.351144 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1401/2802] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:10:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:10:25.739034 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51395f-3c93-48fc-aaf5-5527b5ce2cfd None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:25.739585 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51395f-3c93-48fc-aaf5-5527b5ce2cfd None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:25.739708 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51395f-3c93-48fc-aaf5-5527b5ce2cfd None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:25.741014 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1402/2803] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 7 22:10:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 22:10:25.746810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda73da7-418c-4fe8-b9b6-f34fda331a3f None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:25.747265 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda73da7-418c-4fe8-b9b6-f34fda331a3f None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:25.747390 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda73da7-418c-4fe8-b9b6-f34fda331a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:25.754872 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:25.768122 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-eda73da7-418c-4fe8-b9b6-f34fda331a3f None None] MFA Rules not processed for user `aab50bc9064e444184afb1b4c585ce39`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:25.769351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-eda73da7-418c-4fe8-b9b6-f34fda331a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:25.822909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1402/2804] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 7 22:10:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:10:25.836284 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51395f-3c93-48fc-aaf5-5527b5ce2cfd None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:25.838083 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3a51395f-3c93-48fc-aaf5-5527b5ce2cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:25.850951 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51395f-3c93-48fc-aaf5-5527b5ce2cfd None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:25.854962 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b5511-23f3-493c-9690-fd90ad993d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:25.855593 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b5511-23f3-493c-9690-fd90ad993d47 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:25.855871 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b5511-23f3-493c-9690-fd90ad993d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:25.856183 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b5511-23f3-493c-9690-fd90ad993d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:25.863725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b5511-23f3-493c-9690-fd90ad993d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:25.865138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b5511-23f3-493c-9690-fd90ad993d47 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:25.872954 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1403/2805] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:10:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:10:25.952624 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001227e-a7e5-4059-9cdb-5996e431ac6c None None] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:25.952919 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001227e-a7e5-4059-9cdb-5996e431ac6c None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:25.953201 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001227e-a7e5-4059-9cdb-5996e431ac6c None None] PATH_INFO: `/` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:25.954626 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1403/2806] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 7 22:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 22:10:25.959876 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6ac33-864d-44e5-a8ba-273cebf80ded None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:25.960184 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6ac33-864d-44e5-a8ba-273cebf80ded None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:25.961023 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6ac33-864d-44e5-a8ba-273cebf80ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:25.997239 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-56c6ac33-864d-44e5-a8ba-273cebf80ded None None] MFA Rules not processed for user `1d5760a3f9f946978b1251d3e2aaa943`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:25.998481 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-56c6ac33-864d-44e5-a8ba-273cebf80ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:26.028607 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:26.064814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1404/2807] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 7 22:10:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:10:26.075688 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001227e-a7e5-4059-9cdb-5996e431ac6c None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:26.077387 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b001227e-a7e5-4059-9cdb-5996e431ac6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:26.091374 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001227e-a7e5-4059-9cdb-5996e431ac6c None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:26.094804 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354aae7-246d-4b58-bf7f-15b81d43f264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:26.095430 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354aae7-246d-4b58-bf7f-15b81d43f264 service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:26.095709 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354aae7-246d-4b58-bf7f-15b81d43f264 service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:26.095983 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354aae7-246d-4b58-bf7f-15b81d43f264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:26.106261 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354aae7-246d-4b58-bf7f-15b81d43f264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:26.107672 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354aae7-246d-4b58-bf7f-15b81d43f264 service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:26.118455 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1404/2808] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:10:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:10:29.317993 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6ac33-864d-44e5-a8ba-273cebf80ded None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:29.385283 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6ac33-864d-44e5-a8ba-273cebf80ded None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:29.390124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc654465-9dc2-4165-be37-6667ddc16f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:29.391061 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc654465-9dc2-4165-be37-6667ddc16f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:29.391414 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc654465-9dc2-4165-be37-6667ddc16f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:29.391749 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc654465-9dc2-4165-be37-6667ddc16f7d admin admin] PATH_INFO: `/v3/users/de92a3591ec64e1a8e082c4f4861c619` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:29.392989 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc654465-9dc2-4165-be37-6667ddc16f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de92a3591ec64e1a8e082c4f4861c619)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:29.394934 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc654465-9dc2-4165-be37-6667ddc16f7d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:29.442943 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cc654465-9dc2-4165-be37-6667ddc16f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de92a3591ec64e1a8e082c4f4861c619'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:29.449663 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cc654465-9dc2-4165-be37-6667ddc16f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de92a3591ec64e1a8e082c4f4861c619'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:29.456601 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cc654465-9dc2-4165-be37-6667ddc16f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de92a3591ec64e1a8e082c4f4861c619'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:29.457208 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cc654465-9dc2-4165-be37-6667ddc16f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de92a3591ec64e1a8e082c4f4861c619'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:29.457814 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cc654465-9dc2-4165-be37-6667ddc16f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de92a3591ec64e1a8e082c4f4861c619'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:29.475230 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1405/2809] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:10:29 2022] DELETE /identity/v3/users/de92a3591ec64e1a8e082c4f4861c619 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:10:29.480508 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550b691-d73f-4376-9abc-52ac9d36d568 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:29.481005 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550b691-d73f-4376-9abc-52ac9d36d568 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:29.481110 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550b691-d73f-4376-9abc-52ac9d36d568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:29.498469 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-9550b691-d73f-4376-9abc-52ac9d36d568 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:29.499655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9550b691-d73f-4376-9abc-52ac9d36d568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:29.556996 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1405/2810] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:10:29.566553 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc654465-9dc2-4165-be37-6667ddc16f7d admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:29.568004 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-cc654465-9dc2-4165-be37-6667ddc16f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:29.619477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:29.625530 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc654465-9dc2-4165-be37-6667ddc16f7d admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:29.629993 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51400470-deb1-4ff6-aad7-bde2a795cd63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:29.630645 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51400470-deb1-4ff6-aad7-bde2a795cd63 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:29.630968 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51400470-deb1-4ff6-aad7-bde2a795cd63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:29.631432 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51400470-deb1-4ff6-aad7-bde2a795cd63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:29.640462 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51400470-deb1-4ff6-aad7-bde2a795cd63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:29.641987 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51400470-deb1-4ff6-aad7-bde2a795cd63 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:29.652250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1406/2811] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:10:29.929512 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550b691-d73f-4376-9abc-52ac9d36d568 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:29.931254 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9550b691-d73f-4376-9abc-52ac9d36d568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:29.946571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550b691-d73f-4376-9abc-52ac9d36d568 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:29.951312 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:29.952164 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:29.952479 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:29.952930 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe admin admin] PATH_INFO: `/v3/projects/41b27809ea8c421aa0b12102151c4082` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:29.954217 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=41b27809ea8c421aa0b12102151c4082)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:29.956120 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:30.001288 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b27809ea8c421aa0b12102151c4082', 'request_id': 'req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:30.006844 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b27809ea8c421aa0b12102151c4082', 'request_id': 'req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:30.013455 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b27809ea8c421aa0b12102151c4082', 'request_id': 'req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:30.025671 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe admin admin] The token cache is being invalidate because project 41b27809ea8c421aa0b12102151c4082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:10:30.025973 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:30.026588 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:30.028128 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1406/2812] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:10:29 2022] DELETE /identity/v3/projects/41b27809ea8c421aa0b12102151c4082 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:10:30.032059 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51400470-deb1-4ff6-aad7-bde2a795cd63 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:30.041545 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51400470-deb1-4ff6-aad7-bde2a795cd63 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:30.097185 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f8be2-0f4f-434a-8da0-ea5ec2d9b075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:30.098090 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f8be2-0f4f-434a-8da0-ea5ec2d9b075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:30.098371 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f8be2-0f4f-434a-8da0-ea5ec2d9b075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:30.098649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f8be2-0f4f-434a-8da0-ea5ec2d9b075 admin admin] PATH_INFO: `/v3/users/7453981d6899419e989b0673943b3bfa` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:30.099844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f8be2-0f4f-434a-8da0-ea5ec2d9b075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7453981d6899419e989b0673943b3bfa)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:30.101750 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f8be2-0f4f-434a-8da0-ea5ec2d9b075 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:30.145812 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9f5f8be2-0f4f-434a-8da0-ea5ec2d9b075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7453981d6899419e989b0673943b3bfa'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:30.154998 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9f5f8be2-0f4f-434a-8da0-ea5ec2d9b075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7453981d6899419e989b0673943b3bfa'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:30.162116 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9f5f8be2-0f4f-434a-8da0-ea5ec2d9b075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7453981d6899419e989b0673943b3bfa'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:30.162730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9f5f8be2-0f4f-434a-8da0-ea5ec2d9b075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7453981d6899419e989b0673943b3bfa'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:30.163349 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9f5f8be2-0f4f-434a-8da0-ea5ec2d9b075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7453981d6899419e989b0673943b3bfa'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:30.181588 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1407/2813] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:10:30 2022] DELETE /identity/v3/users/7453981d6899419e989b0673943b3bfa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:10:30.447527 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:30.449012 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:30.462830 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1050bb-2df6-476a-8b75-2ce79ceb06fe admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:30.483761 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:30.527397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae80095-83ed-4817-bc94-1e81477d80f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:30.528386 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae80095-83ed-4817-bc94-1e81477d80f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:30.528674 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae80095-83ed-4817-bc94-1e81477d80f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:30.529826 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae80095-83ed-4817-bc94-1e81477d80f9 admin admin] PATH_INFO: `/v3/projects/1a58b10b05df42cd96f736e17095ddfb` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:30.534320 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae80095-83ed-4817-bc94-1e81477d80f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a58b10b05df42cd96f736e17095ddfb)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:30.539524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae80095-83ed-4817-bc94-1e81477d80f9 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:30.592722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-9ae80095-83ed-4817-bc94-1e81477d80f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a58b10b05df42cd96f736e17095ddfb', 'request_id': 'req-9ae80095-83ed-4817-bc94-1e81477d80f9'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:30.599131 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-9ae80095-83ed-4817-bc94-1e81477d80f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a58b10b05df42cd96f736e17095ddfb', 'request_id': 'req-9ae80095-83ed-4817-bc94-1e81477d80f9'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:30.606383 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-9ae80095-83ed-4817-bc94-1e81477d80f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a58b10b05df42cd96f736e17095ddfb', 'request_id': 'req-9ae80095-83ed-4817-bc94-1e81477d80f9'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:30.620192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-9ae80095-83ed-4817-bc94-1e81477d80f9 admin admin] The token cache is being invalidate because project 1a58b10b05df42cd96f736e17095ddfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:10:30.620479 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-9ae80095-83ed-4817-bc94-1e81477d80f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:30.621140 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-9ae80095-83ed-4817-bc94-1e81477d80f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:30.622733 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1407/2814] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:10:30 2022] DELETE /identity/v3/projects/1a58b10b05df42cd96f736e17095ddfb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:10:30.628844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f3a25-66b8-4cc3-b789-db7505016575 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:30.629351 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f3a25-66b8-4cc3-b789-db7505016575 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:30.629459 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f3a25-66b8-4cc3-b789-db7505016575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:30.647176 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-759f3a25-66b8-4cc3-b789-db7505016575 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:30.648381 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-759f3a25-66b8-4cc3-b789-db7505016575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:30.707496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1408/2815] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:10:30.716253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee1e7-db9d-49d5-9c09-dbb8bc04c406 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:30.716547 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee1e7-db9d-49d5-9c09-dbb8bc04c406 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:30.716831 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee1e7-db9d-49d5-9c09-dbb8bc04c406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:30.735694 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d43ee1e7-db9d-49d5-9c09-dbb8bc04c406 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:30.737192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d43ee1e7-db9d-49d5-9c09-dbb8bc04c406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:30.745548 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1408/2816] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:10:30.749598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f3a25-66b8-4cc3-b789-db7505016575 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:30.759348 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f3a25-66b8-4cc3-b789-db7505016575 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:30.763909 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cff99-4679-48be-bed0-aed3a461de43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:30.764551 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cff99-4679-48be-bed0-aed3a461de43 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:30.764835 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cff99-4679-48be-bed0-aed3a461de43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:30.765107 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cff99-4679-48be-bed0-aed3a461de43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:30.765821 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cff99-4679-48be-bed0-aed3a461de43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:10:30.766157 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cff99-4679-48be-bed0-aed3a461de43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:30.767759 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cff99-4679-48be-bed0-aed3a461de43 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:30.770073 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:30.784357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1409/2817] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:10:30.785562 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ee1e7-db9d-49d5-9c09-dbb8bc04c406 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:30.795679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ee1e7-db9d-49d5-9c09-dbb8bc04c406 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:30.800338 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e85e3-2f81-4af0-997c-75c7384909c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:30.800980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e85e3-2f81-4af0-997c-75c7384909c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:30.801269 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e85e3-2f81-4af0-997c-75c7384909c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:30.801549 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e85e3-2f81-4af0-997c-75c7384909c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:30.802276 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e85e3-2f81-4af0-997c-75c7384909c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:30.804788 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e85e3-2f81-4af0-997c-75c7384909c5 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:30.829911 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1409/2818] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:10:30 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:10:30.833768 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cff99-4679-48be-bed0-aed3a461de43 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:30.843585 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cff99-4679-48be-bed0-aed3a461de43 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:30.899539 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c86f46-98e6-43fb-8ff8-c2d249f68a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:30.900204 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c86f46-98e6-43fb-8ff8-c2d249f68a1d admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:30.900488 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c86f46-98e6-43fb-8ff8-c2d249f68a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:30.900762 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c86f46-98e6-43fb-8ff8-c2d249f68a1d admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:30.901443 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c86f46-98e6-43fb-8ff8-c2d249f68a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:30.903407 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c86f46-98e6-43fb-8ff8-c2d249f68a1d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:30.923299 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1410/2819] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:10:30 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:10:30.927277 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e85e3-2f81-4af0-997c-75c7384909c5 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:30.937945 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e85e3-2f81-4af0-997c-75c7384909c5 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:30.942847 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06305bd5-c2d8-46af-9db0-7fad553ff58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:30.943495 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06305bd5-c2d8-46af-9db0-7fad553ff58c admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:30.943779 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06305bd5-c2d8-46af-9db0-7fad553ff58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:30.944056 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06305bd5-c2d8-46af-9db0-7fad553ff58c admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:30.944804 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06305bd5-c2d8-46af-9db0-7fad553ff58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:30.946443 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06305bd5-c2d8-46af-9db0-7fad553ff58c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:30.957093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1410/2820] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:10:30.961341 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c86f46-98e6-43fb-8ff8-c2d249f68a1d admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:30.971080 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c86f46-98e6-43fb-8ff8-c2d249f68a1d admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:30.975656 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871c3dd-6df6-49f5-9930-e88287baecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:30.976916 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871c3dd-6df6-49f5-9930-e88287baecd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:30.977194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871c3dd-6df6-49f5-9930-e88287baecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:30.977467 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871c3dd-6df6-49f5-9930-e88287baecd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:30.978216 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871c3dd-6df6-49f5-9930-e88287baecd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:30.979789 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871c3dd-6df6-49f5-9930-e88287baecd2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:30.989957 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1411/2821] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:10:30.993785 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06305bd5-c2d8-46af-9db0-7fad553ff58c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:31.003478 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06305bd5-c2d8-46af-9db0-7fad553ff58c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:31.008243 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1155ac6-bd8c-4824-b95a-bdf4317cde43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:31.009104 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1155ac6-bd8c-4824-b95a-bdf4317cde43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:31.009382 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1155ac6-bd8c-4824-b95a-bdf4317cde43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:31.009655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1155ac6-bd8c-4824-b95a-bdf4317cde43 admin admin] PATH_INFO: `/v3/projects/9947b10bdeff4d32badaa0d08716c9c4/users/40ac9827735c4be78842a476fc6d1ed7/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:31.024264 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1155ac6-bd8c-4824-b95a-bdf4317cde43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9947b10bdeff4d32badaa0d08716c9c4, user_id=40ac9827735c4be78842a476fc6d1ed7, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:31.026904 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1155ac6-bd8c-4824-b95a-bdf4317cde43 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:31.039731 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1411/2822] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:10:30 2022] PUT /identity/v3/projects/9947b10bdeff4d32badaa0d08716c9c4/users/40ac9827735c4be78842a476fc6d1ed7/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:10:31.049848 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccbcc4-ee53-42d2-93c5-b6f9bf2fdedc None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:31.050168 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccbcc4-ee53-42d2-93c5-b6f9bf2fdedc None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:31.050445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccbcc4-ee53-42d2-93c5-b6f9bf2fdedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:31.075912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f6ccbcc4-ee53-42d2-93c5-b6f9bf2fdedc None None] MFA Rules not processed for user `40ac9827735c4be78842a476fc6d1ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:31.077086 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f6ccbcc4-ee53-42d2-93c5-b6f9bf2fdedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:31.139592 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1412/2823] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:10:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:10:31.150443 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1155ac6-bd8c-4824-b95a-bdf4317cde43 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:31.152137 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a1155ac6-bd8c-4824-b95a-bdf4317cde43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:31.205887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:31.229394 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1155ac6-bd8c-4824-b95a-bdf4317cde43 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:31.232897 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddca4f9-60f1-495d-87b7-129a8607e5f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a3c022963e74e989a703938ff057757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:31.233531 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddca4f9-60f1-495d-87b7-129a8607e5f6 service glance] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:31.233810 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddca4f9-60f1-495d-87b7-129a8607e5f6 service glance] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:31.234176 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddca4f9-60f1-495d-87b7-129a8607e5f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:31.243068 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddca4f9-60f1-495d-87b7-129a8607e5f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:31.244480 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddca4f9-60f1-495d-87b7-129a8607e5f6 service glance] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:31.253030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1412/2824] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:10:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:10:41.136672 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=68,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:41.249155 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=12 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:45.633019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccbcc4-ee53-42d2-93c5-b6f9bf2fdedc None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:45.693785 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccbcc4-ee53-42d2-93c5-b6f9bf2fdedc None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:45.698711 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c1e8b-1679-45a1-92a9-02afbc97cbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:45.699576 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c1e8b-1679-45a1-92a9-02afbc97cbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:45.699858 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c1e8b-1679-45a1-92a9-02afbc97cbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:45.700133 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c1e8b-1679-45a1-92a9-02afbc97cbba admin admin] PATH_INFO: `/v3/users/40ac9827735c4be78842a476fc6d1ed7` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:45.701294 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c1e8b-1679-45a1-92a9-02afbc97cbba admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ac9827735c4be78842a476fc6d1ed7)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:45.703228 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c1e8b-1679-45a1-92a9-02afbc97cbba admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:45.747252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5c3c1e8b-1679-45a1-92a9-02afbc97cbba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ac9827735c4be78842a476fc6d1ed7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:45.754030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5c3c1e8b-1679-45a1-92a9-02afbc97cbba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ac9827735c4be78842a476fc6d1ed7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:45.761489 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5c3c1e8b-1679-45a1-92a9-02afbc97cbba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ac9827735c4be78842a476fc6d1ed7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:45.762119 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5c3c1e8b-1679-45a1-92a9-02afbc97cbba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ac9827735c4be78842a476fc6d1ed7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:45.762721 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5c3c1e8b-1679-45a1-92a9-02afbc97cbba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ac9827735c4be78842a476fc6d1ed7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:45.780735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1413/2825] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:10:45 2022] DELETE /identity/v3/users/40ac9827735c4be78842a476fc6d1ed7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:10:45.785192 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ea0d-a427-47ca-ab86-98d531abefad None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:45.785625 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ea0d-a427-47ca-ab86-98d531abefad None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:45.785750 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ea0d-a427-47ca-ab86-98d531abefad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:45.803040 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-8675ea0d-a427-47ca-ab86-98d531abefad None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:45.804265 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8675ea0d-a427-47ca-ab86-98d531abefad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:45.861669 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1413/2826] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:10:45.871369 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c1e8b-1679-45a1-92a9-02afbc97cbba admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:45.872836 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5c3c1e8b-1679-45a1-92a9-02afbc97cbba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:45.929844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c1e8b-1679-45a1-92a9-02afbc97cbba admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:45.933402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9890c-1994-4e7e-8b09-8168f0d8b57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:45.934061 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9890c-1994-4e7e-8b09-8168f0d8b57c service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:45.934341 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9890c-1994-4e7e-8b09-8168f0d8b57c service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:45.934611 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9890c-1994-4e7e-8b09-8168f0d8b57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:45.943351 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9890c-1994-4e7e-8b09-8168f0d8b57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:45.944802 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9890c-1994-4e7e-8b09-8168f0d8b57c service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:45.954022 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1414/2827] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:10:46.212426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675ea0d-a427-47ca-ab86-98d531abefad None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:46.214218 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-8675ea0d-a427-47ca-ab86-98d531abefad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:46.230465 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675ea0d-a427-47ca-ab86-98d531abefad None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:46.236182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259a2ce-c67c-4df6-be0f-0d9b3b7e1141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:46.237291 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259a2ce-c67c-4df6-be0f-0d9b3b7e1141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:46.237570 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259a2ce-c67c-4df6-be0f-0d9b3b7e1141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:46.237841 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259a2ce-c67c-4df6-be0f-0d9b3b7e1141 admin admin] PATH_INFO: `/v3/projects/9947b10bdeff4d32badaa0d08716c9c4` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:46.239035 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259a2ce-c67c-4df6-be0f-0d9b3b7e1141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9947b10bdeff4d32badaa0d08716c9c4)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:46.240917 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259a2ce-c67c-4df6-be0f-0d9b3b7e1141 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:46.286972 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b259a2ce-c67c-4df6-be0f-0d9b3b7e1141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9947b10bdeff4d32badaa0d08716c9c4', 'request_id': 'req-b259a2ce-c67c-4df6-be0f-0d9b3b7e1141'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:46.293370 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b259a2ce-c67c-4df6-be0f-0d9b3b7e1141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9947b10bdeff4d32badaa0d08716c9c4', 'request_id': 'req-b259a2ce-c67c-4df6-be0f-0d9b3b7e1141'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:46.299422 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b259a2ce-c67c-4df6-be0f-0d9b3b7e1141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9947b10bdeff4d32badaa0d08716c9c4', 'request_id': 'req-b259a2ce-c67c-4df6-be0f-0d9b3b7e1141'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:46.310957 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b259a2ce-c67c-4df6-be0f-0d9b3b7e1141 admin admin] The token cache is being invalidate because project 9947b10bdeff4d32badaa0d08716c9c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:10:46.311241 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b259a2ce-c67c-4df6-be0f-0d9b3b7e1141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:46.311851 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-b259a2ce-c67c-4df6-be0f-0d9b3b7e1141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:10:46.313364 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1414/2828] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:10:46 2022] DELETE /identity/v3/projects/9947b10bdeff4d32badaa0d08716c9c4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:10:46.318254 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad669228-2071-452d-acf6-fbdfd0076ffb None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:46.318541 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad669228-2071-452d-acf6-fbdfd0076ffb None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:46.318849 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad669228-2071-452d-acf6-fbdfd0076ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:46.337065 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ad669228-2071-452d-acf6-fbdfd0076ffb None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:46.338269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ad669228-2071-452d-acf6-fbdfd0076ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:46.354566 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:46.399289 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1415/2829] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:10:46.407112 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f5806-6e63-4888-a118-c009da3952dc None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:46.407468 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f5806-6e63-4888-a118-c009da3952dc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:46.407752 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f5806-6e63-4888-a118-c009da3952dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:46.425485 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-c92f5806-6e63-4888-a118-c009da3952dc None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:46.426722 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c92f5806-6e63-4888-a118-c009da3952dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:46.434651 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1415/2830] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:10:46.438816 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad669228-2071-452d-acf6-fbdfd0076ffb None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:46.448938 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad669228-2071-452d-acf6-fbdfd0076ffb None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:46.453460 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa54b2a-db64-42e0-ad0d-9f4f5b0f462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:46.454137 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa54b2a-db64-42e0-ad0d-9f4f5b0f462c admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:46.454418 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa54b2a-db64-42e0-ad0d-9f4f5b0f462c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:46.454693 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa54b2a-db64-42e0-ad0d-9f4f5b0f462c admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:46.455408 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa54b2a-db64-42e0-ad0d-9f4f5b0f462c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:10:46.455715 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa54b2a-db64-42e0-ad0d-9f4f5b0f462c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:46.457303 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa54b2a-db64-42e0-ad0d-9f4f5b0f462c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:46.469421 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1416/2831] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:10:46.473600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f5806-6e63-4888-a118-c009da3952dc None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:46.482757 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f5806-6e63-4888-a118-c009da3952dc None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:46.487612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ede2f-e824-41b2-995b-c75f1346d034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:46.488307 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ede2f-e824-41b2-995b-c75f1346d034 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:46.488591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ede2f-e824-41b2-995b-c75f1346d034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:46.488868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ede2f-e824-41b2-995b-c75f1346d034 admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:46.489550 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ede2f-e824-41b2-995b-c75f1346d034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:46.491498 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ede2f-e824-41b2-995b-c75f1346d034 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:46.516232 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1416/2832] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:10:46 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:10:46.520402 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa54b2a-db64-42e0-ad0d-9f4f5b0f462c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:46.531020 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa54b2a-db64-42e0-ad0d-9f4f5b0f462c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:46.585768 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69725b50-ff9e-4b62-8167-d68ec0c1a74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:46.586445 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69725b50-ff9e-4b62-8167-d68ec0c1a74c admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:46.586727 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69725b50-ff9e-4b62-8167-d68ec0c1a74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:46.587001 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69725b50-ff9e-4b62-8167-d68ec0c1a74c admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:46.587691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69725b50-ff9e-4b62-8167-d68ec0c1a74c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:46.589627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69725b50-ff9e-4b62-8167-d68ec0c1a74c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:46.607926 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1417/2833] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:10:46 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:10:46.612348 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ede2f-e824-41b2-995b-c75f1346d034 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:46.622675 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ede2f-e824-41b2-995b-c75f1346d034 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:46.627343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82eb8c-e277-416e-9daf-107f1ad8b64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:46.627985 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82eb8c-e277-416e-9daf-107f1ad8b64e admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:46.628265 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82eb8c-e277-416e-9daf-107f1ad8b64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:46.628539 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82eb8c-e277-416e-9daf-107f1ad8b64e admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:46.629257 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82eb8c-e277-416e-9daf-107f1ad8b64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:46.630868 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82eb8c-e277-416e-9daf-107f1ad8b64e admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:46.641764 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1417/2834] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:10:46.645474 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69725b50-ff9e-4b62-8167-d68ec0c1a74c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:46.655946 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69725b50-ff9e-4b62-8167-d68ec0c1a74c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:46.660406 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637c630-21d1-4d67-b72e-175492c5de06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:46.661045 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637c630-21d1-4d67-b72e-175492c5de06 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:46.661327 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637c630-21d1-4d67-b72e-175492c5de06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:46.661605 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637c630-21d1-4d67-b72e-175492c5de06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:46.662356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637c630-21d1-4d67-b72e-175492c5de06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:46.664000 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637c630-21d1-4d67-b72e-175492c5de06 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:46.673752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1418/2835] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:10:46.677615 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82eb8c-e277-416e-9daf-107f1ad8b64e admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:46.688400 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82eb8c-e277-416e-9daf-107f1ad8b64e admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:46.692928 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb9187-9fda-479d-9482-e9fc66b6c6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:46.693799 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb9187-9fda-479d-9482-e9fc66b6c6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:46.694703 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb9187-9fda-479d-9482-e9fc66b6c6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:46.695094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb9187-9fda-479d-9482-e9fc66b6c6b3 admin admin] PATH_INFO: `/v3/projects/141ed886a79747e5addcc84825ccf9d0/users/337de57e01bd401c9dadb0646f17b736/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:46.709961 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb9187-9fda-479d-9482-e9fc66b6c6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=141ed886a79747e5addcc84825ccf9d0, user_id=337de57e01bd401c9dadb0646f17b736, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:46.713255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb9187-9fda-479d-9482-e9fc66b6c6b3 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:46.725341 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1418/2836] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:10:46 2022] PUT /identity/v3/projects/141ed886a79747e5addcc84825ccf9d0/users/337de57e01bd401c9dadb0646f17b736/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:10:46.786930 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7242c4-66ef-4340-b1d2-6f9f835003da None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:46.787217 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7242c4-66ef-4340-b1d2-6f9f835003da None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:46.787492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7242c4-66ef-4340-b1d2-6f9f835003da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:46.814297 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1a7242c4-66ef-4340-b1d2-6f9f835003da None None] MFA Rules not processed for user `337de57e01bd401c9dadb0646f17b736`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:10:46.815481 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1a7242c4-66ef-4340-b1d2-6f9f835003da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:46.877206 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1419/2837] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:10:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:10:46.888943 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb9187-9fda-479d-9482-e9fc66b6c6b3 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:10:46.890778 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b3fb9187-9fda-479d-9482-e9fc66b6c6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:10:46.912343 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:46.949902 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb9187-9fda-479d-9482-e9fc66b6c6b3 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:10:46.953529 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09536d-23b6-48af-83ce-042a2de0b121 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a3c022963e74e989a703938ff057757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:10:46.954193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09536d-23b6-48af-83ce-042a2de0b121 service glance] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:10:46.954473 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09536d-23b6-48af-83ce-042a2de0b121 service glance] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:10:46.954744 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09536d-23b6-48af-83ce-042a2de0b121 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:10:46.963056 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09536d-23b6-48af-83ce-042a2de0b121 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:10:46.964467 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09536d-23b6-48af-83ce-042a2de0b121 service glance] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:10:46.973138 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1419/2838] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:10:46 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:10:56.874338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:10:56.969126 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=17 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:08.330149 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7242c4-66ef-4340-b1d2-6f9f835003da None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:08.393280 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7242c4-66ef-4340-b1d2-6f9f835003da None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:08.397803 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880c1d5-824f-4b03-8ae0-981bba3e3822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:08.398704 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880c1d5-824f-4b03-8ae0-981bba3e3822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:08.398983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880c1d5-824f-4b03-8ae0-981bba3e3822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:08.399253 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880c1d5-824f-4b03-8ae0-981bba3e3822 admin admin] PATH_INFO: `/v3/users/337de57e01bd401c9dadb0646f17b736` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:08.400493 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880c1d5-824f-4b03-8ae0-981bba3e3822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=337de57e01bd401c9dadb0646f17b736)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:08.402455 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880c1d5-824f-4b03-8ae0-981bba3e3822 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:08.454170 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2880c1d5-824f-4b03-8ae0-981bba3e3822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '337de57e01bd401c9dadb0646f17b736'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:08.461093 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2880c1d5-824f-4b03-8ae0-981bba3e3822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '337de57e01bd401c9dadb0646f17b736'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:08.468275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2880c1d5-824f-4b03-8ae0-981bba3e3822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '337de57e01bd401c9dadb0646f17b736'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:08.468896 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2880c1d5-824f-4b03-8ae0-981bba3e3822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '337de57e01bd401c9dadb0646f17b736'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:08.469496 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2880c1d5-824f-4b03-8ae0-981bba3e3822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '337de57e01bd401c9dadb0646f17b736'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:08.486603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1420/2839] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:11:08 2022] DELETE /identity/v3/users/337de57e01bd401c9dadb0646f17b736 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:11:08.491640 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be0fcd-8e34-4915-8924-96a4c701954b None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:08.492145 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be0fcd-8e34-4915-8924-96a4c701954b None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:08.492248 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be0fcd-8e34-4915-8924-96a4c701954b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:08.510432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-81be0fcd-8e34-4915-8924-96a4c701954b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:08.511618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-81be0fcd-8e34-4915-8924-96a4c701954b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:08.568612 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1420/2840] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:11:08.578915 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880c1d5-824f-4b03-8ae0-981bba3e3822 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:08.580307 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2880c1d5-824f-4b03-8ae0-981bba3e3822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:08.636491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880c1d5-824f-4b03-8ae0-981bba3e3822 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:08.640106 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68295b-1861-4992-81b6-be9f1b320fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:08.640732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68295b-1861-4992-81b6-be9f1b320fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:08.641007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68295b-1861-4992-81b6-be9f1b320fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:08.641275 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68295b-1861-4992-81b6-be9f1b320fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:08.650057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68295b-1861-4992-81b6-be9f1b320fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:08.651492 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68295b-1861-4992-81b6-be9f1b320fe6 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:08.661382 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1421/2841] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:11:08.928597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be0fcd-8e34-4915-8924-96a4c701954b None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:08.930072 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-81be0fcd-8e34-4915-8924-96a4c701954b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:08.942820 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be0fcd-8e34-4915-8924-96a4c701954b None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:08.947648 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44a6b0-77d6-412e-835b-1fec0c4ccb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:08.948513 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44a6b0-77d6-412e-835b-1fec0c4ccb70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:08.948791 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44a6b0-77d6-412e-835b-1fec0c4ccb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:08.949070 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44a6b0-77d6-412e-835b-1fec0c4ccb70 admin admin] PATH_INFO: `/v3/projects/141ed886a79747e5addcc84825ccf9d0` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:08.950285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44a6b0-77d6-412e-835b-1fec0c4ccb70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=141ed886a79747e5addcc84825ccf9d0)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:08.952182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44a6b0-77d6-412e-835b-1fec0c4ccb70 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:08.999002 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-dc44a6b0-77d6-412e-835b-1fec0c4ccb70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141ed886a79747e5addcc84825ccf9d0', 'request_id': 'req-dc44a6b0-77d6-412e-835b-1fec0c4ccb70'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:09.004368 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-dc44a6b0-77d6-412e-835b-1fec0c4ccb70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141ed886a79747e5addcc84825ccf9d0', 'request_id': 'req-dc44a6b0-77d6-412e-835b-1fec0c4ccb70'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:09.010361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-dc44a6b0-77d6-412e-835b-1fec0c4ccb70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141ed886a79747e5addcc84825ccf9d0', 'request_id': 'req-dc44a6b0-77d6-412e-835b-1fec0c4ccb70'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:09.022299 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-dc44a6b0-77d6-412e-835b-1fec0c4ccb70 admin admin] The token cache is being invalidate because project 141ed886a79747e5addcc84825ccf9d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:11:09.022576 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-dc44a6b0-77d6-412e-835b-1fec0c4ccb70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:09.023182 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-dc44a6b0-77d6-412e-835b-1fec0c4ccb70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:09.024806 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1421/2842] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:11:08 2022] DELETE /identity/v3/projects/141ed886a79747e5addcc84825ccf9d0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:11:09.029950 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff555304-e5a9-4149-b42b-5e1b74b401af None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:09.030250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff555304-e5a9-4149-b42b-5e1b74b401af None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:09.030524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff555304-e5a9-4149-b42b-5e1b74b401af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:09.048725 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ff555304-e5a9-4149-b42b-5e1b74b401af None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:09.049902 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ff555304-e5a9-4149-b42b-5e1b74b401af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:09.066649 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:09.110357 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1422/2843] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:11:09.118541 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7925db9-e41e-4be4-8c1d-e00e0c4606b1 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:09.118853 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7925db9-e41e-4be4-8c1d-e00e0c4606b1 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:09.119130 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7925db9-e41e-4be4-8c1d-e00e0c4606b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:09.137075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-d7925db9-e41e-4be4-8c1d-e00e0c4606b1 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:09.138311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d7925db9-e41e-4be4-8c1d-e00e0c4606b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:09.146144 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1422/2844] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:11:09.150070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff555304-e5a9-4149-b42b-5e1b74b401af None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:09.160057 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff555304-e5a9-4149-b42b-5e1b74b401af None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:09.164515 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf03f41-367e-44aa-abd6-24472492fb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:09.165145 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf03f41-367e-44aa-abd6-24472492fb3e admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:09.165423 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf03f41-367e-44aa-abd6-24472492fb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:09.165693 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf03f41-367e-44aa-abd6-24472492fb3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:09.167089 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf03f41-367e-44aa-abd6-24472492fb3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:11:09.167391 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf03f41-367e-44aa-abd6-24472492fb3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:09.168983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf03f41-367e-44aa-abd6-24472492fb3e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:09.180158 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1423/2845] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:11:09.184135 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7925db9-e41e-4be4-8c1d-e00e0c4606b1 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:09.193413 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7925db9-e41e-4be4-8c1d-e00e0c4606b1 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:09.198058 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d06c8-804e-4443-b605-ac697bc8453c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:09.198697 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d06c8-804e-4443-b605-ac697bc8453c admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:09.198978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d06c8-804e-4443-b605-ac697bc8453c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:09.199255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d06c8-804e-4443-b605-ac697bc8453c admin admin] PATH_INFO: `/v3/projects` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:09.199954 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d06c8-804e-4443-b605-ac697bc8453c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:09.201838 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d06c8-804e-4443-b605-ac697bc8453c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:09.227867 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1423/2846] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:11:09 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 22:11:09.232454 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf03f41-367e-44aa-abd6-24472492fb3e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:09.242487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf03f41-367e-44aa-abd6-24472492fb3e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:09.296874 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead945d-dbbd-4147-a8a3-9001d8e6b401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:09.297518 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead945d-dbbd-4147-a8a3-9001d8e6b401 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:09.297795 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead945d-dbbd-4147-a8a3-9001d8e6b401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:09.298096 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead945d-dbbd-4147-a8a3-9001d8e6b401 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:09.298810 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead945d-dbbd-4147-a8a3-9001d8e6b401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:09.300691 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead945d-dbbd-4147-a8a3-9001d8e6b401 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:09.320234 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1424/2847] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:11:09 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:11:09.324401 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d06c8-804e-4443-b605-ac697bc8453c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:09.334495 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d06c8-804e-4443-b605-ac697bc8453c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:09.339583 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9bb2f-cc81-4e01-ab1d-594c1fad96e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:09.340231 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9bb2f-cc81-4e01-ab1d-594c1fad96e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:09.340514 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9bb2f-cc81-4e01-ab1d-594c1fad96e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:09.340790 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9bb2f-cc81-4e01-ab1d-594c1fad96e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:09.341512 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9bb2f-cc81-4e01-ab1d-594c1fad96e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:09.343140 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9bb2f-cc81-4e01-ab1d-594c1fad96e1 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:09.355743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1424/2848] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:11:09.358458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead945d-dbbd-4147-a8a3-9001d8e6b401 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:09.368845 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead945d-dbbd-4147-a8a3-9001d8e6b401 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:09.373566 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b47ca-6644-42ad-8e41-5b363eb617db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:09.374252 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b47ca-6644-42ad-8e41-5b363eb617db admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:09.374533 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b47ca-6644-42ad-8e41-5b363eb617db admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:09.374804 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b47ca-6644-42ad-8e41-5b363eb617db admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:09.375547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b47ca-6644-42ad-8e41-5b363eb617db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:09.377124 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b47ca-6644-42ad-8e41-5b363eb617db admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:09.387031 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1425/2849] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:11:09.391080 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9bb2f-cc81-4e01-ab1d-594c1fad96e1 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:09.401828 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9bb2f-cc81-4e01-ab1d-594c1fad96e1 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:09.406420 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f394f-6e35-4d04-9383-c75fba3d62a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:09.407282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f394f-6e35-4d04-9383-c75fba3d62a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:09.407562 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f394f-6e35-4d04-9383-c75fba3d62a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:09.407836 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f394f-6e35-4d04-9383-c75fba3d62a6 admin admin] PATH_INFO: `/v3/projects/104e4c566f004f269fa6efa172700641/users/11d7db4b4325463ca96f8dbd964b42ee/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:09.422571 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f394f-6e35-4d04-9383-c75fba3d62a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104e4c566f004f269fa6efa172700641, user_id=11d7db4b4325463ca96f8dbd964b42ee, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:09.425199 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f394f-6e35-4d04-9383-c75fba3d62a6 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:09.437837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1425/2850] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:11:09 2022] PUT /identity/v3/projects/104e4c566f004f269fa6efa172700641/users/11d7db4b4325463ca96f8dbd964b42ee/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:11:09.449050 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace85867-6de6-4c35-9bca-5de56f5586cd None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:09.449339 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace85867-6de6-4c35-9bca-5de56f5586cd None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:09.449615 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace85867-6de6-4c35-9bca-5de56f5586cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:09.475721 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ace85867-6de6-4c35-9bca-5de56f5586cd None None] MFA Rules not processed for user `11d7db4b4325463ca96f8dbd964b42ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:09.476905 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ace85867-6de6-4c35-9bca-5de56f5586cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:09.539408 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1426/2851] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:11:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:11:09.549980 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f394f-6e35-4d04-9383-c75fba3d62a6 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:09.551730 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-995f394f-6e35-4d04-9383-c75fba3d62a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:09.573632 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:09.610071 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f394f-6e35-4d04-9383-c75fba3d62a6 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:09.613970 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3941f9-f916-426b-85d5-38374e38ccb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5688ba6551834757b7eeef45a15f16e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:09.614613 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3941f9-f916-426b-85d5-38374e38ccb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:09.614896 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3941f9-f916-426b-85d5-38374e38ccb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:09.615175 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3941f9-f916-426b-85d5-38374e38ccb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:09.623657 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3941f9-f916-426b-85d5-38374e38ccb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:09.625031 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3941f9-f916-426b-85d5-38374e38ccb2 service cinder] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:09.634121 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1426/2852] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:11:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:11:10.962171 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d63764-719b-422c-9761-e6817ba213ba None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:10.963138 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d63764-719b-422c-9761-e6817ba213ba None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:10.963269 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d63764-719b-422c-9761-e6817ba213ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:10.981019 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b3d63764-719b-422c-9761-e6817ba213ba None None] MFA Rules not processed for user `11d7db4b4325463ca96f8dbd964b42ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:10.982226 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b3d63764-719b-422c-9761-e6817ba213ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:10.989250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1427/2853] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:11:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:11:19.629874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=17 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:20.975131 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:25.832793 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f00c8-e3fb-4e33-8302-cbedff3455f2 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:25.833274 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f00c8-e3fb-4e33-8302-cbedff3455f2 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:25.833380 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f00c8-e3fb-4e33-8302-cbedff3455f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:25.850887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-0e6f00c8-e3fb-4e33-8302-cbedff3455f2 None None] MFA Rules not processed for user `4fc55e3a9107489a9b24385ac5379ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:25.852181 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0e6f00c8-e3fb-4e33-8302-cbedff3455f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:25.907432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1427/2854] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 7 22:11:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:11:25.952811 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d63764-719b-422c-9761-e6817ba213ba None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:25.954344 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b3d63764-719b-422c-9761-e6817ba213ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:26.021594 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d63764-719b-422c-9761-e6817ba213ba None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:26.026438 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf648d9-52c6-4888-b193-3fe4e53846d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b69c708fbc470aae3e3954e21a1e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:26.027070 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf648d9-52c6-4888-b193-3fe4e53846d4 service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:26.027350 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf648d9-52c6-4888-b193-3fe4e53846d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:26.027622 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf648d9-52c6-4888-b193-3fe4e53846d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:26.035504 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf648d9-52c6-4888-b193-3fe4e53846d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:26.037080 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf648d9-52c6-4888-b193-3fe4e53846d4 service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:26.045641 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1428/2855] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 7 22:11:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 22:11:26.525987 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2257d43-0eca-431c-b06d-02170d887722 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:26.526225 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2257d43-0eca-431c-b06d-02170d887722 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:26.526498 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2257d43-0eca-431c-b06d-02170d887722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:26.544381 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-b2257d43-0eca-431c-b06d-02170d887722 None None] MFA Rules not processed for user `4fc55e3a9107489a9b24385ac5379ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:26.545551 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-b2257d43-0eca-431c-b06d-02170d887722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:26.552552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1428/2856] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jun 7 22:11:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:11:26.564246 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf648d9-52c6-4888-b193-3fe4e53846d4 service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:26.574696 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf648d9-52c6-4888-b193-3fe4e53846d4 service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:26.585707 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c12419-f130-456d-bb9e-ab7f228d64e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b69c708fbc470aae3e3954e21a1e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:26.586400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c12419-f130-456d-bb9e-ab7f228d64e2 service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:26.586680 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c12419-f130-456d-bb9e-ab7f228d64e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:26.586953 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c12419-f130-456d-bb9e-ab7f228d64e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:26.596603 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c12419-f130-456d-bb9e-ab7f228d64e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:26.598207 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c12419-f130-456d-bb9e-ab7f228d64e2 service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:26.606732 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1429/2857] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 7 22:11:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 22:11:26.788582 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113ff9b-0d28-422a-8ab3-9ec68ff15d76 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:26.788888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113ff9b-0d28-422a-8ab3-9ec68ff15d76 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:26.789164 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113ff9b-0d28-422a-8ab3-9ec68ff15d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:26.806438 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-a113ff9b-0d28-422a-8ab3-9ec68ff15d76 None None] MFA Rules not processed for user `4fc55e3a9107489a9b24385ac5379ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:26.807610 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a113ff9b-0d28-422a-8ab3-9ec68ff15d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:26.815044 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1429/2858] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 7 22:11:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:11:26.827200 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c12419-f130-456d-bb9e-ab7f228d64e2 service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:26.837795 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c12419-f130-456d-bb9e-ab7f228d64e2 service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:26.843434 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad242da0-bbd8-4151-babd-fac36b6b3a4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b69c708fbc470aae3e3954e21a1e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:26.844059 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad242da0-bbd8-4151-babd-fac36b6b3a4c service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:26.844338 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad242da0-bbd8-4151-babd-fac36b6b3a4c service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:26.844610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad242da0-bbd8-4151-babd-fac36b6b3a4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:26.852662 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad242da0-bbd8-4151-babd-fac36b6b3a4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:26.854259 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad242da0-bbd8-4151-babd-fac36b6b3a4c service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:26.862358 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1430/2859] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 7 22:11:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 22:11:27.166499 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5452b-ac96-43a8-a90e-a4fd10ea98d3 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:27.166941 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5452b-ac96-43a8-a90e-a4fd10ea98d3 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:27.167061 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5452b-ac96-43a8-a90e-a4fd10ea98d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:27.185885 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-5bc5452b-ac96-43a8-a90e-a4fd10ea98d3 None None] MFA Rules not processed for user `4fc55e3a9107489a9b24385ac5379ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:27.187208 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-5bc5452b-ac96-43a8-a90e-a4fd10ea98d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:27.194298 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1430/2860] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jun 7 22:11:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:11:27.206698 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad242da0-bbd8-4151-babd-fac36b6b3a4c service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:27.218542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad242da0-bbd8-4151-babd-fac36b6b3a4c service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:27.224026 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56f793-e256-4a45-bcf0-1e0982473c73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b69c708fbc470aae3e3954e21a1e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:27.224655 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56f793-e256-4a45-bcf0-1e0982473c73 service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:27.224937 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56f793-e256-4a45-bcf0-1e0982473c73 service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:27.225212 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56f793-e256-4a45-bcf0-1e0982473c73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:27.233400 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56f793-e256-4a45-bcf0-1e0982473c73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:27.234980 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56f793-e256-4a45-bcf0-1e0982473c73 service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:27.243264 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1431/2861] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 7 22:11:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 22:11:29.448528 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5452b-ac96-43a8-a90e-a4fd10ea98d3 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:29.509332 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5452b-ac96-43a8-a90e-a4fd10ea98d3 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:29.513774 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a201d0-34b9-415b-aa65-a23f5b66ca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:29.514654 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a201d0-34b9-415b-aa65-a23f5b66ca52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:29.514935 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a201d0-34b9-415b-aa65-a23f5b66ca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:29.515206 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a201d0-34b9-415b-aa65-a23f5b66ca52 admin admin] PATH_INFO: `/v3/users/11d7db4b4325463ca96f8dbd964b42ee` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:29.516368 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a201d0-34b9-415b-aa65-a23f5b66ca52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d7db4b4325463ca96f8dbd964b42ee)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:29.518306 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a201d0-34b9-415b-aa65-a23f5b66ca52 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:29.564377 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f4a201d0-34b9-415b-aa65-a23f5b66ca52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d7db4b4325463ca96f8dbd964b42ee'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:29.571255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f4a201d0-34b9-415b-aa65-a23f5b66ca52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d7db4b4325463ca96f8dbd964b42ee'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:29.571911 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f4a201d0-34b9-415b-aa65-a23f5b66ca52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d7db4b4325463ca96f8dbd964b42ee'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:29.579034 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f4a201d0-34b9-415b-aa65-a23f5b66ca52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d7db4b4325463ca96f8dbd964b42ee'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:29.579639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-f4a201d0-34b9-415b-aa65-a23f5b66ca52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d7db4b4325463ca96f8dbd964b42ee'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:29.596800 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1431/2862] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:11:29 2022] DELETE /identity/v3/users/11d7db4b4325463ca96f8dbd964b42ee => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:11:29.601288 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b830d-39fc-465d-9bfc-3da492e1ee1b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:29.601802 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b830d-39fc-465d-9bfc-3da492e1ee1b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:29.601910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b830d-39fc-465d-9bfc-3da492e1ee1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:29.620232 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-654b830d-39fc-465d-9bfc-3da492e1ee1b None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:29.621427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-654b830d-39fc-465d-9bfc-3da492e1ee1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:29.679092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1432/2863] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:11:29.688576 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a201d0-34b9-415b-aa65-a23f5b66ca52 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:29.689990 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-f4a201d0-34b9-415b-aa65-a23f5b66ca52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:29.696426 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:29.748439 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a201d0-34b9-415b-aa65-a23f5b66ca52 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:29.752065 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591af9b-9fda-409d-a57f-c88b1883423d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:29.752696 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591af9b-9fda-409d-a57f-c88b1883423d service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:29.752978 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591af9b-9fda-409d-a57f-c88b1883423d service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:29.753252 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591af9b-9fda-409d-a57f-c88b1883423d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:29.762808 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591af9b-9fda-409d-a57f-c88b1883423d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:29.764237 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591af9b-9fda-409d-a57f-c88b1883423d service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:29.773536 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1432/2864] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:11:29.938805 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b830d-39fc-465d-9bfc-3da492e1ee1b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:29.940580 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-654b830d-39fc-465d-9bfc-3da492e1ee1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:29.953292 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b830d-39fc-465d-9bfc-3da492e1ee1b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:29.957949 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351fdf0-1e50-47d3-bbc8-d4222bdf6a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:29.958806 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351fdf0-1e50-47d3-bbc8-d4222bdf6a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:29.959081 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351fdf0-1e50-47d3-bbc8-d4222bdf6a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:29.959348 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351fdf0-1e50-47d3-bbc8-d4222bdf6a8f admin admin] PATH_INFO: `/v3/projects/104e4c566f004f269fa6efa172700641` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:29.960519 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351fdf0-1e50-47d3-bbc8-d4222bdf6a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=104e4c566f004f269fa6efa172700641)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:29.962457 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351fdf0-1e50-47d3-bbc8-d4222bdf6a8f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:30.006748 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:30.010352 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0351fdf0-1e50-47d3-bbc8-d4222bdf6a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104e4c566f004f269fa6efa172700641', 'request_id': 'req-0351fdf0-1e50-47d3-bbc8-d4222bdf6a8f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:30.017624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0351fdf0-1e50-47d3-bbc8-d4222bdf6a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104e4c566f004f269fa6efa172700641', 'request_id': 'req-0351fdf0-1e50-47d3-bbc8-d4222bdf6a8f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:30.023094 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0351fdf0-1e50-47d3-bbc8-d4222bdf6a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104e4c566f004f269fa6efa172700641', 'request_id': 'req-0351fdf0-1e50-47d3-bbc8-d4222bdf6a8f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:30.035024 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0351fdf0-1e50-47d3-bbc8-d4222bdf6a8f admin admin] The token cache is being invalidate because project 104e4c566f004f269fa6efa172700641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:11:30.035311 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0351fdf0-1e50-47d3-bbc8-d4222bdf6a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:30.035929 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0351fdf0-1e50-47d3-bbc8-d4222bdf6a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:11:30.037456 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1433/2865] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:11:29 2022] DELETE /identity/v3/projects/104e4c566f004f269fa6efa172700641 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:11:30.042448 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3efff-87b6-4dc4-bab9-e51cae4758c7 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:30.042833 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3efff-87b6-4dc4-bab9-e51cae4758c7 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:30.043177 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3efff-87b6-4dc4-bab9-e51cae4758c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:30.060759 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-cfd3efff-87b6-4dc4-bab9-e51cae4758c7 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:30.061966 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-cfd3efff-87b6-4dc4-bab9-e51cae4758c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:30.119854 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1433/2866] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:11:30.128296 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16940ab-0d6c-47c8-aecf-e748cfdb9c14 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:30.128611 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16940ab-0d6c-47c8-aecf-e748cfdb9c14 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:30.128887 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16940ab-0d6c-47c8-aecf-e748cfdb9c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:30.147143 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e16940ab-0d6c-47c8-aecf-e748cfdb9c14 None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:30.148306 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e16940ab-0d6c-47c8-aecf-e748cfdb9c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:30.156588 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1434/2867] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:11:30.160618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3efff-87b6-4dc4-bab9-e51cae4758c7 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:30.170783 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3efff-87b6-4dc4-bab9-e51cae4758c7 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:30.175319 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b55387-01e6-4dd8-a387-5ed841d428bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:30.175986 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b55387-01e6-4dd8-a387-5ed841d428bb admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:30.176268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b55387-01e6-4dd8-a387-5ed841d428bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:30.176566 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b55387-01e6-4dd8-a387-5ed841d428bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:30.177281 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b55387-01e6-4dd8-a387-5ed841d428bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 22:11:30.177585 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b55387-01e6-4dd8-a387-5ed841d428bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:30.179199 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b55387-01e6-4dd8-a387-5ed841d428bb admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:30.190590 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1434/2868] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 7 22:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 22:11:30.194741 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16940ab-0d6c-47c8-aecf-e748cfdb9c14 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:30.203762 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16940ab-0d6c-47c8-aecf-e748cfdb9c14 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:30.208312 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b38c2d-5b24-4fb6-b511-475e3d110b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:30.208939 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b38c2d-5b24-4fb6-b511-475e3d110b33 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:30.209219 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b38c2d-5b24-4fb6-b511-475e3d110b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:30.209487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b38c2d-5b24-4fb6-b511-475e3d110b33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:30.210195 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b38c2d-5b24-4fb6-b511-475e3d110b33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:30.212089 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b38c2d-5b24-4fb6-b511-475e3d110b33 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:30.238801 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1435/2869] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:11:30 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:11:30.242755 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b55387-01e6-4dd8-a387-5ed841d428bb admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:30.252544 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b55387-01e6-4dd8-a387-5ed841d428bb admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:30.307134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c85fd-918a-4031-b2b0-8e855b8bba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:30.307833 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c85fd-918a-4031-b2b0-8e855b8bba1c admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:30.308073 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c85fd-918a-4031-b2b0-8e855b8bba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:30.308349 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c85fd-918a-4031-b2b0-8e855b8bba1c admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:30.309045 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c85fd-918a-4031-b2b0-8e855b8bba1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:30.310986 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c85fd-918a-4031-b2b0-8e855b8bba1c admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:30.329654 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1435/2870] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:11:30 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:11:30.333697 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b38c2d-5b24-4fb6-b511-475e3d110b33 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:30.344297 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b38c2d-5b24-4fb6-b511-475e3d110b33 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:30.348774 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5e5f6-a1f1-4b48-a64a-9033e81cfaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:30.349427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e5f6-a1f1-4b48-a64a-9033e81cfaee admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:30.349707 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e5f6-a1f1-4b48-a64a-9033e81cfaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:30.350011 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e5f6-a1f1-4b48-a64a-9033e81cfaee admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:30.350730 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5e5f6-a1f1-4b48-a64a-9033e81cfaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:30.352388 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5e5f6-a1f1-4b48-a64a-9033e81cfaee admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:30.364757 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1436/2871] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:11:30.368724 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c85fd-918a-4031-b2b0-8e855b8bba1c admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:30.378863 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c85fd-918a-4031-b2b0-8e855b8bba1c admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:30.383432 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d15ee-d836-4e28-aae0-6f805f225d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:30.384077 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d15ee-d836-4e28-aae0-6f805f225d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:30.384365 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d15ee-d836-4e28-aae0-6f805f225d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:30.384640 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d15ee-d836-4e28-aae0-6f805f225d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:30.385356 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d15ee-d836-4e28-aae0-6f805f225d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:30.387002 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d15ee-d836-4e28-aae0-6f805f225d2d admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:30.396727 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1436/2872] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:11:30.401108 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5e5f6-a1f1-4b48-a64a-9033e81cfaee admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:30.410985 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5e5f6-a1f1-4b48-a64a-9033e81cfaee admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:30.415560 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb861d-8ac8-4d45-9a34-0b0853f635bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:30.417006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb861d-8ac8-4d45-9a34-0b0853f635bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:30.417286 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb861d-8ac8-4d45-9a34-0b0853f635bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:30.417589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb861d-8ac8-4d45-9a34-0b0853f635bc admin admin] PATH_INFO: `/v3/projects/cc70b1304b4e4258899ceef61bb05ced/users/2abcccdd83c04c0898765bfe07cf6163/roles/01ccb434cf384bc79bf82f49b697f1ce` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:30.431839 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb861d-8ac8-4d45-9a34-0b0853f635bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc70b1304b4e4258899ceef61bb05ced, user_id=2abcccdd83c04c0898765bfe07cf6163, role_id=01ccb434cf384bc79bf82f49b697f1ce)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:30.434544 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb861d-8ac8-4d45-9a34-0b0853f635bc admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:30.446571 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1437/2873] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:11:30 2022] PUT /identity/v3/projects/cc70b1304b4e4258899ceef61bb05ced/users/2abcccdd83c04c0898765bfe07cf6163/roles/01ccb434cf384bc79bf82f49b697f1ce => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:11:30.451796 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a738ee-b977-4ca3-adf0-76d5b8a4e5dc None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:30.452305 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a738ee-b977-4ca3-adf0-76d5b8a4e5dc None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:30.452415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a738ee-b977-4ca3-adf0-76d5b8a4e5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:30.470233 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-63a738ee-b977-4ca3-adf0-76d5b8a4e5dc None None] MFA Rules not processed for user `6e81933b979640d390f4c808a9dcf7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:30.471415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-63a738ee-b977-4ca3-adf0-76d5b8a4e5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:30.479713 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:30.532600 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1437/2874] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:11:30.542139 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb861d-8ac8-4d45-9a34-0b0853f635bc admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:30.543843 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-defb861d-8ac8-4d45-9a34-0b0853f635bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:30.605807 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb861d-8ac8-4d45-9a34-0b0853f635bc admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:30.609458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd3fd3-9781-4d80-9988-83e359cde739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:30.610128 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd3fd3-9781-4d80-9988-83e359cde739 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:30.610411 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd3fd3-9781-4d80-9988-83e359cde739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:30.610686 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd3fd3-9781-4d80-9988-83e359cde739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:30.619787 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd3fd3-9781-4d80-9988-83e359cde739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:30.621206 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd3fd3-9781-4d80-9988-83e359cde739 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:30.630802 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1438/2875] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:11:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:11:34.294912 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df48fb7-dc2e-4da0-b8e5-9f439e3d7cb9 None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:34.295428 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df48fb7-dc2e-4da0-b8e5-9f439e3d7cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:34.295537 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df48fb7-dc2e-4da0-b8e5-9f439e3d7cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:34.326285 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-4df48fb7-dc2e-4da0-b8e5-9f439e3d7cb9 None None] MFA Rules not processed for user `2abcccdd83c04c0898765bfe07cf6163`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:34.327489 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4df48fb7-dc2e-4da0-b8e5-9f439e3d7cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:34.402555 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1438/2876] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:11:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:11:34.407313 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd3fd3-9781-4d80-9988-83e359cde739 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:34.418440 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd3fd3-9781-4d80-9988-83e359cde739 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:34.425024 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8f4ea-0fa4-42e7-b386-16ff9dc2d9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:34.425792 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8f4ea-0fa4-42e7-b386-16ff9dc2d9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:34.426187 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8f4ea-0fa4-42e7-b386-16ff9dc2d9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:34.426835 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8f4ea-0fa4-42e7-b386-16ff9dc2d9a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:34.427624 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8f4ea-0fa4-42e7-b386-16ff9dc2d9a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:34.429598 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8f4ea-0fa4-42e7-b386-16ff9dc2d9a0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:34.462422 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1439/2877] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 7 22:11:34 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:11:34.466743 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df48fb7-dc2e-4da0-b8e5-9f439e3d7cb9 None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:34.478967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df48fb7-dc2e-4da0-b8e5-9f439e3d7cb9 None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:34.555287 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255d281-26ff-4442-9fa4-09c958cd2ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:34.556310 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255d281-26ff-4442-9fa4-09c958cd2ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:34.557350 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255d281-26ff-4442-9fa4-09c958cd2ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:34.557880 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255d281-26ff-4442-9fa4-09c958cd2ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:34.558772 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255d281-26ff-4442-9fa4-09c958cd2ee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:34.561355 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255d281-26ff-4442-9fa4-09c958cd2ee2 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:34.583834 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1439/2878] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 7 22:11:34 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 22:11:34.585035 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8f4ea-0fa4-42e7-b386-16ff9dc2d9a0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:34.596131 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8f4ea-0fa4-42e7-b386-16ff9dc2d9a0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:34.601006 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6f1eb-6672-4ace-abba-45a21d1bec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:34.601665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6f1eb-6672-4ace-abba-45a21d1bec95 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:34.601983 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6f1eb-6672-4ace-abba-45a21d1bec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:34.602270 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6f1eb-6672-4ace-abba-45a21d1bec95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:34.603007 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6f1eb-6672-4ace-abba-45a21d1bec95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:34.604844 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6f1eb-6672-4ace-abba-45a21d1bec95 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:34.616471 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1440/2879] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 22:11:34.621705 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255d281-26ff-4442-9fa4-09c958cd2ee2 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:34.633001 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255d281-26ff-4442-9fa4-09c958cd2ee2 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:34.637983 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f133b-714a-4d8c-b5ca-5b72fd41e0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:34.638921 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f133b-714a-4d8c-b5ca-5b72fd41e0c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:34.639209 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f133b-714a-4d8c-b5ca-5b72fd41e0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:34.639484 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f133b-714a-4d8c-b5ca-5b72fd41e0c8 admin admin] PATH_INFO: `/v3/projects/e0a108688ed94aa699caadf4cfc89490/users/37e38f4d68d043abb43a6f82175123e0/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:34.674709 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f133b-714a-4d8c-b5ca-5b72fd41e0c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a108688ed94aa699caadf4cfc89490, user_id=37e38f4d68d043abb43a6f82175123e0, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:34.674709 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f133b-714a-4d8c-b5ca-5b72fd41e0c8 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:34.691888 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1440/2880] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:11:34 2022] PUT /identity/v3/projects/e0a108688ed94aa699caadf4cfc89490/users/37e38f4d68d043abb43a6f82175123e0/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:11:34.701578 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6f1eb-6672-4ace-abba-45a21d1bec95 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:34.711898 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6f1eb-6672-4ace-abba-45a21d1bec95 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:34.763031 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:34.787808 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb441af-4a43-42ef-bdd9-c485916742e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:34.788491 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb441af-4a43-42ef-bdd9-c485916742e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:34.788783 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb441af-4a43-42ef-bdd9-c485916742e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:34.789062 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb441af-4a43-42ef-bdd9-c485916742e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:34.790092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb441af-4a43-42ef-bdd9-c485916742e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:34.792075 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb441af-4a43-42ef-bdd9-c485916742e3 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:34.803408 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1441/2881] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 7 22:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 22:11:34.807723 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f133b-714a-4d8c-b5ca-5b72fd41e0c8 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:34.818698 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f133b-714a-4d8c-b5ca-5b72fd41e0c8 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:34.823524 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c83cfb-2218-493a-8d70-65d3c9d87782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:34.824427 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c83cfb-2218-493a-8d70-65d3c9d87782 admin admin] REQUEST_METHOD: `PUT` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:34.824711 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c83cfb-2218-493a-8d70-65d3c9d87782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:34.824988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c83cfb-2218-493a-8d70-65d3c9d87782 admin admin] PATH_INFO: `/v3/projects/e0a108688ed94aa699caadf4cfc89490/users/37e38f4d68d043abb43a6f82175123e0/roles/8f58ef9d28494d97a68de20b84355450` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:34.827116 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c83cfb-2218-493a-8d70-65d3c9d87782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a108688ed94aa699caadf4cfc89490, user_id=37e38f4d68d043abb43a6f82175123e0, role_id=8f58ef9d28494d97a68de20b84355450)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:34.829805 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c83cfb-2218-493a-8d70-65d3c9d87782 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:34.833389 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:34.848126 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1441/2882] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 7 22:11:34 2022] PUT /identity/v3/projects/e0a108688ed94aa699caadf4cfc89490/users/37e38f4d68d043abb43a6f82175123e0/roles/8f58ef9d28494d97a68de20b84355450 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:11:39.194829 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b96b2-22bb-4ca1-b0c6-196b5ac62f88 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:39.195326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b96b2-22bb-4ca1-b0c6-196b5ac62f88 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:39.195427 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b96b2-22bb-4ca1-b0c6-196b5ac62f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:39.223784 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d17b96b2-22bb-4ca1-b0c6-196b5ac62f88 None None] MFA Rules not processed for user `37e38f4d68d043abb43a6f82175123e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:39.225013 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d17b96b2-22bb-4ca1-b0c6-196b5ac62f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:39.295557 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1442/2883] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:11:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:11:39.308133 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c83cfb-2218-493a-8d70-65d3c9d87782 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:39.309882 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-26c83cfb-2218-493a-8d70-65d3c9d87782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:39.375895 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c83cfb-2218-493a-8d70-65d3c9d87782 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:39.379679 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6e7e0-e9c4-4947-aa32-97ddd373da0e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a3c022963e74e989a703938ff057757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:39.380397 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6e7e0-e9c4-4947-aa32-97ddd373da0e service glance] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:39.380746 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6e7e0-e9c4-4947-aa32-97ddd373da0e service glance] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:39.381084 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6e7e0-e9c4-4947-aa32-97ddd373da0e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:39.437875 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6e7e0-e9c4-4947-aa32-97ddd373da0e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:39.439457 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6e7e0-e9c4-4947-aa32-97ddd373da0e service glance] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:39.450837 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1442/2884] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:11:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:11:39.566688 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08632-9531-4ccb-9586-4edbc2d8513b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:39.567003 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08632-9531-4ccb-9586-4edbc2d8513b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:39.567333 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08632-9531-4ccb-9586-4edbc2d8513b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:39.586110 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-40c08632-9531-4ccb-9586-4edbc2d8513b None None] MFA Rules not processed for user `4fc55e3a9107489a9b24385ac5379ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:39.587355 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-40c08632-9531-4ccb-9586-4edbc2d8513b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:39.645715 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1443/2885] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 7 22:11:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 22:11:39.658093 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6e7e0-e9c4-4947-aa32-97ddd373da0e service glance] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:39.659575 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-26b6e7e0-e9c4-4947-aa32-97ddd373da0e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:39.746268 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6e7e0-e9c4-4947-aa32-97ddd373da0e service glance] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:39.753532 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d28a3-7314-4636-a55e-cd1c7d613471 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b69c708fbc470aae3e3954e21a1e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:39.754255 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d28a3-7314-4636-a55e-cd1c7d613471 service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:39.754541 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d28a3-7314-4636-a55e-cd1c7d613471 service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:39.754814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d28a3-7314-4636-a55e-cd1c7d613471 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:39.764549 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d28a3-7314-4636-a55e-cd1c7d613471 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:39.766311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d28a3-7314-4636-a55e-cd1c7d613471 service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:39.776369 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1443/2886] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 7 22:11:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 22:11:48.393393 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742a404-243a-4c79-ba77-cca56bae9c21 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:48.393918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742a404-243a-4c79-ba77-cca56bae9c21 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:48.393918 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742a404-243a-4c79-ba77-cca56bae9c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:48.411821 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f742a404-243a-4c79-ba77-cca56bae9c21 None None] MFA Rules not processed for user `2abcccdd83c04c0898765bfe07cf6163`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:48.413029 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f742a404-243a-4c79-ba77-cca56bae9c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:48.420682 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1444/2887] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 7 22:11:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:11:48.461819 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d28a3-7314-4636-a55e-cd1c7d613471 service swift] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:48.471454 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d28a3-7314-4636-a55e-cd1c7d613471 service swift] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:48.475316 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12ba17-8e5f-48c1-b43f-64397d59638c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a3c022963e74e989a703938ff057757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:48.475967 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12ba17-8e5f-48c1-b43f-64397d59638c service glance] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:48.476228 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12ba17-8e5f-48c1-b43f-64397d59638c service glance] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:48.476506 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12ba17-8e5f-48c1-b43f-64397d59638c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:48.478834 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-eb12ba17-8e5f-48c1-b43f-64397d59638c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:48.518331 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:48.550765 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12ba17-8e5f-48c1-b43f-64397d59638c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:48.552200 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12ba17-8e5f-48c1-b43f-64397d59638c service glance] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:48.564282 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1444/2888] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:11:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:11:48.783904 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742a404-243a-4c79-ba77-cca56bae9c21 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:48.785318 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f742a404-243a-4c79-ba77-cca56bae9c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:48.842766 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742a404-243a-4c79-ba77-cca56bae9c21 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:48.846326 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d72045-a749-4790-b445-1726db815335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:48.846966 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d72045-a749-4790-b445-1726db815335 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:48.847250 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d72045-a749-4790-b445-1726db815335 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:48.847524 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d72045-a749-4790-b445-1726db815335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:48.849334 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d5d72045-a749-4790-b445-1726db815335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:48.858828 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d72045-a749-4790-b445-1726db815335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:48.860240 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d72045-a749-4790-b445-1726db815335 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:48.868899 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1445/2889] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:11:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:11:49.180459 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12ba17-8e5f-48c1-b43f-64397d59638c service glance] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:49.184168 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-eb12ba17-8e5f-48c1-b43f-64397d59638c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:49.184900 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d72045-a749-4790-b445-1726db815335 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:49.188982 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:11:49.194685 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d72045-a749-4790-b445-1726db815335 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:49.199480 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663417e-eb03-40b3-a9ea-d77c3502aa35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:49.200180 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663417e-eb03-40b3-a9ea-d77c3502aa35 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:49.200464 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663417e-eb03-40b3-a9ea-d77c3502aa35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:49.200740 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663417e-eb03-40b3-a9ea-d77c3502aa35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:49.202589 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e663417e-eb03-40b3-a9ea-d77c3502aa35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:49.217194 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663417e-eb03-40b3-a9ea-d77c3502aa35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:49.220253 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663417e-eb03-40b3-a9ea-d77c3502aa35 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:49.232981 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1446/2890] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:11:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:11:49.256186 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12ba17-8e5f-48c1-b43f-64397d59638c service glance] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:49.261556 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae3c3a-fb42-44d0-909d-ab59d8649aab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90facf92f97d435dbe8a001759a8fe0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:49.262267 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3c3a-fb42-44d0-909d-ab59d8649aab service placement] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:49.262645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3c3a-fb42-44d0-909d-ab59d8649aab service placement] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:49.262956 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae3c3a-fb42-44d0-909d-ab59d8649aab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:49.264715 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-19ae3c3a-fb42-44d0-909d-ab59d8649aab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:49.276601 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae3c3a-fb42-44d0-909d-ab59d8649aab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:49.278348 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae3c3a-fb42-44d0-909d-ab59d8649aab service placement] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:49.288887 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1445/2891] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:11:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:11:50.534287 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331dd38-3cb1-4d07-9685-e6816473e07f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:50.534746 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331dd38-3cb1-4d07-9685-e6816473e07f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:50.534838 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331dd38-3cb1-4d07-9685-e6816473e07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:50.553056 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1331dd38-3cb1-4d07-9685-e6816473e07f None None] MFA Rules not processed for user `4fc55e3a9107489a9b24385ac5379ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:11:50.554450 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1331dd38-3cb1-4d07-9685-e6816473e07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:50.562284 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1447/2892] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 7 22:11:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:11:50.575251 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae3c3a-fb42-44d0-909d-ab59d8649aab service placement] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:50.586685 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae3c3a-fb42-44d0-909d-ab59d8649aab service placement] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:50.592659 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c077b1b-67b4-4a23-afaf-8193126fc9b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b69c708fbc470aae3e3954e21a1e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:50.593291 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077b1b-67b4-4a23-afaf-8193126fc9b8 service swift] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:50.593597 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077b1b-67b4-4a23-afaf-8193126fc9b8 service swift] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:50.593839 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077b1b-67b4-4a23-afaf-8193126fc9b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:50.602278 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c077b1b-67b4-4a23-afaf-8193126fc9b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:50.603911 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c077b1b-67b4-4a23-afaf-8193126fc9b8 service swift] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:50.612702 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1446/2893] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 7 22:11:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 22:11:58.519972 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331dd38-3cb1-4d07-9685-e6816473e07f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:58.520609 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c077b1b-67b4-4a23-afaf-8193126fc9b8 service swift] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:11:58.530347 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331dd38-3cb1-4d07-9685-e6816473e07f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:58.530529 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c077b1b-67b4-4a23-afaf-8193126fc9b8 service swift] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:11:58.533936 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce46a91-4f21-41e9-ac40-0bceba4b452e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:58.534394 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2d511-140d-480c-9099-57d8ce2f0a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:11:58.534591 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46a91-4f21-41e9-ac40-0bceba4b452e service neutron] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:58.534874 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46a91-4f21-41e9-ac40-0bceba4b452e service neutron] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:58.535030 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2d511-140d-480c-9099-57d8ce2f0a32 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:11:58.535139 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46a91-4f21-41e9-ac40-0bceba4b452e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:58.535317 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2d511-140d-480c-9099-57d8ce2f0a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:11:58.535593 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2d511-140d-480c-9099-57d8ce2f0a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:11:58.536958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0ce46a91-4f21-41e9-ac40-0bceba4b452e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:58.537310 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5fd2d511-140d-480c-9099-57d8ce2f0a32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:11:58.547219 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2d511-140d-480c-9099-57d8ce2f0a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:58.547391 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce46a91-4f21-41e9-ac40-0bceba4b452e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:11:58.548655 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce46a91-4f21-41e9-ac40-0bceba4b452e service neutron] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:58.548780 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2d511-140d-480c-9099-57d8ce2f0a32 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:11:58.557051 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1447/2894] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:11:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 22:11:58.557502 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1448/2895] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:11:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:12:06.634351 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce46a91-4f21-41e9-ac40-0bceba4b452e service neutron] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:12:06.635853 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-0ce46a91-4f21-41e9-ac40-0bceba4b452e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:12:06.655159 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce46a91-4f21-41e9-ac40-0bceba4b452e service neutron] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:12:06.661608 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadd91a-90ae-4a76-a217-1c94fbbfb58d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90facf92f97d435dbe8a001759a8fe0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:12:06.662667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadd91a-90ae-4a76-a217-1c94fbbfb58d service placement] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:12:06.663134 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadd91a-90ae-4a76-a217-1c94fbbfb58d service placement] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:12:06.663815 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadd91a-90ae-4a76-a217-1c94fbbfb58d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:12:06.666030 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-4eadd91a-90ae-4a76-a217-1c94fbbfb58d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:12:06.680793 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eadd91a-90ae-4a76-a217-1c94fbbfb58d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:12:06.683507 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eadd91a-90ae-4a76-a217-1c94fbbfb58d service placement] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:12:06.701409 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1448/2896] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:12:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:12:08.554113 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=14 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:09.864689 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2d511-140d-480c-9099-57d8ce2f0a32 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:12:09.866188 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5fd2d511-140d-480c-9099-57d8ce2f0a32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:12:09.938141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2d511-140d-480c-9099-57d8ce2f0a32 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:12:09.942815 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fb9ae-657d-48f2-a9f8-c44086e36551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:12:09.943706 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fb9ae-657d-48f2-a9f8-c44086e36551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:12:09.944017 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fb9ae-657d-48f2-a9f8-c44086e36551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:12:09.944295 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fb9ae-657d-48f2-a9f8-c44086e36551 admin admin] PATH_INFO: `/v3/users/41c11f8edbd648869963db0f1846cbf9` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:12:09.945527 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fb9ae-657d-48f2-a9f8-c44086e36551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41c11f8edbd648869963db0f1846cbf9)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:12:09.947610 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fb9ae-657d-48f2-a9f8-c44086e36551 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:12:10.000151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-252fb9ae-657d-48f2-a9f8-c44086e36551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41c11f8edbd648869963db0f1846cbf9'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.007477 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-252fb9ae-657d-48f2-a9f8-c44086e36551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41c11f8edbd648869963db0f1846cbf9'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.016486 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-252fb9ae-657d-48f2-a9f8-c44086e36551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41c11f8edbd648869963db0f1846cbf9'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.017113 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-252fb9ae-657d-48f2-a9f8-c44086e36551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41c11f8edbd648869963db0f1846cbf9'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.017789 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-252fb9ae-657d-48f2-a9f8-c44086e36551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41c11f8edbd648869963db0f1846cbf9'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.036383 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1449/2897] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:12:09 2022] DELETE /identity/v3/users/41c11f8edbd648869963db0f1846cbf9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 22:12:10.201879 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadd91a-90ae-4a76-a217-1c94fbbfb58d service placement] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:12:10.213115 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadd91a-90ae-4a76-a217-1c94fbbfb58d service placement] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:12:10.271681 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b159c0-16ee-4f04-95c8-483c7daacd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:12:10.272554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b159c0-16ee-4f04-95c8-483c7daacd7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:12:10.272842 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b159c0-16ee-4f04-95c8-483c7daacd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:12:10.273119 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b159c0-16ee-4f04-95c8-483c7daacd7f admin admin] PATH_INFO: `/v3/projects/b1ce9e56e13745e3b69e08b620b5335d` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:12:10.274958 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b159c0-16ee-4f04-95c8-483c7daacd7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ce9e56e13745e3b69e08b620b5335d)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:12:10.276858 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b159c0-16ee-4f04-95c8-483c7daacd7f admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:12:10.293127 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=100 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:10.321858 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-35b159c0-16ee-4f04-95c8-483c7daacd7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ce9e56e13745e3b69e08b620b5335d', 'request_id': 'req-35b159c0-16ee-4f04-95c8-483c7daacd7f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.327248 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-35b159c0-16ee-4f04-95c8-483c7daacd7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ce9e56e13745e3b69e08b620b5335d', 'request_id': 'req-35b159c0-16ee-4f04-95c8-483c7daacd7f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.333204 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-35b159c0-16ee-4f04-95c8-483c7daacd7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ce9e56e13745e3b69e08b620b5335d', 'request_id': 'req-35b159c0-16ee-4f04-95c8-483c7daacd7f'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.345560 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-35b159c0-16ee-4f04-95c8-483c7daacd7f admin admin] The token cache is being invalidate because project b1ce9e56e13745e3b69e08b620b5335d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:12:10.345839 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-35b159c0-16ee-4f04-95c8-483c7daacd7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.346475 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-35b159c0-16ee-4f04-95c8-483c7daacd7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.347988 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1449/2898] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:12:10 2022] DELETE /identity/v3/projects/b1ce9e56e13745e3b69e08b620b5335d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:12:10.353870 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fb9ae-657d-48f2-a9f8-c44086e36551 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:12:10.355313 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-252fb9ae-657d-48f2-a9f8-c44086e36551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:12:10.368963 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fb9ae-657d-48f2-a9f8-c44086e36551 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:12:10.423625 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3aba54-1a8a-4b6b-a5e4-917ba704e9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:12:10.424516 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aba54-1a8a-4b6b-a5e4-917ba704e9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:12:10.424798 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aba54-1a8a-4b6b-a5e4-917ba704e9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:12:10.425072 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aba54-1a8a-4b6b-a5e4-917ba704e9a9 admin admin] PATH_INFO: `/v3/users/69962cad34e3472aa82323cc8912bef1` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:12:10.426321 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3aba54-1a8a-4b6b-a5e4-917ba704e9a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69962cad34e3472aa82323cc8912bef1)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:12:10.428253 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3aba54-1a8a-4b6b-a5e4-917ba704e9a9 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:12:10.450330 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:10.476304 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0f3aba54-1a8a-4b6b-a5e4-917ba704e9a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69962cad34e3472aa82323cc8912bef1'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.483073 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0f3aba54-1a8a-4b6b-a5e4-917ba704e9a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69962cad34e3472aa82323cc8912bef1'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.490410 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0f3aba54-1a8a-4b6b-a5e4-917ba704e9a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69962cad34e3472aa82323cc8912bef1'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.491025 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0f3aba54-1a8a-4b6b-a5e4-917ba704e9a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69962cad34e3472aa82323cc8912bef1'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.491627 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0f3aba54-1a8a-4b6b-a5e4-917ba704e9a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69962cad34e3472aa82323cc8912bef1'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.511735 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1450/2899] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:12:10 2022] DELETE /identity/v3/users/69962cad34e3472aa82323cc8912bef1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:12:10.679670 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b159c0-16ee-4f04-95c8-483c7daacd7f admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:12:10.681685 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-35b159c0-16ee-4f04-95c8-483c7daacd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:12:10.700323 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b159c0-16ee-4f04-95c8-483c7daacd7f admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:12:10.755563 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f84be8-1ac3-4085-8a98-051b5d365ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:12:10.756415 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84be8-1ac3-4085-8a98-051b5d365ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:12:10.756691 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84be8-1ac3-4085-8a98-051b5d365ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:12:10.756964 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84be8-1ac3-4085-8a98-051b5d365ad0 admin admin] PATH_INFO: `/v3/projects/b13d61b8f75848b5b0b1d27a69a586ed` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:12:10.758193 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f84be8-1ac3-4085-8a98-051b5d365ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b13d61b8f75848b5b0b1d27a69a586ed)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:12:10.760570 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f84be8-1ac3-4085-8a98-051b5d365ad0 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:12:10.807557 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a0f84be8-1ac3-4085-8a98-051b5d365ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13d61b8f75848b5b0b1d27a69a586ed', 'request_id': 'req-a0f84be8-1ac3-4085-8a98-051b5d365ad0'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.813371 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a0f84be8-1ac3-4085-8a98-051b5d365ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13d61b8f75848b5b0b1d27a69a586ed', 'request_id': 'req-a0f84be8-1ac3-4085-8a98-051b5d365ad0'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.819535 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a0f84be8-1ac3-4085-8a98-051b5d365ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13d61b8f75848b5b0b1d27a69a586ed', 'request_id': 'req-a0f84be8-1ac3-4085-8a98-051b5d365ad0'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.833613 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a0f84be8-1ac3-4085-8a98-051b5d365ad0 admin admin] The token cache is being invalidate because project b13d61b8f75848b5b0b1d27a69a586ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:12:10.833909 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a0f84be8-1ac3-4085-8a98-051b5d365ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.834989 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-a0f84be8-1ac3-4085-8a98-051b5d365ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:12:10.836075 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1450/2900] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:12:10 2022] DELETE /identity/v3/projects/b13d61b8f75848b5b0b1d27a69a586ed => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:12:12.634255 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3aba54-1a8a-4b6b-a5e4-917ba704e9a9 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:12:12.635743 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0f3aba54-1a8a-4b6b-a5e4-917ba704e9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:12:12.692098 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3aba54-1a8a-4b6b-a5e4-917ba704e9a9 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:12:12.738101 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61ff4d-6e5e-424e-bc8e-31ca2e9b0cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab50bc9064e444184afb1b4c585ce39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:12:12.738734 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61ff4d-6e5e-424e-bc8e-31ca2e9b0cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:12:12.739012 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61ff4d-6e5e-424e-bc8e-31ca2e9b0cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:12:12.739280 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61ff4d-6e5e-424e-bc8e-31ca2e9b0cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:12:12.741027 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8a61ff4d-6e5e-424e-bc8e-31ca2e9b0cf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:12:12.800940 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61ff4d-6e5e-424e-bc8e-31ca2e9b0cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:12:12.802465 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61ff4d-6e5e-424e-bc8e-31ca2e9b0cf2 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:12:12.812323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1451/2901] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:12:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:12:14.559742 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f84be8-1ac3-4085-8a98-051b5d365ad0 admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:12:14.561263 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-a0f84be8-1ac3-4085-8a98-051b5d365ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:12:14.606780 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:14.660715 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f84be8-1ac3-4085-8a98-051b5d365ad0 admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:12:14.666911 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a6599-ffc9-4f41-b36a-599c81401027 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:12:14.667919 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a6599-ffc9-4f41-b36a-599c81401027 service nova] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:12:14.667919 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a6599-ffc9-4f41-b36a-599c81401027 service nova] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:12:14.668224 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a6599-ffc9-4f41-b36a-599c81401027 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:12:14.670814 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-c28a6599-ffc9-4f41-b36a-599c81401027 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:12:14.690552 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a6599-ffc9-4f41-b36a-599c81401027 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:12:14.692900 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a6599-ffc9-4f41-b36a-599c81401027 service nova] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:12:14.707214 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1451/2902] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:12:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:12:22.808281 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:12:24.702055 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=18 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:13:40.210054 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61ff4d-6e5e-424e-bc8e-31ca2e9b0cf2 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:13:40.310247 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61ff4d-6e5e-424e-bc8e-31ca2e9b0cf2 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:13:40.318739 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2920320-3133-419c-9508-a970637ca4ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d5760a3f9f946978b1251d3e2aaa943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:13:40.321487 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2920320-3133-419c-9508-a970637ca4ad service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:13:40.322116 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2920320-3133-419c-9508-a970637ca4ad service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:13:40.323265 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2920320-3133-419c-9508-a970637ca4ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:13:40.325977 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d2920320-3133-419c-9508-a970637ca4ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:13:40.358949 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2920320-3133-419c-9508-a970637ca4ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:13:40.360693 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2920320-3133-419c-9508-a970637ca4ad service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:13:40.386374 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1452/2903] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:13:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:13:47.990633 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588c0c7-c64d-43f2-80ec-bc87dd3cb2aa None None] REQUEST_METHOD: `POST` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:13:47.991067 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588c0c7-c64d-43f2-80ec-bc87dd3cb2aa None None] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:13:47.991187 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588c0c7-c64d-43f2-80ec-bc87dd3cb2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:13:48.009154 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.auth.core [None req-9588c0c7-c64d-43f2-80ec-bc87dd3cb2aa None None] MFA Rules not processed for user `4fc55e3a9107489a9b24385ac5379ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 22:13:48.010368 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9588c0c7-c64d-43f2-80ec-bc87dd3cb2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:13:48.073662 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1452/2904] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jun 7 22:13:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 22:13:48.112790 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2920320-3133-419c-9508-a970637ca4ad service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:13:48.114287 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d2920320-3133-419c-9508-a970637ca4ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:13:48.190181 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2920320-3133-419c-9508-a970637ca4ad service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:13:48.195037 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1552c-156c-4f75-aba2-35f93e0e0ca6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b69c708fbc470aae3e3954e21a1e88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:13:48.195700 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1552c-156c-4f75-aba2-35f93e0e0ca6 service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:13:48.195980 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1552c-156c-4f75-aba2-35f93e0e0ca6 service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:13:48.196255 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1552c-156c-4f75-aba2-35f93e0e0ca6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:13:48.204118 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1552c-156c-4f75-aba2-35f93e0e0ca6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:13:48.205697 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1552c-156c-4f75-aba2-35f93e0e0ca6 service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:13:48.214151 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1453/2905] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 7 22:13:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 22:13:51.269953 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588c0c7-c64d-43f2-80ec-bc87dd3cb2aa None None] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:13:51.271884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-9588c0c7-c64d-43f2-80ec-bc87dd3cb2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:13:51.407235 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588c0c7-c64d-43f2-80ec-bc87dd3cb2aa None None] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:13:51.412311 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc721f8-a240-4c06-b6ca-6a6c8a0ef9f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90facf92f97d435dbe8a001759a8fe0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:13:51.412965 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc721f8-a240-4c06-b6ca-6a6c8a0ef9f6 service placement] REQUEST_METHOD: `GET` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:13:51.413253 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc721f8-a240-4c06-b6ca-6a6c8a0ef9f6 service placement] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:13:51.413533 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc721f8-a240-4c06-b6ca-6a6c8a0ef9f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:13:51.415437 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-dfc721f8-a240-4c06-b6ca-6a6c8a0ef9f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:13:51.427693 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc721f8-a240-4c06-b6ca-6a6c8a0ef9f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:13:51.429323 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc721f8-a240-4c06-b6ca-6a6c8a0ef9f6 service placement] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:13:51.440324 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1453/2906] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:13:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:13:54.363547 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1552c-156c-4f75-aba2-35f93e0e0ca6 service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:13:54.365882 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-02c1552c-156c-4f75-aba2-35f93e0e0ca6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:13:54.473653 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1552c-156c-4f75-aba2-35f93e0e0ca6 service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:13:54.478800 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69204e-0736-4578-9be5-8d2af42f48df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:13:54.479665 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69204e-0736-4578-9be5-8d2af42f48df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:13:54.479947 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69204e-0736-4578-9be5-8d2af42f48df admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:13:54.480222 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69204e-0736-4578-9be5-8d2af42f48df admin admin] PATH_INFO: `/v3/users/2abcccdd83c04c0898765bfe07cf6163` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:13:54.481405 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69204e-0736-4578-9be5-8d2af42f48df admin admin] RBAC: Authorizing `identity:delete_user(user_id=2abcccdd83c04c0898765bfe07cf6163)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:13:54.483399 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69204e-0736-4578-9be5-8d2af42f48df admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:13:54.484850 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:13:54.529651 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2d69204e-0736-4578-9be5-8d2af42f48df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2abcccdd83c04c0898765bfe07cf6163'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:54.536356 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2d69204e-0736-4578-9be5-8d2af42f48df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2abcccdd83c04c0898765bfe07cf6163'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:54.543494 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2d69204e-0736-4578-9be5-8d2af42f48df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2abcccdd83c04c0898765bfe07cf6163'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:54.544118 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2d69204e-0736-4578-9be5-8d2af42f48df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2abcccdd83c04c0898765bfe07cf6163'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:54.544724 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2d69204e-0736-4578-9be5-8d2af42f48df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2abcccdd83c04c0898765bfe07cf6163'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:54.562332 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1454/2907] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:13:54 2022] DELETE /identity/v3/users/2abcccdd83c04c0898765bfe07cf6163 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:13:54.730809 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc721f8-a240-4c06-b6ca-6a6c8a0ef9f6 service placement] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:13:54.743666 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc721f8-a240-4c06-b6ca-6a6c8a0ef9f6 service placement] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:13:54.799361 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:13:54.800217 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:13:54.800498 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:13:54.800782 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de admin admin] PATH_INFO: `/v3/projects/cc70b1304b4e4258899ceef61bb05ced` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:13:54.801959 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc70b1304b4e4258899ceef61bb05ced)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:13:54.803853 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:13:54.833884 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:13:54.849592 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc70b1304b4e4258899ceef61bb05ced', 'request_id': 'req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:54.855618 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc70b1304b4e4258899ceef61bb05ced', 'request_id': 'req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:54.861604 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc70b1304b4e4258899ceef61bb05ced', 'request_id': 'req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:54.873316 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de admin admin] The token cache is being invalidate because project cc70b1304b4e4258899ceef61bb05ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:13:54.873599 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:54.874236 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:54.875766 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1454/2908] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:13:54 2022] DELETE /identity/v3/projects/cc70b1304b4e4258899ceef61bb05ced => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:13:54.879752 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69204e-0736-4578-9be5-8d2af42f48df admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:13:54.881141 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2d69204e-0736-4578-9be5-8d2af42f48df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:13:54.894167 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69204e-0736-4578-9be5-8d2af42f48df admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:13:54.950564 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc7461-4f26-4259-81e8-b7dc92d321f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:13:54.951363 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc7461-4f26-4259-81e8-b7dc92d321f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:13:54.951644 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc7461-4f26-4259-81e8-b7dc92d321f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:13:54.951921 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc7461-4f26-4259-81e8-b7dc92d321f0 admin admin] PATH_INFO: `/v3/users/37e38f4d68d043abb43a6f82175123e0` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:13:54.953090 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc7461-4f26-4259-81e8-b7dc92d321f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e38f4d68d043abb43a6f82175123e0)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:13:54.955041 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc7461-4f26-4259-81e8-b7dc92d321f0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:13:55.000668 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8efc7461-4f26-4259-81e8-b7dc92d321f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e38f4d68d043abb43a6f82175123e0'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:55.007323 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8efc7461-4f26-4259-81e8-b7dc92d321f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e38f4d68d043abb43a6f82175123e0'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:55.013584 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8efc7461-4f26-4259-81e8-b7dc92d321f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e38f4d68d043abb43a6f82175123e0'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:55.014223 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8efc7461-4f26-4259-81e8-b7dc92d321f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e38f4d68d043abb43a6f82175123e0'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:55.014841 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8efc7461-4f26-4259-81e8-b7dc92d321f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e38f4d68d043abb43a6f82175123e0'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:55.027778 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:13:55.033313 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1455/2909] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 7 22:13:54 2022] DELETE /identity/v3/users/37e38f4d68d043abb43a6f82175123e0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:13:55.202956 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de admin admin] Authenticating user token {{(pid=80404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:13:55.204424 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.fernet_utils [None req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:13:55.217645 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4c23d-2531-4c70-a4a5-9bb13deb05de admin admin] Validating token access rules against request {{(pid=80404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:13:55.280639 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58dd79-c954-44a3-bc77-11ec39628c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e81933b979640d390f4c808a9dcf7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd15d054b930a4d03bfa50272128a53b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:13:55.281496 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58dd79-c954-44a3-bc77-11ec39628c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:13:55.281781 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58dd79-c954-44a3-bc77-11ec39628c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:13:55.282102 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58dd79-c954-44a3-bc77-11ec39628c25 admin admin] PATH_INFO: `/v3/projects/e0a108688ed94aa699caadf4cfc89490` {{(pid=80404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:13:55.283254 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58dd79-c954-44a3-bc77-11ec39628c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a108688ed94aa699caadf4cfc89490)` {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:13:55.285146 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58dd79-c954-44a3-bc77-11ec39628c25 admin admin] RBAC: Authorization granted {{(pid=80404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:13:55.328383 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0f58dd79-c954-44a3-bc77-11ec39628c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a108688ed94aa699caadf4cfc89490', 'request_id': 'req-0f58dd79-c954-44a3-bc77-11ec39628c25'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:55.333667 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0f58dd79-c954-44a3-bc77-11ec39628c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a108688ed94aa699caadf4cfc89490', 'request_id': 'req-0f58dd79-c954-44a3-bc77-11ec39628c25'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:55.340094 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0f58dd79-c954-44a3-bc77-11ec39628c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a108688ed94aa699caadf4cfc89490', 'request_id': 'req-0f58dd79-c954-44a3-bc77-11ec39628c25'} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:55.353554 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0f58dd79-c954-44a3-bc77-11ec39628c25 admin admin] The token cache is being invalidate because project e0a108688ed94aa699caadf4cfc89490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 22:13:55.353839 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0f58dd79-c954-44a3-bc77-11ec39628c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:55.354623 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG keystone.notifications [None req-0f58dd79-c954-44a3-bc77-11ec39628c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 22:13:55.356163 dv-cinder-835525-4-smb devstack@keystone.service[80404]: [pid: 80404|app: 0|req: 1455/2910] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 7 22:13:55 2022] DELETE /identity/v3/projects/e0a108688ed94aa699caadf4cfc89490 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 22:14:05.036458 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:14:05.350438 dv-cinder-835525-4-smb devstack@keystone.service[80404]: DEBUG dbcounter [-] [80404] Writing DB stats keystone:SELECT=65,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 22:14:42.192008 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc7461-4f26-4259-81e8-b7dc92d321f0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 22:14:42.193396 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8efc7461-4f26-4259-81e8-b7dc92d321f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:14:42.282560 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc7461-4f26-4259-81e8-b7dc92d321f0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 22:14:42.339910 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d220def-3848-4d24-9563-549ab7fbd338 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90facf92f97d435dbe8a001759a8fe0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca8f481deb242789622ebb10aa2c5da', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 22:14:42.340542 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d220def-3848-4d24-9563-549ab7fbd338 service placement] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 22:14:42.340820 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d220def-3848-4d24-9563-549ab7fbd338 service placement] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 22:14:42.341092 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d220def-3848-4d24-9563-549ab7fbd338 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 22:14:42.342823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3d220def-3848-4d24-9563-549ab7fbd338 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 22:14:42.354823 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d220def-3848-4d24-9563-549ab7fbd338 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 22:14:42.356912 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d220def-3848-4d24-9563-549ab7fbd338 service placement] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 22:14:42.367010 dv-cinder-835525-4-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1456/2911] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 7 22:14:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 22:14:52.362777 dv-cinder-835525-4-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=67 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}